00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 968 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3635 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.128 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.129 The recommended git tool is: git 00:00:00.129 using credential 00000000-0000-0000-0000-000000000002 00:00:00.131 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.165 Fetching changes from the remote Git repository 00:00:00.166 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.193 Using shallow fetch with depth 1 00:00:00.193 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.193 > git --version # timeout=10 00:00:00.219 > git --version # 'git version 2.39.2' 00:00:00.220 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.234 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.234 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.715 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.725 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.735 Checking out Revision b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf (FETCH_HEAD) 00:00:05.735 > git config core.sparsecheckout # timeout=10 00:00:05.744 > git read-tree -mu HEAD # timeout=10 00:00:05.757 > git checkout -f b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf # timeout=5 00:00:05.770 Commit message: "jenkins/jjb-config: Ignore OS version mismatch under freebsd" 00:00:05.770 > git rev-list --no-walk b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf # timeout=10 00:00:05.836 [Pipeline] Start of Pipeline 00:00:05.846 [Pipeline] library 00:00:05.848 Loading library shm_lib@master 00:00:05.848 Library shm_lib@master is cached. Copying from home. 00:00:05.865 [Pipeline] node 00:00:05.873 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.875 [Pipeline] { 00:00:05.881 [Pipeline] catchError 00:00:05.883 [Pipeline] { 00:00:05.891 [Pipeline] wrap 00:00:05.897 [Pipeline] { 00:00:05.903 [Pipeline] stage 00:00:05.905 [Pipeline] { (Prologue) 00:00:06.110 [Pipeline] sh 00:00:06.396 + logger -p user.info -t JENKINS-CI 00:00:06.410 [Pipeline] echo 00:00:06.412 Node: GP11 00:00:06.420 [Pipeline] sh 00:00:06.721 [Pipeline] setCustomBuildProperty 00:00:06.733 [Pipeline] echo 00:00:06.734 Cleanup processes 00:00:06.740 [Pipeline] sh 00:00:07.026 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.026 1371100 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.040 [Pipeline] sh 00:00:07.327 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.327 ++ grep -v 'sudo pgrep' 00:00:07.327 ++ awk '{print $1}' 00:00:07.327 + sudo kill -9 00:00:07.327 + true 00:00:07.345 [Pipeline] cleanWs 00:00:07.357 [WS-CLEANUP] Deleting project workspace... 00:00:07.357 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.364 [WS-CLEANUP] done 00:00:07.369 [Pipeline] setCustomBuildProperty 00:00:07.388 [Pipeline] sh 00:00:07.674 + sudo git config --global --replace-all safe.directory '*' 00:00:07.770 [Pipeline] httpRequest 00:00:08.977 [Pipeline] echo 00:00:08.979 Sorcerer 10.211.164.20 is alive 00:00:08.989 [Pipeline] retry 00:00:08.991 [Pipeline] { 00:00:09.007 [Pipeline] httpRequest 00:00:09.011 HttpMethod: GET 00:00:09.012 URL: http://10.211.164.20/packages/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:09.013 Sending request to url: http://10.211.164.20/packages/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:09.030 Response Code: HTTP/1.1 200 OK 00:00:09.030 Success: Status code 200 is in the accepted range: 200,404 00:00:09.031 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:11.084 [Pipeline] } 00:00:11.103 [Pipeline] // retry 00:00:11.113 [Pipeline] sh 00:00:11.400 + tar --no-same-owner -xf jbp_b9dd3f7ec12b0ee8a44940dc99ce739345caa4cf.tar.gz 00:00:11.417 [Pipeline] httpRequest 00:00:11.810 [Pipeline] echo 00:00:11.811 Sorcerer 10.211.164.20 is alive 00:00:11.819 [Pipeline] retry 00:00:11.821 [Pipeline] { 00:00:11.834 [Pipeline] httpRequest 00:00:11.838 HttpMethod: GET 00:00:11.838 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:11.839 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:11.857 Response Code: HTTP/1.1 200 OK 00:00:11.858 Success: Status code 200 is in the accepted range: 200,404 00:00:11.858 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:02.895 [Pipeline] } 00:01:02.913 [Pipeline] // retry 00:01:02.921 [Pipeline] sh 00:01:03.209 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:06.520 [Pipeline] sh 00:01:06.806 + git -C spdk log --oneline -n5 00:01:06.806 c13c99a5e test: Various fixes for Fedora40 00:01:06.806 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:06.806 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:06.806 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:06.806 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:06.825 [Pipeline] withCredentials 00:01:06.836 > git --version # timeout=10 00:01:06.850 > git --version # 'git version 2.39.2' 00:01:06.868 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:06.870 [Pipeline] { 00:01:06.879 [Pipeline] retry 00:01:06.881 [Pipeline] { 00:01:06.897 [Pipeline] sh 00:01:07.182 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:01:07.195 [Pipeline] } 00:01:07.213 [Pipeline] // retry 00:01:07.218 [Pipeline] } 00:01:07.235 [Pipeline] // withCredentials 00:01:07.245 [Pipeline] httpRequest 00:01:07.683 [Pipeline] echo 00:01:07.685 Sorcerer 10.211.164.20 is alive 00:01:07.695 [Pipeline] retry 00:01:07.698 [Pipeline] { 00:01:07.712 [Pipeline] httpRequest 00:01:07.717 HttpMethod: GET 00:01:07.717 URL: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:07.718 Sending request to url: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:07.736 Response Code: HTTP/1.1 200 OK 00:01:07.736 Success: Status code 200 is in the accepted range: 200,404 00:01:07.736 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:21.276 [Pipeline] } 00:01:21.293 [Pipeline] // retry 00:01:21.301 [Pipeline] sh 00:01:21.589 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:22.984 [Pipeline] sh 00:01:23.269 + git -C dpdk log --oneline -n5 00:01:23.269 eeb0605f11 version: 23.11.0 00:01:23.269 238778122a doc: update release notes for 23.11 00:01:23.269 46aa6b3cfc doc: fix description of RSS features 00:01:23.269 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:23.269 7e421ae345 devtools: support skipping forbid rule check 00:01:23.278 [Pipeline] } 00:01:23.292 [Pipeline] // stage 00:01:23.301 [Pipeline] stage 00:01:23.303 [Pipeline] { (Prepare) 00:01:23.323 [Pipeline] writeFile 00:01:23.340 [Pipeline] sh 00:01:23.621 + logger -p user.info -t JENKINS-CI 00:01:23.633 [Pipeline] sh 00:01:23.913 + logger -p user.info -t JENKINS-CI 00:01:23.924 [Pipeline] sh 00:01:24.256 + cat autorun-spdk.conf 00:01:24.256 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.256 SPDK_TEST_NVMF=1 00:01:24.256 SPDK_TEST_NVME_CLI=1 00:01:24.256 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.256 SPDK_TEST_NVMF_NICS=e810 00:01:24.256 SPDK_TEST_VFIOUSER=1 00:01:24.256 SPDK_RUN_UBSAN=1 00:01:24.256 NET_TYPE=phy 00:01:24.256 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:24.256 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.264 RUN_NIGHTLY=1 00:01:24.269 [Pipeline] readFile 00:01:24.295 [Pipeline] withEnv 00:01:24.297 [Pipeline] { 00:01:24.311 [Pipeline] sh 00:01:24.597 + set -ex 00:01:24.597 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:24.597 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:24.597 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:24.597 ++ SPDK_TEST_NVMF=1 00:01:24.597 ++ SPDK_TEST_NVME_CLI=1 00:01:24.597 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:24.597 ++ SPDK_TEST_NVMF_NICS=e810 00:01:24.597 ++ SPDK_TEST_VFIOUSER=1 00:01:24.597 ++ SPDK_RUN_UBSAN=1 00:01:24.597 ++ NET_TYPE=phy 00:01:24.597 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:24.597 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:24.597 ++ RUN_NIGHTLY=1 00:01:24.597 + case $SPDK_TEST_NVMF_NICS in 00:01:24.597 + DRIVERS=ice 00:01:24.597 + [[ tcp == \r\d\m\a ]] 00:01:24.597 + [[ -n ice ]] 00:01:24.597 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:24.597 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:24.597 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:24.597 rmmod: ERROR: Module irdma is not currently loaded 00:01:24.597 rmmod: ERROR: Module i40iw is not currently loaded 00:01:24.597 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:24.597 + true 00:01:24.597 + for D in $DRIVERS 00:01:24.597 + sudo modprobe ice 00:01:24.597 + exit 0 00:01:24.608 [Pipeline] } 00:01:24.624 [Pipeline] // withEnv 00:01:24.630 [Pipeline] } 00:01:24.646 [Pipeline] // stage 00:01:24.657 [Pipeline] catchError 00:01:24.658 [Pipeline] { 00:01:24.675 [Pipeline] timeout 00:01:24.675 Timeout set to expire in 1 hr 0 min 00:01:24.677 [Pipeline] { 00:01:24.692 [Pipeline] stage 00:01:24.694 [Pipeline] { (Tests) 00:01:24.709 [Pipeline] sh 00:01:25.000 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.000 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.000 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.000 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:25.000 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.000 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:25.000 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:25.000 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:25.000 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:25.000 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:25.000 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:25.000 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:25.000 + source /etc/os-release 00:01:25.000 ++ NAME='Fedora Linux' 00:01:25.000 ++ VERSION='39 (Cloud Edition)' 00:01:25.000 ++ ID=fedora 00:01:25.000 ++ VERSION_ID=39 00:01:25.000 ++ VERSION_CODENAME= 00:01:25.000 ++ PLATFORM_ID=platform:f39 00:01:25.000 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:25.000 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:25.000 ++ LOGO=fedora-logo-icon 00:01:25.000 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:25.000 ++ HOME_URL=https://fedoraproject.org/ 00:01:25.000 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:25.000 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:25.000 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:25.000 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:25.000 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:25.000 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:25.000 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:25.000 ++ SUPPORT_END=2024-11-12 00:01:25.000 ++ VARIANT='Cloud Edition' 00:01:25.000 ++ VARIANT_ID=cloud 00:01:25.000 + uname -a 00:01:25.000 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:25.000 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:25.939 Hugepages 00:01:25.939 node hugesize free / total 00:01:25.939 node0 1048576kB 0 / 0 00:01:25.939 node0 2048kB 0 / 0 00:01:25.939 node1 1048576kB 0 / 0 00:01:25.939 node1 2048kB 0 / 0 00:01:25.939 00:01:25.939 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:25.939 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:25.939 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:25.939 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:25.939 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:25.939 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:25.939 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:25.939 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:25.939 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:25.939 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:25.939 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:25.939 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:25.939 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:25.939 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:25.939 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:25.939 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:25.939 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:25.939 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:25.939 + rm -f /tmp/spdk-ld-path 00:01:25.939 + source autorun-spdk.conf 00:01:25.940 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.940 ++ SPDK_TEST_NVMF=1 00:01:25.940 ++ SPDK_TEST_NVME_CLI=1 00:01:25.940 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.940 ++ SPDK_TEST_NVMF_NICS=e810 00:01:25.940 ++ SPDK_TEST_VFIOUSER=1 00:01:25.940 ++ SPDK_RUN_UBSAN=1 00:01:25.940 ++ NET_TYPE=phy 00:01:25.940 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:25.940 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:25.940 ++ RUN_NIGHTLY=1 00:01:25.940 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:25.940 + [[ -n '' ]] 00:01:25.940 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.940 + for M in /var/spdk/build-*-manifest.txt 00:01:25.940 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:25.940 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.940 + for M in /var/spdk/build-*-manifest.txt 00:01:25.940 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:25.940 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.940 + for M in /var/spdk/build-*-manifest.txt 00:01:25.940 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:25.940 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:25.940 ++ uname 00:01:25.940 + [[ Linux == \L\i\n\u\x ]] 00:01:25.940 + sudo dmesg -T 00:01:25.940 + sudo dmesg --clear 00:01:25.940 + dmesg_pid=1371909 00:01:25.940 + [[ Fedora Linux == FreeBSD ]] 00:01:25.940 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.940 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:25.940 + sudo dmesg -Tw 00:01:25.940 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:25.940 + [[ -x /usr/src/fio-static/fio ]] 00:01:25.940 + export FIO_BIN=/usr/src/fio-static/fio 00:01:25.940 + FIO_BIN=/usr/src/fio-static/fio 00:01:25.940 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:25.940 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:25.940 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:25.940 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.940 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:25.940 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:25.940 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.940 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:25.940 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:25.940 Test configuration: 00:01:25.940 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:25.940 SPDK_TEST_NVMF=1 00:01:25.940 SPDK_TEST_NVME_CLI=1 00:01:25.940 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:25.940 SPDK_TEST_NVMF_NICS=e810 00:01:25.940 SPDK_TEST_VFIOUSER=1 00:01:25.940 SPDK_RUN_UBSAN=1 00:01:25.940 NET_TYPE=phy 00:01:25.940 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:25.940 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:25.940 RUN_NIGHTLY=1 17:21:03 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:25.940 17:21:03 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:25.940 17:21:03 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:25.940 17:21:03 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:25.940 17:21:03 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:25.940 17:21:03 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.940 17:21:03 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.940 17:21:03 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.940 17:21:03 -- paths/export.sh@5 -- $ export PATH 00:01:25.940 17:21:03 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:25.940 17:21:03 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:25.940 17:21:03 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:25.940 17:21:03 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731774063.XXXXXX 00:01:25.940 17:21:03 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731774063.5wO5ab 00:01:25.940 17:21:03 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:25.940 17:21:03 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:25.940 17:21:03 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:25.940 17:21:03 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:25.940 17:21:03 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:25.940 17:21:03 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:25.940 17:21:03 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:25.940 17:21:03 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:25.940 17:21:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.940 17:21:03 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:25.940 17:21:03 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:25.940 17:21:03 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:25.940 17:21:03 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:25.940 17:21:03 -- spdk/autobuild.sh@16 -- $ date -u 00:01:25.940 Sat Nov 16 04:21:03 PM UTC 2024 00:01:25.940 17:21:03 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:26.201 LTS-67-gc13c99a5e 00:01:26.201 17:21:03 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:26.201 17:21:03 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:26.201 17:21:03 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:26.201 17:21:03 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:26.201 17:21:03 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:26.201 17:21:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:26.201 ************************************ 00:01:26.201 START TEST ubsan 00:01:26.201 ************************************ 00:01:26.201 17:21:03 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:26.201 using ubsan 00:01:26.201 00:01:26.201 real 0m0.000s 00:01:26.201 user 0m0.000s 00:01:26.201 sys 0m0.000s 00:01:26.201 17:21:03 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:26.201 17:21:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:26.201 ************************************ 00:01:26.201 END TEST ubsan 00:01:26.201 ************************************ 00:01:26.201 17:21:03 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:26.201 17:21:03 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:26.201 17:21:03 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:26.201 17:21:03 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:26.201 17:21:03 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:26.201 17:21:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:26.201 ************************************ 00:01:26.201 START TEST build_native_dpdk 00:01:26.201 ************************************ 00:01:26.201 17:21:03 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:26.201 17:21:03 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:26.201 17:21:03 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:26.201 17:21:03 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:26.201 17:21:03 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:26.201 17:21:03 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:26.201 17:21:03 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:26.201 17:21:03 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:26.201 17:21:03 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:26.201 17:21:03 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:26.201 17:21:03 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:26.201 17:21:03 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:26.201 17:21:03 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:26.201 17:21:03 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:26.201 17:21:03 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:26.201 17:21:03 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:26.201 17:21:03 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:26.201 17:21:03 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:26.201 eeb0605f11 version: 23.11.0 00:01:26.201 238778122a doc: update release notes for 23.11 00:01:26.201 46aa6b3cfc doc: fix description of RSS features 00:01:26.201 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:26.201 7e421ae345 devtools: support skipping forbid rule check 00:01:26.201 17:21:03 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:26.201 17:21:03 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:26.201 17:21:03 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:26.201 17:21:03 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:26.201 17:21:03 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:26.201 17:21:03 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:26.201 17:21:03 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:26.201 17:21:03 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:26.201 17:21:03 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:26.201 17:21:03 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:26.201 17:21:03 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:26.201 17:21:03 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:26.201 17:21:03 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:26.201 17:21:03 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:26.201 17:21:03 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:26.201 17:21:03 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:26.201 17:21:03 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:26.201 17:21:03 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:26.201 17:21:03 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:26.201 17:21:03 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:26.201 17:21:03 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:26.201 17:21:03 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:26.201 17:21:03 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:26.201 17:21:03 -- scripts/common.sh@343 -- $ case "$op" in 00:01:26.201 17:21:03 -- scripts/common.sh@344 -- $ : 1 00:01:26.201 17:21:03 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:26.201 17:21:03 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:26.201 17:21:03 -- scripts/common.sh@364 -- $ decimal 23 00:01:26.201 17:21:03 -- scripts/common.sh@352 -- $ local d=23 00:01:26.201 17:21:03 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:26.201 17:21:03 -- scripts/common.sh@354 -- $ echo 23 00:01:26.201 17:21:03 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:26.201 17:21:03 -- scripts/common.sh@365 -- $ decimal 21 00:01:26.201 17:21:03 -- scripts/common.sh@352 -- $ local d=21 00:01:26.201 17:21:03 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:26.201 17:21:03 -- scripts/common.sh@354 -- $ echo 21 00:01:26.201 17:21:03 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:26.201 17:21:03 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:26.201 17:21:03 -- scripts/common.sh@366 -- $ return 1 00:01:26.201 17:21:03 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:26.201 patching file config/rte_config.h 00:01:26.201 Hunk #1 succeeded at 60 (offset 1 line). 00:01:26.201 17:21:03 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:26.201 17:21:03 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:26.201 17:21:03 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:26.201 17:21:03 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:26.201 17:21:03 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:26.201 17:21:03 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:26.201 17:21:03 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:26.201 17:21:03 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:26.201 17:21:03 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:26.201 17:21:03 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:26.201 17:21:03 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:26.201 17:21:03 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:26.201 17:21:03 -- scripts/common.sh@343 -- $ case "$op" in 00:01:26.201 17:21:03 -- scripts/common.sh@344 -- $ : 1 00:01:26.201 17:21:03 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:26.202 17:21:03 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:26.202 17:21:03 -- scripts/common.sh@364 -- $ decimal 23 00:01:26.202 17:21:03 -- scripts/common.sh@352 -- $ local d=23 00:01:26.202 17:21:03 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:26.202 17:21:03 -- scripts/common.sh@354 -- $ echo 23 00:01:26.202 17:21:03 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:26.202 17:21:03 -- scripts/common.sh@365 -- $ decimal 24 00:01:26.202 17:21:03 -- scripts/common.sh@352 -- $ local d=24 00:01:26.202 17:21:03 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:26.202 17:21:03 -- scripts/common.sh@354 -- $ echo 24 00:01:26.202 17:21:03 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:26.202 17:21:03 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:26.202 17:21:03 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:26.202 17:21:03 -- scripts/common.sh@367 -- $ return 0 00:01:26.202 17:21:03 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:26.202 patching file lib/pcapng/rte_pcapng.c 00:01:26.202 17:21:03 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:26.202 17:21:03 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:26.202 17:21:03 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:26.202 17:21:03 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:26.202 17:21:03 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:30.404 The Meson build system 00:01:30.404 Version: 1.5.0 00:01:30.404 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:30.404 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:30.404 Build type: native build 00:01:30.404 Program cat found: YES (/usr/bin/cat) 00:01:30.404 Project name: DPDK 00:01:30.404 Project version: 23.11.0 00:01:30.404 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:30.404 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:30.404 Host machine cpu family: x86_64 00:01:30.404 Host machine cpu: x86_64 00:01:30.404 Message: ## Building in Developer Mode ## 00:01:30.404 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:30.404 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:30.404 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:30.404 Program python3 found: YES (/usr/bin/python3) 00:01:30.404 Program cat found: YES (/usr/bin/cat) 00:01:30.404 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:30.404 Compiler for C supports arguments -march=native: YES 00:01:30.404 Checking for size of "void *" : 8 00:01:30.404 Checking for size of "void *" : 8 (cached) 00:01:30.404 Library m found: YES 00:01:30.404 Library numa found: YES 00:01:30.404 Has header "numaif.h" : YES 00:01:30.404 Library fdt found: NO 00:01:30.404 Library execinfo found: NO 00:01:30.404 Has header "execinfo.h" : YES 00:01:30.404 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:30.404 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:30.404 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:30.404 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:30.404 Run-time dependency openssl found: YES 3.1.1 00:01:30.404 Run-time dependency libpcap found: YES 1.10.4 00:01:30.404 Has header "pcap.h" with dependency libpcap: YES 00:01:30.404 Compiler for C supports arguments -Wcast-qual: YES 00:01:30.404 Compiler for C supports arguments -Wdeprecated: YES 00:01:30.404 Compiler for C supports arguments -Wformat: YES 00:01:30.404 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:30.404 Compiler for C supports arguments -Wformat-security: NO 00:01:30.404 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:30.404 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:30.404 Compiler for C supports arguments -Wnested-externs: YES 00:01:30.404 Compiler for C supports arguments -Wold-style-definition: YES 00:01:30.404 Compiler for C supports arguments -Wpointer-arith: YES 00:01:30.404 Compiler for C supports arguments -Wsign-compare: YES 00:01:30.404 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:30.404 Compiler for C supports arguments -Wundef: YES 00:01:30.404 Compiler for C supports arguments -Wwrite-strings: YES 00:01:30.404 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:30.404 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:30.404 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:30.404 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:30.404 Program objdump found: YES (/usr/bin/objdump) 00:01:30.404 Compiler for C supports arguments -mavx512f: YES 00:01:30.404 Checking if "AVX512 checking" compiles: YES 00:01:30.404 Fetching value of define "__SSE4_2__" : 1 00:01:30.404 Fetching value of define "__AES__" : 1 00:01:30.404 Fetching value of define "__AVX__" : 1 00:01:30.404 Fetching value of define "__AVX2__" : (undefined) 00:01:30.404 Fetching value of define "__AVX512BW__" : (undefined) 00:01:30.404 Fetching value of define "__AVX512CD__" : (undefined) 00:01:30.404 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:30.404 Fetching value of define "__AVX512F__" : (undefined) 00:01:30.404 Fetching value of define "__AVX512VL__" : (undefined) 00:01:30.404 Fetching value of define "__PCLMUL__" : 1 00:01:30.404 Fetching value of define "__RDRND__" : 1 00:01:30.404 Fetching value of define "__RDSEED__" : (undefined) 00:01:30.404 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:30.404 Fetching value of define "__znver1__" : (undefined) 00:01:30.404 Fetching value of define "__znver2__" : (undefined) 00:01:30.404 Fetching value of define "__znver3__" : (undefined) 00:01:30.404 Fetching value of define "__znver4__" : (undefined) 00:01:30.404 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:30.404 Message: lib/log: Defining dependency "log" 00:01:30.404 Message: lib/kvargs: Defining dependency "kvargs" 00:01:30.404 Message: lib/telemetry: Defining dependency "telemetry" 00:01:30.404 Checking for function "getentropy" : NO 00:01:30.404 Message: lib/eal: Defining dependency "eal" 00:01:30.404 Message: lib/ring: Defining dependency "ring" 00:01:30.404 Message: lib/rcu: Defining dependency "rcu" 00:01:30.404 Message: lib/mempool: Defining dependency "mempool" 00:01:30.404 Message: lib/mbuf: Defining dependency "mbuf" 00:01:30.404 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:30.404 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:30.404 Compiler for C supports arguments -mpclmul: YES 00:01:30.404 Compiler for C supports arguments -maes: YES 00:01:30.404 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:30.404 Compiler for C supports arguments -mavx512bw: YES 00:01:30.404 Compiler for C supports arguments -mavx512dq: YES 00:01:30.404 Compiler for C supports arguments -mavx512vl: YES 00:01:30.404 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:30.404 Compiler for C supports arguments -mavx2: YES 00:01:30.404 Compiler for C supports arguments -mavx: YES 00:01:30.404 Message: lib/net: Defining dependency "net" 00:01:30.404 Message: lib/meter: Defining dependency "meter" 00:01:30.404 Message: lib/ethdev: Defining dependency "ethdev" 00:01:30.404 Message: lib/pci: Defining dependency "pci" 00:01:30.404 Message: lib/cmdline: Defining dependency "cmdline" 00:01:30.404 Message: lib/metrics: Defining dependency "metrics" 00:01:30.404 Message: lib/hash: Defining dependency "hash" 00:01:30.404 Message: lib/timer: Defining dependency "timer" 00:01:30.404 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:30.404 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:30.404 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:30.404 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:30.404 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:30.404 Message: lib/acl: Defining dependency "acl" 00:01:30.404 Message: lib/bbdev: Defining dependency "bbdev" 00:01:30.404 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:30.404 Run-time dependency libelf found: YES 0.191 00:01:30.404 Message: lib/bpf: Defining dependency "bpf" 00:01:30.404 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:30.404 Message: lib/compressdev: Defining dependency "compressdev" 00:01:30.404 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:30.404 Message: lib/distributor: Defining dependency "distributor" 00:01:30.404 Message: lib/dmadev: Defining dependency "dmadev" 00:01:30.404 Message: lib/efd: Defining dependency "efd" 00:01:30.404 Message: lib/eventdev: Defining dependency "eventdev" 00:01:30.404 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:30.404 Message: lib/gpudev: Defining dependency "gpudev" 00:01:30.404 Message: lib/gro: Defining dependency "gro" 00:01:30.404 Message: lib/gso: Defining dependency "gso" 00:01:30.404 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:30.404 Message: lib/jobstats: Defining dependency "jobstats" 00:01:30.404 Message: lib/latencystats: Defining dependency "latencystats" 00:01:30.404 Message: lib/lpm: Defining dependency "lpm" 00:01:30.404 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:30.404 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:30.404 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:30.404 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:30.404 Message: lib/member: Defining dependency "member" 00:01:30.404 Message: lib/pcapng: Defining dependency "pcapng" 00:01:30.404 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:30.404 Message: lib/power: Defining dependency "power" 00:01:30.404 Message: lib/rawdev: Defining dependency "rawdev" 00:01:30.404 Message: lib/regexdev: Defining dependency "regexdev" 00:01:30.404 Message: lib/mldev: Defining dependency "mldev" 00:01:30.404 Message: lib/rib: Defining dependency "rib" 00:01:30.404 Message: lib/reorder: Defining dependency "reorder" 00:01:30.404 Message: lib/sched: Defining dependency "sched" 00:01:30.404 Message: lib/security: Defining dependency "security" 00:01:30.404 Message: lib/stack: Defining dependency "stack" 00:01:30.404 Has header "linux/userfaultfd.h" : YES 00:01:30.404 Has header "linux/vduse.h" : YES 00:01:30.404 Message: lib/vhost: Defining dependency "vhost" 00:01:30.404 Message: lib/ipsec: Defining dependency "ipsec" 00:01:30.404 Message: lib/pdcp: Defining dependency "pdcp" 00:01:30.404 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:30.404 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:30.404 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:30.404 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:30.404 Message: lib/fib: Defining dependency "fib" 00:01:30.404 Message: lib/port: Defining dependency "port" 00:01:30.405 Message: lib/pdump: Defining dependency "pdump" 00:01:30.405 Message: lib/table: Defining dependency "table" 00:01:30.405 Message: lib/pipeline: Defining dependency "pipeline" 00:01:30.405 Message: lib/graph: Defining dependency "graph" 00:01:30.405 Message: lib/node: Defining dependency "node" 00:01:32.318 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:32.318 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:32.318 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:32.318 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:32.318 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:32.318 Compiler for C supports arguments -Wno-unused-value: YES 00:01:32.318 Compiler for C supports arguments -Wno-format: YES 00:01:32.318 Compiler for C supports arguments -Wno-format-security: YES 00:01:32.318 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:32.318 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:32.318 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:32.318 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:32.318 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:32.318 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:32.318 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:32.318 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:32.318 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:32.318 Has header "sys/epoll.h" : YES 00:01:32.318 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:32.318 Configuring doxy-api-html.conf using configuration 00:01:32.318 Configuring doxy-api-man.conf using configuration 00:01:32.318 Program mandb found: YES (/usr/bin/mandb) 00:01:32.318 Program sphinx-build found: NO 00:01:32.318 Configuring rte_build_config.h using configuration 00:01:32.318 Message: 00:01:32.318 ================= 00:01:32.318 Applications Enabled 00:01:32.318 ================= 00:01:32.318 00:01:32.318 apps: 00:01:32.318 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:32.318 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:32.318 test-pmd, test-regex, test-sad, test-security-perf, 00:01:32.318 00:01:32.318 Message: 00:01:32.318 ================= 00:01:32.318 Libraries Enabled 00:01:32.318 ================= 00:01:32.318 00:01:32.318 libs: 00:01:32.318 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:32.318 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:32.318 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:32.318 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:32.318 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:32.318 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:32.318 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:32.318 00:01:32.318 00:01:32.318 Message: 00:01:32.318 =============== 00:01:32.318 Drivers Enabled 00:01:32.318 =============== 00:01:32.318 00:01:32.318 common: 00:01:32.318 00:01:32.318 bus: 00:01:32.318 pci, vdev, 00:01:32.318 mempool: 00:01:32.318 ring, 00:01:32.318 dma: 00:01:32.318 00:01:32.318 net: 00:01:32.318 i40e, 00:01:32.318 raw: 00:01:32.318 00:01:32.318 crypto: 00:01:32.318 00:01:32.318 compress: 00:01:32.318 00:01:32.318 regex: 00:01:32.318 00:01:32.318 ml: 00:01:32.318 00:01:32.318 vdpa: 00:01:32.318 00:01:32.318 event: 00:01:32.318 00:01:32.318 baseband: 00:01:32.318 00:01:32.318 gpu: 00:01:32.318 00:01:32.318 00:01:32.318 Message: 00:01:32.318 ================= 00:01:32.318 Content Skipped 00:01:32.318 ================= 00:01:32.318 00:01:32.318 apps: 00:01:32.318 00:01:32.318 libs: 00:01:32.318 00:01:32.318 drivers: 00:01:32.318 common/cpt: not in enabled drivers build config 00:01:32.318 common/dpaax: not in enabled drivers build config 00:01:32.318 common/iavf: not in enabled drivers build config 00:01:32.318 common/idpf: not in enabled drivers build config 00:01:32.318 common/mvep: not in enabled drivers build config 00:01:32.318 common/octeontx: not in enabled drivers build config 00:01:32.318 bus/auxiliary: not in enabled drivers build config 00:01:32.318 bus/cdx: not in enabled drivers build config 00:01:32.319 bus/dpaa: not in enabled drivers build config 00:01:32.319 bus/fslmc: not in enabled drivers build config 00:01:32.319 bus/ifpga: not in enabled drivers build config 00:01:32.319 bus/platform: not in enabled drivers build config 00:01:32.319 bus/vmbus: not in enabled drivers build config 00:01:32.319 common/cnxk: not in enabled drivers build config 00:01:32.319 common/mlx5: not in enabled drivers build config 00:01:32.319 common/nfp: not in enabled drivers build config 00:01:32.319 common/qat: not in enabled drivers build config 00:01:32.319 common/sfc_efx: not in enabled drivers build config 00:01:32.319 mempool/bucket: not in enabled drivers build config 00:01:32.319 mempool/cnxk: not in enabled drivers build config 00:01:32.319 mempool/dpaa: not in enabled drivers build config 00:01:32.319 mempool/dpaa2: not in enabled drivers build config 00:01:32.319 mempool/octeontx: not in enabled drivers build config 00:01:32.319 mempool/stack: not in enabled drivers build config 00:01:32.319 dma/cnxk: not in enabled drivers build config 00:01:32.319 dma/dpaa: not in enabled drivers build config 00:01:32.319 dma/dpaa2: not in enabled drivers build config 00:01:32.319 dma/hisilicon: not in enabled drivers build config 00:01:32.319 dma/idxd: not in enabled drivers build config 00:01:32.319 dma/ioat: not in enabled drivers build config 00:01:32.319 dma/skeleton: not in enabled drivers build config 00:01:32.319 net/af_packet: not in enabled drivers build config 00:01:32.319 net/af_xdp: not in enabled drivers build config 00:01:32.319 net/ark: not in enabled drivers build config 00:01:32.319 net/atlantic: not in enabled drivers build config 00:01:32.319 net/avp: not in enabled drivers build config 00:01:32.319 net/axgbe: not in enabled drivers build config 00:01:32.319 net/bnx2x: not in enabled drivers build config 00:01:32.319 net/bnxt: not in enabled drivers build config 00:01:32.319 net/bonding: not in enabled drivers build config 00:01:32.319 net/cnxk: not in enabled drivers build config 00:01:32.319 net/cpfl: not in enabled drivers build config 00:01:32.319 net/cxgbe: not in enabled drivers build config 00:01:32.319 net/dpaa: not in enabled drivers build config 00:01:32.319 net/dpaa2: not in enabled drivers build config 00:01:32.319 net/e1000: not in enabled drivers build config 00:01:32.319 net/ena: not in enabled drivers build config 00:01:32.319 net/enetc: not in enabled drivers build config 00:01:32.319 net/enetfec: not in enabled drivers build config 00:01:32.319 net/enic: not in enabled drivers build config 00:01:32.319 net/failsafe: not in enabled drivers build config 00:01:32.319 net/fm10k: not in enabled drivers build config 00:01:32.319 net/gve: not in enabled drivers build config 00:01:32.319 net/hinic: not in enabled drivers build config 00:01:32.319 net/hns3: not in enabled drivers build config 00:01:32.319 net/iavf: not in enabled drivers build config 00:01:32.319 net/ice: not in enabled drivers build config 00:01:32.319 net/idpf: not in enabled drivers build config 00:01:32.319 net/igc: not in enabled drivers build config 00:01:32.319 net/ionic: not in enabled drivers build config 00:01:32.319 net/ipn3ke: not in enabled drivers build config 00:01:32.319 net/ixgbe: not in enabled drivers build config 00:01:32.319 net/mana: not in enabled drivers build config 00:01:32.319 net/memif: not in enabled drivers build config 00:01:32.319 net/mlx4: not in enabled drivers build config 00:01:32.319 net/mlx5: not in enabled drivers build config 00:01:32.319 net/mvneta: not in enabled drivers build config 00:01:32.319 net/mvpp2: not in enabled drivers build config 00:01:32.319 net/netvsc: not in enabled drivers build config 00:01:32.319 net/nfb: not in enabled drivers build config 00:01:32.319 net/nfp: not in enabled drivers build config 00:01:32.319 net/ngbe: not in enabled drivers build config 00:01:32.319 net/null: not in enabled drivers build config 00:01:32.319 net/octeontx: not in enabled drivers build config 00:01:32.319 net/octeon_ep: not in enabled drivers build config 00:01:32.319 net/pcap: not in enabled drivers build config 00:01:32.319 net/pfe: not in enabled drivers build config 00:01:32.319 net/qede: not in enabled drivers build config 00:01:32.319 net/ring: not in enabled drivers build config 00:01:32.319 net/sfc: not in enabled drivers build config 00:01:32.319 net/softnic: not in enabled drivers build config 00:01:32.319 net/tap: not in enabled drivers build config 00:01:32.319 net/thunderx: not in enabled drivers build config 00:01:32.319 net/txgbe: not in enabled drivers build config 00:01:32.319 net/vdev_netvsc: not in enabled drivers build config 00:01:32.319 net/vhost: not in enabled drivers build config 00:01:32.319 net/virtio: not in enabled drivers build config 00:01:32.319 net/vmxnet3: not in enabled drivers build config 00:01:32.319 raw/cnxk_bphy: not in enabled drivers build config 00:01:32.319 raw/cnxk_gpio: not in enabled drivers build config 00:01:32.319 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:32.319 raw/ifpga: not in enabled drivers build config 00:01:32.319 raw/ntb: not in enabled drivers build config 00:01:32.319 raw/skeleton: not in enabled drivers build config 00:01:32.319 crypto/armv8: not in enabled drivers build config 00:01:32.319 crypto/bcmfs: not in enabled drivers build config 00:01:32.319 crypto/caam_jr: not in enabled drivers build config 00:01:32.319 crypto/ccp: not in enabled drivers build config 00:01:32.319 crypto/cnxk: not in enabled drivers build config 00:01:32.319 crypto/dpaa_sec: not in enabled drivers build config 00:01:32.319 crypto/dpaa2_sec: not in enabled drivers build config 00:01:32.319 crypto/ipsec_mb: not in enabled drivers build config 00:01:32.319 crypto/mlx5: not in enabled drivers build config 00:01:32.319 crypto/mvsam: not in enabled drivers build config 00:01:32.319 crypto/nitrox: not in enabled drivers build config 00:01:32.319 crypto/null: not in enabled drivers build config 00:01:32.319 crypto/octeontx: not in enabled drivers build config 00:01:32.319 crypto/openssl: not in enabled drivers build config 00:01:32.319 crypto/scheduler: not in enabled drivers build config 00:01:32.319 crypto/uadk: not in enabled drivers build config 00:01:32.319 crypto/virtio: not in enabled drivers build config 00:01:32.319 compress/isal: not in enabled drivers build config 00:01:32.319 compress/mlx5: not in enabled drivers build config 00:01:32.319 compress/octeontx: not in enabled drivers build config 00:01:32.319 compress/zlib: not in enabled drivers build config 00:01:32.319 regex/mlx5: not in enabled drivers build config 00:01:32.319 regex/cn9k: not in enabled drivers build config 00:01:32.319 ml/cnxk: not in enabled drivers build config 00:01:32.319 vdpa/ifc: not in enabled drivers build config 00:01:32.319 vdpa/mlx5: not in enabled drivers build config 00:01:32.319 vdpa/nfp: not in enabled drivers build config 00:01:32.319 vdpa/sfc: not in enabled drivers build config 00:01:32.319 event/cnxk: not in enabled drivers build config 00:01:32.319 event/dlb2: not in enabled drivers build config 00:01:32.319 event/dpaa: not in enabled drivers build config 00:01:32.319 event/dpaa2: not in enabled drivers build config 00:01:32.319 event/dsw: not in enabled drivers build config 00:01:32.319 event/opdl: not in enabled drivers build config 00:01:32.319 event/skeleton: not in enabled drivers build config 00:01:32.319 event/sw: not in enabled drivers build config 00:01:32.319 event/octeontx: not in enabled drivers build config 00:01:32.319 baseband/acc: not in enabled drivers build config 00:01:32.319 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:32.319 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:32.319 baseband/la12xx: not in enabled drivers build config 00:01:32.319 baseband/null: not in enabled drivers build config 00:01:32.319 baseband/turbo_sw: not in enabled drivers build config 00:01:32.319 gpu/cuda: not in enabled drivers build config 00:01:32.319 00:01:32.319 00:01:32.319 Build targets in project: 220 00:01:32.319 00:01:32.319 DPDK 23.11.0 00:01:32.319 00:01:32.319 User defined options 00:01:32.319 libdir : lib 00:01:32.319 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:32.319 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:32.319 c_link_args : 00:01:32.319 enable_docs : false 00:01:32.319 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:32.319 enable_kmods : false 00:01:32.319 machine : native 00:01:32.319 tests : false 00:01:32.319 00:01:32.319 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:32.319 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:32.319 17:21:09 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:32.319 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:32.319 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:32.581 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:32.581 [3/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:32.581 [4/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:32.581 [5/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:32.581 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:32.581 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:32.581 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:32.581 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:32.581 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:32.581 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:32.581 [12/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:32.581 [13/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:32.581 [14/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:32.581 [15/710] Linking static target lib/librte_kvargs.a 00:01:32.581 [16/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:32.581 [17/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:32.842 [18/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:32.842 [19/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:32.842 [20/710] Linking static target lib/librte_log.a 00:01:32.842 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:33.104 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.367 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.367 [24/710] Linking target lib/librte_log.so.24.0 00:01:33.630 [25/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:33.630 [26/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:33.630 [27/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:33.630 [28/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:33.630 [29/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:33.630 [30/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:33.630 [31/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:33.630 [32/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:33.630 [33/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:33.630 [34/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:33.630 [35/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:33.630 [36/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:33.630 [37/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:33.630 [38/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:33.630 [39/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:33.630 [40/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:33.630 [41/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:33.630 [42/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:33.630 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:33.630 [44/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:33.630 [45/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:33.630 [46/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:33.630 [47/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:33.630 [48/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:33.630 [49/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:33.892 [50/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:33.892 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:33.892 [52/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:33.892 [53/710] Linking target lib/librte_kvargs.so.24.0 00:01:33.892 [54/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:33.892 [55/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:33.892 [56/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:33.892 [57/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:33.892 [58/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:33.892 [59/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:33.892 [60/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:33.892 [61/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:33.892 [62/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:33.892 [63/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:33.892 [64/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:33.892 [65/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:34.154 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:34.154 [67/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:34.154 [68/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:34.154 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:34.415 [70/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:34.415 [71/710] Linking static target lib/librte_pci.a 00:01:34.415 [72/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:34.415 [73/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:34.415 [74/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:34.415 [75/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:34.415 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:34.679 [77/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:34.679 [78/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:34.679 [79/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.679 [80/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:34.679 [81/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:34.679 [82/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:34.679 [83/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:34.679 [84/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:34.679 [85/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:34.679 [86/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:34.679 [87/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:34.679 [88/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:34.941 [89/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:34.941 [90/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:34.941 [91/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:34.941 [92/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:34.941 [93/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:34.941 [94/710] Linking static target lib/librte_ring.a 00:01:34.941 [95/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:34.941 [96/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:34.941 [97/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:34.941 [98/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:34.941 [99/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:34.941 [100/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:34.941 [101/710] Linking static target lib/librte_meter.a 00:01:34.941 [102/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:34.941 [103/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:34.941 [104/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:35.205 [105/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:35.205 [106/710] Linking static target lib/librte_telemetry.a 00:01:35.205 [107/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:35.205 [108/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:35.205 [109/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:35.205 [110/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:35.205 [111/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:35.205 [112/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:35.205 [113/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:35.205 [114/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:35.205 [115/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.205 [116/710] Linking static target lib/librte_eal.a 00:01:35.471 [117/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:35.471 [118/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.471 [119/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:35.471 [120/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:35.471 [121/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:35.471 [122/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:35.471 [123/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:35.471 [124/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:35.471 [125/710] Linking static target lib/librte_net.a 00:01:35.733 [126/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:35.733 [127/710] Linking static target lib/librte_cmdline.a 00:01:35.733 [128/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:35.733 [129/710] Linking static target lib/librte_mempool.a 00:01:35.733 [130/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.733 [131/710] Linking target lib/librte_telemetry.so.24.0 00:01:35.733 [132/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:35.992 [133/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:35.992 [134/710] Linking static target lib/librte_cfgfile.a 00:01:35.992 [135/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:35.992 [136/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:35.992 [137/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.992 [138/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:35.992 [139/710] Linking static target lib/librte_metrics.a 00:01:35.992 [140/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:35.992 [141/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:35.992 [142/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:36.256 [143/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:36.256 [144/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:36.257 [145/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:36.257 [146/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:36.257 [147/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:36.257 [148/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:36.257 [149/710] Linking static target lib/librte_bitratestats.a 00:01:36.257 [150/710] Linking static target lib/librte_rcu.a 00:01:36.257 [151/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:36.257 [152/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:36.517 [153/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.517 [154/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:36.517 [155/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:36.517 [156/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:36.517 [157/710] Linking static target lib/librte_timer.a 00:01:36.517 [158/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.518 [159/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:36.518 [160/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:36.518 [161/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:36.518 [162/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.783 [163/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.783 [164/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:36.783 [165/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.783 [166/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:36.783 [167/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:36.783 [168/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:36.783 [169/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.045 [170/710] Linking static target lib/librte_bbdev.a 00:01:37.045 [171/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:37.045 [172/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.045 [173/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:37.045 [174/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:37.045 [175/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:37.045 [176/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:37.307 [177/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:37.307 [178/710] Linking static target lib/librte_compressdev.a 00:01:37.307 [179/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:37.307 [180/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:37.307 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:37.567 [182/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:37.567 [183/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:37.567 [184/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:37.567 [185/710] Linking static target lib/librte_distributor.a 00:01:37.829 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:37.829 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.829 [188/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:37.829 [189/710] Linking static target lib/librte_bpf.a 00:01:37.829 [190/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:37.829 [191/710] Linking static target lib/librte_dmadev.a 00:01:38.091 [192/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.091 [193/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:38.091 [194/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:38.091 [195/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:38.091 [196/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.091 [197/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:38.091 [198/710] Linking static target lib/librte_dispatcher.a 00:01:38.091 [199/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:38.091 [200/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:38.350 [201/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:38.350 [202/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:38.350 [203/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:38.350 [204/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:38.350 [205/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:38.350 [206/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:38.350 [207/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:38.350 [208/710] Linking static target lib/librte_gpudev.a 00:01:38.350 [209/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:38.350 [210/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:38.350 [211/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.350 [212/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:38.350 [213/710] Linking static target lib/librte_gro.a 00:01:38.350 [214/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:38.350 [215/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:38.612 [216/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.612 [217/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:38.612 [218/710] Linking static target lib/librte_jobstats.a 00:01:38.612 [219/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:38.612 [220/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:38.874 [221/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.874 [222/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.874 [223/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:38.874 [224/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:39.135 [225/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:39.135 [226/710] Linking static target lib/librte_latencystats.a 00:01:39.135 [227/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.135 [228/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:39.135 [229/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:39.135 [230/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:39.135 [231/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:39.135 [232/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:39.135 [233/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:39.395 [234/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:39.395 [235/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.395 [236/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:39.395 [237/710] Linking static target lib/librte_ip_frag.a 00:01:39.395 [238/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:39.395 [239/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:39.395 [240/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:39.657 [241/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:39.657 [242/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.657 [243/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:39.657 [244/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:39.657 [245/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:39.920 [246/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.920 [247/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:39.920 [248/710] Linking static target lib/librte_gso.a 00:01:39.920 [249/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:39.920 [250/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:39.920 [251/710] Linking static target lib/librte_regexdev.a 00:01:39.920 [252/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:39.920 [253/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:40.182 [254/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:40.182 [255/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:40.182 [256/710] Linking static target lib/librte_rawdev.a 00:01:40.182 [257/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:40.182 [258/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:40.182 [259/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.182 [260/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:40.182 [261/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:40.182 [262/710] Linking static target lib/librte_mldev.a 00:01:40.182 [263/710] Linking static target lib/librte_pcapng.a 00:01:40.182 [264/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:40.444 [265/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:40.444 [266/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:40.444 [267/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:40.444 [268/710] Linking static target lib/librte_efd.a 00:01:40.444 [269/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:40.444 [270/710] Linking static target lib/acl/libavx2_tmp.a 00:01:40.444 [271/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:40.444 [272/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:40.444 [273/710] Linking static target lib/librte_stack.a 00:01:40.444 [274/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:40.444 [275/710] Linking static target lib/librte_lpm.a 00:01:40.444 [276/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:40.706 [277/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:40.706 [278/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:40.706 [279/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.706 [280/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:40.706 [281/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:40.706 [282/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.706 [283/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.706 [284/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.968 [285/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:40.968 [286/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:40.968 [287/710] Linking static target lib/librte_hash.a 00:01:40.968 [288/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:40.968 [289/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:40.968 [290/710] Linking static target lib/librte_power.a 00:01:40.968 [291/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:40.968 [292/710] Linking static target lib/acl/libavx512_tmp.a 00:01:40.968 [293/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:40.968 [294/710] Linking static target lib/librte_reorder.a 00:01:40.968 [295/710] Linking static target lib/librte_acl.a 00:01:40.968 [296/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.968 [297/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:41.238 [298/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.238 [299/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:41.238 [300/710] Linking static target lib/librte_security.a 00:01:41.238 [301/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:41.502 [302/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:41.502 [303/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:41.502 [304/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:41.502 [305/710] Linking static target lib/librte_mbuf.a 00:01:41.502 [306/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:41.502 [307/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:41.502 [308/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.502 [309/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.503 [310/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:41.503 [311/710] Linking static target lib/librte_rib.a 00:01:41.764 [312/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:41.764 [313/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:41.764 [314/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:41.764 [315/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:41.764 [316/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.764 [317/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:42.028 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.028 [319/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:42.028 [320/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:42.028 [321/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:42.028 [322/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:42.028 [323/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:42.028 [324/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:42.028 [325/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:42.028 [326/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.028 [327/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:42.289 [328/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.289 [329/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:42.289 [330/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.289 [331/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.289 [332/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:42.552 [333/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:42.552 [334/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:42.552 [335/710] Linking static target lib/librte_member.a 00:01:42.552 [336/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:42.814 [337/710] Linking static target lib/librte_eventdev.a 00:01:42.814 [338/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:42.814 [339/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:43.077 [340/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:43.077 [341/710] Linking static target lib/librte_cryptodev.a 00:01:43.077 [342/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:43.077 [343/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:43.077 [344/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.077 [345/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:43.077 [346/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:43.077 [347/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:43.077 [348/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:43.077 [349/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:43.078 [350/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:43.339 [351/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:43.339 [352/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:43.339 [353/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:43.339 [354/710] Linking static target lib/librte_ethdev.a 00:01:43.339 [355/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:43.339 [356/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:43.339 [357/710] Linking static target lib/librte_fib.a 00:01:43.339 [358/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:43.339 [359/710] Linking static target lib/librte_sched.a 00:01:43.339 [360/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:43.339 [361/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:43.607 [362/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:43.607 [363/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:43.607 [364/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:43.607 [365/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:43.607 [366/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:43.607 [367/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:43.866 [368/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:43.866 [369/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:43.866 [370/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.866 [371/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:43.866 [372/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.127 [373/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:44.127 [374/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:44.127 [375/710] Linking static target lib/librte_pdump.a 00:01:44.127 [376/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:44.390 [377/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:44.390 [378/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:44.390 [379/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:01:44.390 [380/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:44.390 [381/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:44.390 [382/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:44.390 [383/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:44.390 [384/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:44.654 [385/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:44.654 [386/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:44.654 [387/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:44.654 [388/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.654 [389/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:01:44.654 [390/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:44.654 [391/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:44.918 [392/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:44.918 [393/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:44.918 [394/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.918 [395/710] Linking static target lib/librte_table.a 00:01:44.918 [396/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:44.918 [397/710] Linking static target lib/librte_ipsec.a 00:01:44.918 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:45.178 [399/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:45.178 [400/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:01:45.443 [401/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:45.443 [402/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.707 [403/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:45.708 [404/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:45.708 [405/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:45.708 [406/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.708 [407/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:45.708 [408/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:45.708 [409/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:45.971 [410/710] Linking target lib/librte_eal.so.24.0 00:01:45.971 [411/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.971 [412/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:45.971 [413/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:45.971 [414/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:45.971 [415/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:01:45.971 [416/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:45.971 [417/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:45.971 [418/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.971 [419/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:46.240 [420/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:46.240 [421/710] Linking target lib/librte_ring.so.24.0 00:01:46.240 [422/710] Linking target lib/librte_meter.so.24.0 00:01:46.240 [423/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:46.240 [424/710] Linking target lib/librte_pci.so.24.0 00:01:46.240 [425/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:46.240 [426/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:46.240 [427/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:46.240 [428/710] Linking target lib/librte_timer.so.24.0 00:01:46.500 [429/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:46.500 [430/710] Linking target lib/librte_acl.so.24.0 00:01:46.500 [431/710] Linking target lib/librte_cfgfile.so.24.0 00:01:46.500 [432/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:46.500 [433/710] Linking target lib/librte_rcu.so.24.0 00:01:46.500 [434/710] Linking target lib/librte_mempool.so.24.0 00:01:46.500 [435/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:46.500 [436/710] Linking target lib/librte_dmadev.so.24.0 00:01:46.500 [437/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:46.500 [438/710] Linking target lib/librte_jobstats.so.24.0 00:01:46.500 [439/710] Linking target lib/librte_rawdev.so.24.0 00:01:46.500 [440/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:46.500 [441/710] Linking target lib/librte_stack.so.24.0 00:01:46.500 [442/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:46.500 [443/710] Linking static target lib/librte_port.a 00:01:46.763 [444/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:46.763 [445/710] Linking static target drivers/librte_bus_vdev.a 00:01:46.763 [446/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:01:46.763 [447/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:01:46.763 [448/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:46.763 [449/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:01:46.763 [450/710] Linking static target lib/librte_graph.a 00:01:46.763 [451/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:46.763 [452/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:46.763 [453/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:46.763 [454/710] Linking target lib/librte_mbuf.so.24.0 00:01:46.763 [455/710] Linking target lib/librte_rib.so.24.0 00:01:47.030 [456/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:01:47.030 [457/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:47.030 [458/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:47.030 [459/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:01:47.030 [460/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.030 [461/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:47.030 [462/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:01:47.030 [463/710] Linking target lib/librte_net.so.24.0 00:01:47.030 [464/710] Linking target lib/librte_bbdev.so.24.0 00:01:47.293 [465/710] Linking target lib/librte_compressdev.so.24.0 00:01:47.293 [466/710] Linking target lib/librte_distributor.so.24.0 00:01:47.293 [467/710] Linking target lib/librte_cryptodev.so.24.0 00:01:47.293 [468/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:47.293 [469/710] Linking target lib/librte_gpudev.so.24.0 00:01:47.293 [470/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:01:47.293 [471/710] Linking target lib/librte_regexdev.so.24.0 00:01:47.293 [472/710] Linking target lib/librte_reorder.so.24.0 00:01:47.293 [473/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:01:47.293 [474/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:47.293 [475/710] Linking target lib/librte_mldev.so.24.0 00:01:47.293 [476/710] Linking static target drivers/librte_bus_pci.a 00:01:47.293 [477/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:47.293 [478/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:47.293 [479/710] Linking target lib/librte_sched.so.24.0 00:01:47.293 [480/710] Linking target lib/librte_fib.so.24.0 00:01:47.293 [481/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:47.293 [482/710] Linking target drivers/librte_bus_vdev.so.24.0 00:01:47.293 [483/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:47.564 [484/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:47.564 [485/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.564 [486/710] Linking target lib/librte_cmdline.so.24.0 00:01:47.564 [487/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:01:47.564 [488/710] Linking target lib/librte_hash.so.24.0 00:01:47.564 [489/710] Linking target lib/librte_security.so.24.0 00:01:47.564 [490/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:01:47.564 [491/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:01:47.564 [492/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:01:47.564 [493/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:47.826 [494/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:47.826 [495/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.826 [496/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:47.826 [497/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:47.826 [498/710] Linking static target drivers/librte_mempool_ring.a 00:01:47.826 [499/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:01:47.826 [500/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:47.826 [501/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:47.826 [502/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:01:47.826 [503/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:47.826 [504/710] Linking target drivers/librte_mempool_ring.so.24.0 00:01:47.826 [505/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:47.826 [506/710] Linking target lib/librte_efd.so.24.0 00:01:47.826 [507/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:47.826 [508/710] Linking target lib/librte_lpm.so.24.0 00:01:47.826 [509/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:01:47.826 [510/710] Linking target lib/librte_member.so.24.0 00:01:47.826 [511/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:47.826 [512/710] Linking target lib/librte_ipsec.so.24.0 00:01:47.826 [513/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:01:48.087 [514/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:01:48.087 [515/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:01:48.087 [516/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:01:48.087 [517/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:01:48.087 [518/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.087 [519/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:01:48.087 [520/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:01:48.087 [521/710] Linking target drivers/librte_bus_pci.so.24.0 00:01:48.351 [522/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:01:48.351 [523/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:48.351 [524/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:01:48.615 [525/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:01:48.882 [526/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:01:48.882 [527/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:48.882 [528/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:48.882 [529/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:48.882 [530/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:49.142 [531/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:01:49.142 [532/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:49.142 [533/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:49.142 [534/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:49.405 [535/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:49.405 [536/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:49.405 [537/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:49.405 [538/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:49.405 [539/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:49.405 [540/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:49.405 [541/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:49.666 [542/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:49.666 [543/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:49.928 [544/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:49.928 [545/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:49.928 [546/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:49.928 [547/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:49.928 [548/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:50.192 [549/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:50.192 [550/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:50.192 [551/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:50.192 [552/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:01:50.192 [553/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:50.192 [554/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:01:50.192 [555/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:01:50.192 [556/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:50.454 [557/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:50.454 [558/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:01:50.717 [559/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:50.717 [560/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.980 [561/710] Linking target lib/librte_ethdev.so.24.0 00:01:50.980 [562/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:50.980 [563/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:50.980 [564/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:51.245 [565/710] Linking target lib/librte_metrics.so.24.0 00:01:51.245 [566/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:51.245 [567/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:51.245 [568/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:51.245 [569/710] Linking target lib/librte_bpf.so.24.0 00:01:51.245 [570/710] Linking target lib/librte_gro.so.24.0 00:01:51.245 [571/710] Linking target lib/librte_eventdev.so.24.0 00:01:51.512 [572/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:01:51.512 [573/710] Linking target lib/librte_gso.so.24.0 00:01:51.512 [574/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:01:51.512 [575/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:51.512 [576/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:01:51.512 [577/710] Linking target lib/librte_pcapng.so.24.0 00:01:51.512 [578/710] Linking target lib/librte_ip_frag.so.24.0 00:01:51.512 [579/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:51.512 [580/710] Linking target lib/librte_bitratestats.so.24.0 00:01:51.512 [581/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:01:51.512 [582/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:01:51.512 [583/710] Linking target lib/librte_latencystats.so.24.0 00:01:51.512 [584/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:51.512 [585/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:01:51.512 [586/710] Linking target lib/librte_power.so.24.0 00:01:51.512 [587/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:01:51.771 [588/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:51.771 [589/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:01:51.771 [590/710] Linking target lib/librte_dispatcher.so.24.0 00:01:51.771 [591/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:01:51.771 [592/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:01:51.771 [593/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:51.771 [594/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:01:51.771 [595/710] Linking target lib/librte_pdump.so.24.0 00:01:51.771 [596/710] Linking target lib/librte_port.so.24.0 00:01:51.771 [597/710] Linking target lib/librte_graph.so.24.0 00:01:51.771 [598/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:01:52.033 [599/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:01:52.033 [600/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:52.033 [601/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:52.033 [602/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:01:52.033 [603/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:01:52.033 [604/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:52.033 [605/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:52.295 [606/710] Linking target lib/librte_table.so.24.0 00:01:52.295 [607/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:01:52.295 [608/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:01:52.295 [609/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:01:52.558 [610/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:01:52.558 [611/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:52.558 [612/710] Linking static target lib/librte_pdcp.a 00:01:52.558 [613/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:52.817 [614/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:52.817 [615/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:52.817 [616/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:52.817 [617/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:52.817 [618/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:52.817 [619/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:53.079 [620/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:53.079 [621/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:53.079 [622/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:53.079 [623/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.079 [624/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:01:53.079 [625/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:53.079 [626/710] Linking target lib/librte_pdcp.so.24.0 00:01:53.340 [627/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:53.340 [628/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:53.340 [629/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:53.600 [630/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:53.600 [631/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:53.600 [632/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:53.859 [633/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:53.859 [634/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:53.859 [635/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:53.859 [636/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:53.859 [637/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:53.859 [638/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:54.118 [639/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:54.118 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:54.118 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:54.118 [642/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:54.377 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:01:54.377 [644/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:54.377 [645/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:54.377 [646/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:54.377 [647/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:54.636 [648/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:54.636 [649/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:54.636 [650/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:54.895 [651/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:54.895 [652/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:54.895 [653/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:54.895 [654/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:54.895 [655/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:54.895 [656/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:55.153 [657/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:55.153 [658/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:55.153 [659/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:55.464 [660/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:55.464 [661/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:55.464 [662/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:55.464 [663/710] Linking static target drivers/librte_net_i40e.a 00:01:56.073 [664/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:56.073 [665/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:56.073 [666/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:56.073 [667/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.073 [668/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:56.073 [669/710] Linking target drivers/librte_net_i40e.so.24.0 00:01:56.332 [670/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:56.332 [671/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:56.332 [672/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:01:56.590 [673/710] Linking static target lib/librte_node.a 00:01:56.849 [674/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.849 [675/710] Linking target lib/librte_node.so.24.0 00:01:56.849 [676/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:58.223 [677/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:01:58.223 [678/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:58.482 [679/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:00.383 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:00.383 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:05.650 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:37.721 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:37.721 [684/710] Linking static target lib/librte_vhost.a 00:02:37.981 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:38.241 [686/710] Linking target lib/librte_vhost.so.24.0 00:02:50.465 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:50.465 [688/710] Linking static target lib/librte_pipeline.a 00:02:50.465 [689/710] Linking target app/dpdk-dumpcap 00:02:50.465 [690/710] Linking target app/dpdk-test-dma-perf 00:02:50.465 [691/710] Linking target app/dpdk-test-gpudev 00:02:50.465 [692/710] Linking target app/dpdk-test-sad 00:02:50.465 [693/710] Linking target app/dpdk-pdump 00:02:50.465 [694/710] Linking target app/dpdk-test-pipeline 00:02:50.465 [695/710] Linking target app/dpdk-test-regex 00:02:50.465 [696/710] Linking target app/dpdk-test-fib 00:02:50.465 [697/710] Linking target app/dpdk-graph 00:02:50.465 [698/710] Linking target app/dpdk-test-cmdline 00:02:50.465 [699/710] Linking target app/dpdk-proc-info 00:02:50.465 [700/710] Linking target app/dpdk-test-crypto-perf 00:02:50.465 [701/710] Linking target app/dpdk-test-compress-perf 00:02:50.465 [702/710] Linking target app/dpdk-test-acl 00:02:50.465 [703/710] Linking target app/dpdk-test-flow-perf 00:02:50.465 [704/710] Linking target app/dpdk-test-security-perf 00:02:50.465 [705/710] Linking target app/dpdk-test-mldev 00:02:50.465 [706/710] Linking target app/dpdk-test-bbdev 00:02:50.465 [707/710] Linking target app/dpdk-test-eventdev 00:02:50.465 [708/710] Linking target app/dpdk-testpmd 00:02:52.372 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:52.372 [710/710] Linking target lib/librte_pipeline.so.24.0 00:02:52.372 17:22:29 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:52.372 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:52.372 [0/1] Installing files. 00:02:52.948 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.948 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.949 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.950 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.951 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.952 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.953 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:52.954 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:52.954 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.954 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:52.955 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.530 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.531 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.531 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.531 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.531 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.531 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.531 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.531 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.531 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.531 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.531 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.531 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.531 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.531 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.532 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.533 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.534 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:53.535 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:53.535 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:02:53.535 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:02:53.535 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:02:53.535 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:53.535 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:02:53.535 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:53.535 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:02:53.535 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:53.535 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:02:53.536 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:53.536 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:02:53.536 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:53.536 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:02:53.536 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:53.536 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:02:53.536 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:53.536 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:02:53.536 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:53.536 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:02:53.536 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:53.536 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:02:53.536 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:53.536 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:02:53.536 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:53.536 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:02:53.536 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:53.536 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:02:53.536 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:53.536 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:02:53.536 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:53.536 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:02:53.536 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:53.536 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:02:53.536 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:53.536 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:02:53.536 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:53.536 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:02:53.536 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:53.536 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:02:53.536 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:53.536 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:02:53.536 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:53.536 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:02:53.536 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:53.536 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:02:53.536 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:53.536 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:02:53.536 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:53.536 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:02:53.536 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:53.536 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:02:53.536 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:53.536 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:02:53.536 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:53.536 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:02:53.536 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:02:53.536 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:02:53.536 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:53.536 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:02:53.536 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:53.536 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:02:53.536 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:53.536 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:02:53.536 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:53.536 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:02:53.536 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:53.536 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:02:53.536 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:53.536 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:02:53.536 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:53.536 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:02:53.536 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:53.536 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:02:53.536 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:53.536 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:02:53.536 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:53.536 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:02:53.536 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:53.536 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:02:53.536 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:53.798 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:02:53.798 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:02:53.798 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:02:53.798 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:02:53.798 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:02:53.798 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:02:53.798 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:02:53.798 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:02:53.798 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:02:53.798 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:02:53.798 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:02:53.798 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:02:53.798 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:02:53.798 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:02:53.798 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:02:53.798 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:53.798 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:02:53.798 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:53.798 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:02:53.798 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:53.798 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:02:53.798 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:53.798 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:02:53.798 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:53.798 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:02:53.798 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:53.798 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:02:53.798 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:53.798 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:02:53.798 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:02:53.798 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:02:53.798 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:53.798 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:02:53.798 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:53.798 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:02:53.798 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:53.798 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:02:53.798 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:53.798 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:02:53.798 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:53.798 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:02:53.798 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:53.798 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:02:53.798 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:53.798 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:02:53.798 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:02:53.798 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:02:53.798 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:02:53.798 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:02:53.798 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:02:53.798 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:02:53.798 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:02:53.798 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:02:53.798 17:22:31 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:53.798 17:22:31 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:53.798 17:22:31 -- common/autobuild_common.sh@203 -- $ cat 00:02:53.798 17:22:31 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:53.798 00:02:53.798 real 1m27.603s 00:02:53.798 user 18m1.720s 00:02:53.798 sys 2m8.853s 00:02:53.798 17:22:31 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:53.798 17:22:31 -- common/autotest_common.sh@10 -- $ set +x 00:02:53.798 ************************************ 00:02:53.798 END TEST build_native_dpdk 00:02:53.798 ************************************ 00:02:53.798 17:22:31 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:53.798 17:22:31 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:53.798 17:22:31 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:53.798 17:22:31 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:53.798 17:22:31 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:53.798 17:22:31 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:53.798 17:22:31 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:53.798 17:22:31 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:53.798 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:53.798 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.798 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:54.059 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:54.059 Using 'verbs' RDMA provider 00:03:04.610 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:12.726 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:12.726 Creating mk/config.mk...done. 00:03:12.726 Creating mk/cc.flags.mk...done. 00:03:12.726 Type 'make' to build. 00:03:12.726 17:22:50 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:12.726 17:22:50 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:12.726 17:22:50 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:12.726 17:22:50 -- common/autotest_common.sh@10 -- $ set +x 00:03:12.726 ************************************ 00:03:12.726 START TEST make 00:03:12.726 ************************************ 00:03:12.726 17:22:50 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:12.990 make[1]: Nothing to be done for 'all'. 00:03:14.915 The Meson build system 00:03:14.915 Version: 1.5.0 00:03:14.915 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:14.915 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:14.915 Build type: native build 00:03:14.915 Project name: libvfio-user 00:03:14.915 Project version: 0.0.1 00:03:14.915 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:14.915 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:14.915 Host machine cpu family: x86_64 00:03:14.915 Host machine cpu: x86_64 00:03:14.915 Run-time dependency threads found: YES 00:03:14.915 Library dl found: YES 00:03:14.915 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:14.915 Run-time dependency json-c found: YES 0.17 00:03:14.915 Run-time dependency cmocka found: YES 1.1.7 00:03:14.915 Program pytest-3 found: NO 00:03:14.915 Program flake8 found: NO 00:03:14.915 Program misspell-fixer found: NO 00:03:14.915 Program restructuredtext-lint found: NO 00:03:14.915 Program valgrind found: YES (/usr/bin/valgrind) 00:03:14.915 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:14.915 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:14.915 Compiler for C supports arguments -Wwrite-strings: YES 00:03:14.915 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:14.915 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:14.916 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:14.916 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:14.916 Build targets in project: 8 00:03:14.916 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:14.916 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:14.916 00:03:14.916 libvfio-user 0.0.1 00:03:14.916 00:03:14.916 User defined options 00:03:14.916 buildtype : debug 00:03:14.916 default_library: shared 00:03:14.916 libdir : /usr/local/lib 00:03:14.916 00:03:14.916 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:15.538 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:15.809 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:15.809 [2/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:15.809 [3/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:15.809 [4/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:15.809 [5/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:15.809 [6/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:15.809 [7/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:15.809 [8/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:15.809 [9/37] Compiling C object samples/null.p/null.c.o 00:03:15.809 [10/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:15.809 [11/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:15.809 [12/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:15.809 [13/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:15.809 [14/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:15.809 [15/37] Compiling C object samples/server.p/server.c.o 00:03:15.809 [16/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:15.809 [17/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:15.809 [18/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:15.809 [19/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:15.809 [20/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:15.809 [21/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:15.809 [22/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:15.809 [23/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:16.068 [24/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:16.068 [25/37] Compiling C object samples/client.p/client.c.o 00:03:16.068 [26/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:16.068 [27/37] Linking target samples/client 00:03:16.068 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:16.068 [29/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:16.068 [30/37] Linking target lib/libvfio-user.so.0.0.1 00:03:16.068 [31/37] Linking target test/unit_tests 00:03:16.331 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:16.331 [33/37] Linking target samples/server 00:03:16.331 [34/37] Linking target samples/lspci 00:03:16.331 [35/37] Linking target samples/gpio-pci-idio-16 00:03:16.331 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:16.331 [37/37] Linking target samples/null 00:03:16.331 INFO: autodetecting backend as ninja 00:03:16.331 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:16.596 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:17.534 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:17.534 ninja: no work to do. 00:03:27.503 CC lib/ut_mock/mock.o 00:03:27.503 CC lib/log/log.o 00:03:27.503 CC lib/log/log_flags.o 00:03:27.503 CC lib/log/log_deprecated.o 00:03:27.503 CC lib/ut/ut.o 00:03:27.503 LIB libspdk_ut_mock.a 00:03:27.503 SO libspdk_ut_mock.so.5.0 00:03:27.503 LIB libspdk_log.a 00:03:27.503 LIB libspdk_ut.a 00:03:27.503 SO libspdk_ut.so.1.0 00:03:27.503 SO libspdk_log.so.6.1 00:03:27.503 SYMLINK libspdk_ut_mock.so 00:03:27.503 SYMLINK libspdk_ut.so 00:03:27.503 SYMLINK libspdk_log.so 00:03:27.761 CXX lib/trace_parser/trace.o 00:03:27.761 CC lib/util/base64.o 00:03:27.761 CC lib/util/bit_array.o 00:03:27.761 CC lib/dma/dma.o 00:03:27.761 CC lib/ioat/ioat.o 00:03:27.761 CC lib/util/cpuset.o 00:03:27.761 CC lib/util/crc16.o 00:03:27.761 CC lib/util/crc32.o 00:03:27.761 CC lib/util/crc32c.o 00:03:27.761 CC lib/util/crc32_ieee.o 00:03:27.761 CC lib/util/crc64.o 00:03:27.761 CC lib/util/dif.o 00:03:27.762 CC lib/util/fd.o 00:03:27.762 CC lib/util/file.o 00:03:27.762 CC lib/util/hexlify.o 00:03:27.762 CC lib/util/iov.o 00:03:27.762 CC lib/util/math.o 00:03:27.762 CC lib/util/pipe.o 00:03:27.762 CC lib/util/strerror_tls.o 00:03:27.762 CC lib/util/string.o 00:03:27.762 CC lib/util/uuid.o 00:03:27.762 CC lib/util/fd_group.o 00:03:27.762 CC lib/util/xor.o 00:03:27.762 CC lib/util/zipf.o 00:03:27.762 CC lib/vfio_user/host/vfio_user_pci.o 00:03:27.762 CC lib/vfio_user/host/vfio_user.o 00:03:28.020 LIB libspdk_dma.a 00:03:28.020 SO libspdk_dma.so.3.0 00:03:28.020 SYMLINK libspdk_dma.so 00:03:28.020 LIB libspdk_ioat.a 00:03:28.020 SO libspdk_ioat.so.6.0 00:03:28.020 LIB libspdk_vfio_user.a 00:03:28.020 SO libspdk_vfio_user.so.4.0 00:03:28.020 SYMLINK libspdk_ioat.so 00:03:28.020 SYMLINK libspdk_vfio_user.so 00:03:28.277 LIB libspdk_util.a 00:03:28.277 SO libspdk_util.so.8.0 00:03:28.535 SYMLINK libspdk_util.so 00:03:28.535 CC lib/json/json_parse.o 00:03:28.535 CC lib/idxd/idxd.o 00:03:28.535 CC lib/rdma/common.o 00:03:28.535 CC lib/env_dpdk/env.o 00:03:28.535 CC lib/json/json_util.o 00:03:28.535 CC lib/idxd/idxd_user.o 00:03:28.535 CC lib/rdma/rdma_verbs.o 00:03:28.535 CC lib/env_dpdk/memory.o 00:03:28.535 CC lib/json/json_write.o 00:03:28.535 CC lib/idxd/idxd_kernel.o 00:03:28.535 CC lib/env_dpdk/pci.o 00:03:28.535 CC lib/env_dpdk/init.o 00:03:28.535 CC lib/env_dpdk/threads.o 00:03:28.535 CC lib/conf/conf.o 00:03:28.535 CC lib/env_dpdk/pci_ioat.o 00:03:28.535 CC lib/vmd/vmd.o 00:03:28.535 CC lib/vmd/led.o 00:03:28.535 CC lib/env_dpdk/pci_virtio.o 00:03:28.535 CC lib/env_dpdk/pci_vmd.o 00:03:28.535 CC lib/env_dpdk/pci_idxd.o 00:03:28.535 CC lib/env_dpdk/pci_event.o 00:03:28.535 CC lib/env_dpdk/sigbus_handler.o 00:03:28.535 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:28.535 CC lib/env_dpdk/pci_dpdk.o 00:03:28.535 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:28.793 LIB libspdk_trace_parser.a 00:03:28.793 SO libspdk_trace_parser.so.4.0 00:03:28.793 SYMLINK libspdk_trace_parser.so 00:03:28.793 LIB libspdk_conf.a 00:03:28.793 SO libspdk_conf.so.5.0 00:03:28.793 SYMLINK libspdk_conf.so 00:03:29.051 LIB libspdk_json.a 00:03:29.051 LIB libspdk_rdma.a 00:03:29.051 SO libspdk_rdma.so.5.0 00:03:29.051 SO libspdk_json.so.5.1 00:03:29.051 SYMLINK libspdk_rdma.so 00:03:29.051 SYMLINK libspdk_json.so 00:03:29.051 LIB libspdk_idxd.a 00:03:29.051 CC lib/jsonrpc/jsonrpc_server.o 00:03:29.051 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:29.051 CC lib/jsonrpc/jsonrpc_client.o 00:03:29.051 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:29.051 SO libspdk_idxd.so.11.0 00:03:29.309 SYMLINK libspdk_idxd.so 00:03:29.309 LIB libspdk_vmd.a 00:03:29.309 SO libspdk_vmd.so.5.0 00:03:29.309 SYMLINK libspdk_vmd.so 00:03:29.309 LIB libspdk_jsonrpc.a 00:03:29.309 SO libspdk_jsonrpc.so.5.1 00:03:29.567 SYMLINK libspdk_jsonrpc.so 00:03:29.567 CC lib/rpc/rpc.o 00:03:29.825 LIB libspdk_rpc.a 00:03:29.825 SO libspdk_rpc.so.5.0 00:03:29.825 SYMLINK libspdk_rpc.so 00:03:30.084 CC lib/sock/sock.o 00:03:30.084 CC lib/notify/notify.o 00:03:30.084 CC lib/sock/sock_rpc.o 00:03:30.084 CC lib/notify/notify_rpc.o 00:03:30.084 CC lib/trace/trace.o 00:03:30.084 CC lib/trace/trace_flags.o 00:03:30.084 CC lib/trace/trace_rpc.o 00:03:30.084 LIB libspdk_notify.a 00:03:30.084 SO libspdk_notify.so.5.0 00:03:30.342 LIB libspdk_trace.a 00:03:30.342 SYMLINK libspdk_notify.so 00:03:30.342 SO libspdk_trace.so.9.0 00:03:30.342 SYMLINK libspdk_trace.so 00:03:30.342 LIB libspdk_sock.a 00:03:30.342 SO libspdk_sock.so.8.0 00:03:30.342 CC lib/thread/thread.o 00:03:30.342 CC lib/thread/iobuf.o 00:03:30.342 SYMLINK libspdk_sock.so 00:03:30.600 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:30.600 CC lib/nvme/nvme_ctrlr.o 00:03:30.600 CC lib/nvme/nvme_fabric.o 00:03:30.600 CC lib/nvme/nvme_ns_cmd.o 00:03:30.600 CC lib/nvme/nvme_ns.o 00:03:30.600 CC lib/nvme/nvme_pcie_common.o 00:03:30.600 CC lib/nvme/nvme_pcie.o 00:03:30.600 CC lib/nvme/nvme_qpair.o 00:03:30.600 CC lib/nvme/nvme.o 00:03:30.600 CC lib/nvme/nvme_quirks.o 00:03:30.600 CC lib/nvme/nvme_transport.o 00:03:30.600 CC lib/nvme/nvme_discovery.o 00:03:30.600 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:30.600 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:30.600 CC lib/nvme/nvme_tcp.o 00:03:30.600 CC lib/nvme/nvme_opal.o 00:03:30.600 CC lib/nvme/nvme_io_msg.o 00:03:30.600 CC lib/nvme/nvme_poll_group.o 00:03:30.600 CC lib/nvme/nvme_zns.o 00:03:30.600 CC lib/nvme/nvme_cuse.o 00:03:30.600 CC lib/nvme/nvme_vfio_user.o 00:03:30.600 CC lib/nvme/nvme_rdma.o 00:03:30.600 LIB libspdk_env_dpdk.a 00:03:30.600 SO libspdk_env_dpdk.so.13.0 00:03:30.858 SYMLINK libspdk_env_dpdk.so 00:03:32.231 LIB libspdk_thread.a 00:03:32.231 SO libspdk_thread.so.9.0 00:03:32.231 SYMLINK libspdk_thread.so 00:03:32.231 CC lib/accel/accel.o 00:03:32.231 CC lib/virtio/virtio.o 00:03:32.231 CC lib/blob/blobstore.o 00:03:32.231 CC lib/blob/request.o 00:03:32.231 CC lib/vfu_tgt/tgt_endpoint.o 00:03:32.231 CC lib/accel/accel_rpc.o 00:03:32.231 CC lib/init/json_config.o 00:03:32.231 CC lib/blob/zeroes.o 00:03:32.231 CC lib/virtio/virtio_vhost_user.o 00:03:32.231 CC lib/vfu_tgt/tgt_rpc.o 00:03:32.231 CC lib/accel/accel_sw.o 00:03:32.231 CC lib/virtio/virtio_vfio_user.o 00:03:32.231 CC lib/blob/blob_bs_dev.o 00:03:32.231 CC lib/init/subsystem.o 00:03:32.231 CC lib/virtio/virtio_pci.o 00:03:32.231 CC lib/init/subsystem_rpc.o 00:03:32.231 CC lib/init/rpc.o 00:03:32.489 LIB libspdk_init.a 00:03:32.489 SO libspdk_init.so.4.0 00:03:32.489 SYMLINK libspdk_init.so 00:03:32.489 LIB libspdk_virtio.a 00:03:32.489 LIB libspdk_vfu_tgt.a 00:03:32.489 SO libspdk_vfu_tgt.so.2.0 00:03:32.489 SO libspdk_virtio.so.6.0 00:03:32.489 SYMLINK libspdk_vfu_tgt.so 00:03:32.748 SYMLINK libspdk_virtio.so 00:03:32.748 CC lib/event/app.o 00:03:32.748 CC lib/event/reactor.o 00:03:32.748 CC lib/event/log_rpc.o 00:03:32.748 CC lib/event/app_rpc.o 00:03:32.748 CC lib/event/scheduler_static.o 00:03:33.005 LIB libspdk_nvme.a 00:03:33.005 SO libspdk_nvme.so.12.0 00:03:33.005 LIB libspdk_event.a 00:03:33.005 SO libspdk_event.so.12.0 00:03:33.264 SYMLINK libspdk_event.so 00:03:33.264 SYMLINK libspdk_nvme.so 00:03:33.264 LIB libspdk_accel.a 00:03:33.264 SO libspdk_accel.so.14.0 00:03:33.264 SYMLINK libspdk_accel.so 00:03:33.522 CC lib/bdev/bdev.o 00:03:33.522 CC lib/bdev/bdev_rpc.o 00:03:33.522 CC lib/bdev/bdev_zone.o 00:03:33.522 CC lib/bdev/part.o 00:03:33.522 CC lib/bdev/scsi_nvme.o 00:03:34.893 LIB libspdk_blob.a 00:03:34.893 SO libspdk_blob.so.10.1 00:03:35.151 SYMLINK libspdk_blob.so 00:03:35.151 CC lib/blobfs/blobfs.o 00:03:35.151 CC lib/blobfs/tree.o 00:03:35.151 CC lib/lvol/lvol.o 00:03:36.085 LIB libspdk_blobfs.a 00:03:36.085 SO libspdk_blobfs.so.9.0 00:03:36.085 LIB libspdk_bdev.a 00:03:36.085 SO libspdk_bdev.so.14.0 00:03:36.085 SYMLINK libspdk_blobfs.so 00:03:36.085 LIB libspdk_lvol.a 00:03:36.085 SO libspdk_lvol.so.9.1 00:03:36.085 SYMLINK libspdk_bdev.so 00:03:36.085 SYMLINK libspdk_lvol.so 00:03:36.085 CC lib/ublk/ublk.o 00:03:36.085 CC lib/ftl/ftl_core.o 00:03:36.085 CC lib/nvmf/ctrlr.o 00:03:36.085 CC lib/scsi/dev.o 00:03:36.085 CC lib/ftl/ftl_init.o 00:03:36.085 CC lib/ublk/ublk_rpc.o 00:03:36.085 CC lib/nbd/nbd.o 00:03:36.085 CC lib/scsi/lun.o 00:03:36.085 CC lib/nvmf/ctrlr_discovery.o 00:03:36.085 CC lib/ftl/ftl_layout.o 00:03:36.085 CC lib/nbd/nbd_rpc.o 00:03:36.085 CC lib/scsi/port.o 00:03:36.085 CC lib/ftl/ftl_debug.o 00:03:36.085 CC lib/nvmf/ctrlr_bdev.o 00:03:36.085 CC lib/scsi/scsi.o 00:03:36.086 CC lib/nvmf/subsystem.o 00:03:36.086 CC lib/ftl/ftl_io.o 00:03:36.086 CC lib/ftl/ftl_sb.o 00:03:36.086 CC lib/nvmf/nvmf.o 00:03:36.086 CC lib/scsi/scsi_bdev.o 00:03:36.086 CC lib/scsi/scsi_pr.o 00:03:36.086 CC lib/ftl/ftl_l2p.o 00:03:36.086 CC lib/scsi/scsi_rpc.o 00:03:36.351 CC lib/nvmf/transport.o 00:03:36.351 CC lib/nvmf/nvmf_rpc.o 00:03:36.351 CC lib/scsi/task.o 00:03:36.351 CC lib/ftl/ftl_l2p_flat.o 00:03:36.351 CC lib/nvmf/tcp.o 00:03:36.351 CC lib/ftl/ftl_nv_cache.o 00:03:36.351 CC lib/ftl/ftl_band.o 00:03:36.351 CC lib/nvmf/vfio_user.o 00:03:36.351 CC lib/ftl/ftl_band_ops.o 00:03:36.351 CC lib/nvmf/rdma.o 00:03:36.351 CC lib/ftl/ftl_writer.o 00:03:36.351 CC lib/ftl/ftl_rq.o 00:03:36.351 CC lib/ftl/ftl_reloc.o 00:03:36.351 CC lib/ftl/ftl_l2p_cache.o 00:03:36.351 CC lib/ftl/ftl_p2l.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:36.351 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:36.612 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:36.612 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:36.612 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:36.612 CC lib/ftl/utils/ftl_conf.o 00:03:36.612 CC lib/ftl/utils/ftl_md.o 00:03:36.612 CC lib/ftl/utils/ftl_mempool.o 00:03:36.612 CC lib/ftl/utils/ftl_bitmap.o 00:03:36.612 CC lib/ftl/utils/ftl_property.o 00:03:36.612 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:36.612 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:36.612 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:36.612 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:36.612 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:36.612 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:36.612 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:36.612 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:36.612 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:36.612 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:36.612 CC lib/ftl/base/ftl_base_dev.o 00:03:36.871 CC lib/ftl/base/ftl_base_bdev.o 00:03:36.871 CC lib/ftl/ftl_trace.o 00:03:36.871 LIB libspdk_nbd.a 00:03:37.129 SO libspdk_nbd.so.6.0 00:03:37.129 SYMLINK libspdk_nbd.so 00:03:37.129 LIB libspdk_scsi.a 00:03:37.129 SO libspdk_scsi.so.8.0 00:03:37.129 LIB libspdk_ublk.a 00:03:37.129 SO libspdk_ublk.so.2.0 00:03:37.129 SYMLINK libspdk_scsi.so 00:03:37.129 SYMLINK libspdk_ublk.so 00:03:37.388 CC lib/vhost/vhost.o 00:03:37.388 CC lib/iscsi/conn.o 00:03:37.388 CC lib/iscsi/init_grp.o 00:03:37.388 CC lib/vhost/vhost_rpc.o 00:03:37.388 CC lib/vhost/vhost_scsi.o 00:03:37.388 CC lib/iscsi/iscsi.o 00:03:37.388 CC lib/vhost/vhost_blk.o 00:03:37.388 CC lib/iscsi/md5.o 00:03:37.388 CC lib/vhost/rte_vhost_user.o 00:03:37.388 CC lib/iscsi/param.o 00:03:37.388 CC lib/iscsi/portal_grp.o 00:03:37.388 CC lib/iscsi/tgt_node.o 00:03:37.388 CC lib/iscsi/iscsi_subsystem.o 00:03:37.388 CC lib/iscsi/iscsi_rpc.o 00:03:37.388 CC lib/iscsi/task.o 00:03:37.646 LIB libspdk_ftl.a 00:03:37.646 SO libspdk_ftl.so.8.0 00:03:37.904 SYMLINK libspdk_ftl.so 00:03:38.470 LIB libspdk_vhost.a 00:03:38.470 SO libspdk_vhost.so.7.1 00:03:38.728 SYMLINK libspdk_vhost.so 00:03:38.728 LIB libspdk_nvmf.a 00:03:38.728 SO libspdk_nvmf.so.17.0 00:03:38.728 LIB libspdk_iscsi.a 00:03:38.728 SO libspdk_iscsi.so.7.0 00:03:38.987 SYMLINK libspdk_nvmf.so 00:03:38.987 SYMLINK libspdk_iscsi.so 00:03:39.245 CC module/env_dpdk/env_dpdk_rpc.o 00:03:39.245 CC module/vfu_device/vfu_virtio.o 00:03:39.245 CC module/vfu_device/vfu_virtio_blk.o 00:03:39.245 CC module/vfu_device/vfu_virtio_scsi.o 00:03:39.245 CC module/vfu_device/vfu_virtio_rpc.o 00:03:39.245 CC module/accel/ioat/accel_ioat.o 00:03:39.245 CC module/accel/ioat/accel_ioat_rpc.o 00:03:39.245 CC module/accel/iaa/accel_iaa.o 00:03:39.245 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:39.245 CC module/accel/iaa/accel_iaa_rpc.o 00:03:39.245 CC module/sock/posix/posix.o 00:03:39.245 CC module/blob/bdev/blob_bdev.o 00:03:39.245 CC module/accel/dsa/accel_dsa.o 00:03:39.245 CC module/accel/error/accel_error.o 00:03:39.245 CC module/accel/dsa/accel_dsa_rpc.o 00:03:39.245 CC module/scheduler/gscheduler/gscheduler.o 00:03:39.245 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:39.245 CC module/accel/error/accel_error_rpc.o 00:03:39.245 LIB libspdk_env_dpdk_rpc.a 00:03:39.245 SO libspdk_env_dpdk_rpc.so.5.0 00:03:39.245 SYMLINK libspdk_env_dpdk_rpc.so 00:03:39.245 LIB libspdk_scheduler_gscheduler.a 00:03:39.245 LIB libspdk_scheduler_dpdk_governor.a 00:03:39.503 SO libspdk_scheduler_gscheduler.so.3.0 00:03:39.503 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:39.503 LIB libspdk_accel_error.a 00:03:39.503 LIB libspdk_accel_ioat.a 00:03:39.503 LIB libspdk_scheduler_dynamic.a 00:03:39.503 SO libspdk_accel_error.so.1.0 00:03:39.503 LIB libspdk_accel_iaa.a 00:03:39.503 SO libspdk_accel_ioat.so.5.0 00:03:39.503 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:39.503 SYMLINK libspdk_scheduler_gscheduler.so 00:03:39.503 SO libspdk_scheduler_dynamic.so.3.0 00:03:39.503 SO libspdk_accel_iaa.so.2.0 00:03:39.503 LIB libspdk_accel_dsa.a 00:03:39.503 SYMLINK libspdk_accel_error.so 00:03:39.503 SYMLINK libspdk_scheduler_dynamic.so 00:03:39.503 SYMLINK libspdk_accel_ioat.so 00:03:39.503 LIB libspdk_blob_bdev.a 00:03:39.503 SO libspdk_accel_dsa.so.4.0 00:03:39.503 SYMLINK libspdk_accel_iaa.so 00:03:39.503 SO libspdk_blob_bdev.so.10.1 00:03:39.503 SYMLINK libspdk_accel_dsa.so 00:03:39.503 SYMLINK libspdk_blob_bdev.so 00:03:39.763 CC module/bdev/error/vbdev_error.o 00:03:39.763 CC module/bdev/lvol/vbdev_lvol.o 00:03:39.763 CC module/bdev/error/vbdev_error_rpc.o 00:03:39.763 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:39.763 CC module/bdev/gpt/gpt.o 00:03:39.763 CC module/bdev/malloc/bdev_malloc.o 00:03:39.763 CC module/bdev/raid/bdev_raid.o 00:03:39.763 CC module/bdev/null/bdev_null.o 00:03:39.763 CC module/bdev/nvme/bdev_nvme.o 00:03:39.763 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:39.763 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:39.763 CC module/bdev/gpt/vbdev_gpt.o 00:03:39.763 CC module/bdev/raid/bdev_raid_rpc.o 00:03:39.763 CC module/bdev/null/bdev_null_rpc.o 00:03:39.763 CC module/bdev/iscsi/bdev_iscsi.o 00:03:39.763 CC module/blobfs/bdev/blobfs_bdev.o 00:03:39.763 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:39.763 CC module/bdev/raid/bdev_raid_sb.o 00:03:39.763 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:39.763 CC module/bdev/split/vbdev_split.o 00:03:39.763 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:39.763 CC module/bdev/delay/vbdev_delay.o 00:03:39.763 CC module/bdev/passthru/vbdev_passthru.o 00:03:39.763 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:39.763 CC module/bdev/nvme/nvme_rpc.o 00:03:39.763 CC module/bdev/split/vbdev_split_rpc.o 00:03:39.763 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:39.763 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:39.763 CC module/bdev/raid/raid0.o 00:03:39.763 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:39.763 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:39.763 CC module/bdev/raid/raid1.o 00:03:39.763 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:39.763 CC module/bdev/nvme/bdev_mdns_client.o 00:03:39.763 CC module/bdev/aio/bdev_aio.o 00:03:39.763 CC module/bdev/nvme/vbdev_opal.o 00:03:39.763 CC module/bdev/raid/concat.o 00:03:39.763 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:39.763 CC module/bdev/aio/bdev_aio_rpc.o 00:03:39.763 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:39.763 CC module/bdev/ftl/bdev_ftl.o 00:03:39.763 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:39.763 LIB libspdk_vfu_device.a 00:03:40.022 SO libspdk_vfu_device.so.2.0 00:03:40.022 SYMLINK libspdk_vfu_device.so 00:03:40.022 LIB libspdk_sock_posix.a 00:03:40.022 LIB libspdk_blobfs_bdev.a 00:03:40.022 LIB libspdk_bdev_ftl.a 00:03:40.022 SO libspdk_sock_posix.so.5.0 00:03:40.022 SO libspdk_blobfs_bdev.so.5.0 00:03:40.022 LIB libspdk_bdev_aio.a 00:03:40.280 LIB libspdk_bdev_split.a 00:03:40.280 SO libspdk_bdev_ftl.so.5.0 00:03:40.280 LIB libspdk_bdev_error.a 00:03:40.280 SO libspdk_bdev_aio.so.5.0 00:03:40.280 SO libspdk_bdev_split.so.5.0 00:03:40.280 SYMLINK libspdk_blobfs_bdev.so 00:03:40.280 SO libspdk_bdev_error.so.5.0 00:03:40.280 LIB libspdk_bdev_null.a 00:03:40.280 SYMLINK libspdk_sock_posix.so 00:03:40.280 SYMLINK libspdk_bdev_ftl.so 00:03:40.280 SO libspdk_bdev_null.so.5.0 00:03:40.280 SYMLINK libspdk_bdev_aio.so 00:03:40.280 LIB libspdk_bdev_passthru.a 00:03:40.280 SYMLINK libspdk_bdev_split.so 00:03:40.280 LIB libspdk_bdev_gpt.a 00:03:40.280 SYMLINK libspdk_bdev_error.so 00:03:40.280 SO libspdk_bdev_passthru.so.5.0 00:03:40.280 SO libspdk_bdev_gpt.so.5.0 00:03:40.280 SYMLINK libspdk_bdev_null.so 00:03:40.280 LIB libspdk_bdev_zone_block.a 00:03:40.280 SO libspdk_bdev_zone_block.so.5.0 00:03:40.280 SYMLINK libspdk_bdev_passthru.so 00:03:40.280 LIB libspdk_bdev_iscsi.a 00:03:40.280 SYMLINK libspdk_bdev_gpt.so 00:03:40.280 SO libspdk_bdev_iscsi.so.5.0 00:03:40.280 LIB libspdk_bdev_malloc.a 00:03:40.280 SYMLINK libspdk_bdev_zone_block.so 00:03:40.280 LIB libspdk_bdev_delay.a 00:03:40.280 SO libspdk_bdev_malloc.so.5.0 00:03:40.280 SO libspdk_bdev_delay.so.5.0 00:03:40.280 SYMLINK libspdk_bdev_iscsi.so 00:03:40.538 SYMLINK libspdk_bdev_malloc.so 00:03:40.538 LIB libspdk_bdev_virtio.a 00:03:40.538 SYMLINK libspdk_bdev_delay.so 00:03:40.538 SO libspdk_bdev_virtio.so.5.0 00:03:40.538 LIB libspdk_bdev_lvol.a 00:03:40.538 SO libspdk_bdev_lvol.so.5.0 00:03:40.538 SYMLINK libspdk_bdev_virtio.so 00:03:40.538 SYMLINK libspdk_bdev_lvol.so 00:03:40.795 LIB libspdk_bdev_raid.a 00:03:40.795 SO libspdk_bdev_raid.so.5.0 00:03:40.795 SYMLINK libspdk_bdev_raid.so 00:03:42.696 LIB libspdk_bdev_nvme.a 00:03:42.696 SO libspdk_bdev_nvme.so.6.0 00:03:42.696 SYMLINK libspdk_bdev_nvme.so 00:03:42.696 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:42.696 CC module/event/subsystems/scheduler/scheduler.o 00:03:42.696 CC module/event/subsystems/iobuf/iobuf.o 00:03:42.696 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:42.696 CC module/event/subsystems/vmd/vmd.o 00:03:42.696 CC module/event/subsystems/sock/sock.o 00:03:42.696 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:42.696 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:42.954 LIB libspdk_event_sock.a 00:03:42.954 LIB libspdk_event_vhost_blk.a 00:03:42.954 LIB libspdk_event_scheduler.a 00:03:42.954 LIB libspdk_event_vfu_tgt.a 00:03:42.954 LIB libspdk_event_vmd.a 00:03:42.954 SO libspdk_event_sock.so.4.0 00:03:42.954 SO libspdk_event_vhost_blk.so.2.0 00:03:42.954 SO libspdk_event_scheduler.so.3.0 00:03:42.954 LIB libspdk_event_iobuf.a 00:03:42.954 SO libspdk_event_vfu_tgt.so.2.0 00:03:42.954 SO libspdk_event_vmd.so.5.0 00:03:42.954 SO libspdk_event_iobuf.so.2.0 00:03:42.954 SYMLINK libspdk_event_sock.so 00:03:42.954 SYMLINK libspdk_event_vhost_blk.so 00:03:42.954 SYMLINK libspdk_event_scheduler.so 00:03:42.954 SYMLINK libspdk_event_vfu_tgt.so 00:03:42.954 SYMLINK libspdk_event_vmd.so 00:03:42.954 SYMLINK libspdk_event_iobuf.so 00:03:43.213 CC module/event/subsystems/accel/accel.o 00:03:43.213 LIB libspdk_event_accel.a 00:03:43.213 SO libspdk_event_accel.so.5.0 00:03:43.213 SYMLINK libspdk_event_accel.so 00:03:43.471 CC module/event/subsystems/bdev/bdev.o 00:03:43.730 LIB libspdk_event_bdev.a 00:03:43.730 SO libspdk_event_bdev.so.5.0 00:03:43.730 SYMLINK libspdk_event_bdev.so 00:03:43.730 CC module/event/subsystems/scsi/scsi.o 00:03:43.730 CC module/event/subsystems/ublk/ublk.o 00:03:43.730 CC module/event/subsystems/nbd/nbd.o 00:03:43.730 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:43.730 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:43.988 LIB libspdk_event_ublk.a 00:03:43.988 LIB libspdk_event_nbd.a 00:03:43.988 SO libspdk_event_ublk.so.2.0 00:03:43.988 LIB libspdk_event_scsi.a 00:03:43.988 SO libspdk_event_nbd.so.5.0 00:03:43.988 SO libspdk_event_scsi.so.5.0 00:03:43.988 SYMLINK libspdk_event_ublk.so 00:03:43.988 SYMLINK libspdk_event_nbd.so 00:03:43.988 SYMLINK libspdk_event_scsi.so 00:03:43.988 LIB libspdk_event_nvmf.a 00:03:43.988 SO libspdk_event_nvmf.so.5.0 00:03:43.988 SYMLINK libspdk_event_nvmf.so 00:03:44.247 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:44.247 CC module/event/subsystems/iscsi/iscsi.o 00:03:44.247 LIB libspdk_event_vhost_scsi.a 00:03:44.247 LIB libspdk_event_iscsi.a 00:03:44.247 SO libspdk_event_vhost_scsi.so.2.0 00:03:44.247 SO libspdk_event_iscsi.so.5.0 00:03:44.247 SYMLINK libspdk_event_vhost_scsi.so 00:03:44.247 SYMLINK libspdk_event_iscsi.so 00:03:44.511 SO libspdk.so.5.0 00:03:44.511 SYMLINK libspdk.so 00:03:44.511 CC app/trace_record/trace_record.o 00:03:44.511 CXX app/trace/trace.o 00:03:44.511 CC app/spdk_lspci/spdk_lspci.o 00:03:44.511 TEST_HEADER include/spdk/accel.h 00:03:44.511 CC app/spdk_nvme_perf/perf.o 00:03:44.511 CC app/spdk_nvme_identify/identify.o 00:03:44.511 TEST_HEADER include/spdk/accel_module.h 00:03:44.511 TEST_HEADER include/spdk/assert.h 00:03:44.511 CC app/spdk_nvme_discover/discovery_aer.o 00:03:44.511 TEST_HEADER include/spdk/barrier.h 00:03:44.511 CC app/spdk_top/spdk_top.o 00:03:44.511 CC test/rpc_client/rpc_client_test.o 00:03:44.511 TEST_HEADER include/spdk/base64.h 00:03:44.512 TEST_HEADER include/spdk/bdev.h 00:03:44.512 TEST_HEADER include/spdk/bdev_module.h 00:03:44.512 TEST_HEADER include/spdk/bdev_zone.h 00:03:44.512 TEST_HEADER include/spdk/bit_array.h 00:03:44.512 TEST_HEADER include/spdk/bit_pool.h 00:03:44.512 TEST_HEADER include/spdk/blob_bdev.h 00:03:44.776 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:44.776 TEST_HEADER include/spdk/blobfs.h 00:03:44.776 TEST_HEADER include/spdk/blob.h 00:03:44.776 TEST_HEADER include/spdk/conf.h 00:03:44.776 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:44.776 TEST_HEADER include/spdk/config.h 00:03:44.776 TEST_HEADER include/spdk/cpuset.h 00:03:44.776 TEST_HEADER include/spdk/crc16.h 00:03:44.776 TEST_HEADER include/spdk/crc32.h 00:03:44.776 TEST_HEADER include/spdk/crc64.h 00:03:44.776 CC app/spdk_dd/spdk_dd.o 00:03:44.776 TEST_HEADER include/spdk/dif.h 00:03:44.776 TEST_HEADER include/spdk/dma.h 00:03:44.776 CC app/nvmf_tgt/nvmf_main.o 00:03:44.776 TEST_HEADER include/spdk/endian.h 00:03:44.776 TEST_HEADER include/spdk/env_dpdk.h 00:03:44.776 CC app/iscsi_tgt/iscsi_tgt.o 00:03:44.776 TEST_HEADER include/spdk/env.h 00:03:44.776 CC examples/nvme/hello_world/hello_world.o 00:03:44.776 CC examples/ioat/perf/perf.o 00:03:44.776 CC examples/ioat/verify/verify.o 00:03:44.776 CC app/vhost/vhost.o 00:03:44.776 TEST_HEADER include/spdk/event.h 00:03:44.776 CC examples/util/zipf/zipf.o 00:03:44.776 TEST_HEADER include/spdk/fd_group.h 00:03:44.776 CC examples/nvme/arbitration/arbitration.o 00:03:44.776 CC examples/vmd/led/led.o 00:03:44.776 TEST_HEADER include/spdk/fd.h 00:03:44.776 CC examples/nvme/reconnect/reconnect.o 00:03:44.776 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:44.776 TEST_HEADER include/spdk/file.h 00:03:44.776 CC examples/nvme/abort/abort.o 00:03:44.776 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:44.776 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:44.776 TEST_HEADER include/spdk/ftl.h 00:03:44.776 CC examples/sock/hello_world/hello_sock.o 00:03:44.776 CC examples/nvme/hotplug/hotplug.o 00:03:44.776 TEST_HEADER include/spdk/gpt_spec.h 00:03:44.776 CC examples/accel/perf/accel_perf.o 00:03:44.776 CC examples/vmd/lsvmd/lsvmd.o 00:03:44.776 TEST_HEADER include/spdk/hexlify.h 00:03:44.776 TEST_HEADER include/spdk/histogram_data.h 00:03:44.776 CC app/fio/nvme/fio_plugin.o 00:03:44.776 CC test/event/event_perf/event_perf.o 00:03:44.776 TEST_HEADER include/spdk/idxd.h 00:03:44.776 CC examples/idxd/perf/perf.o 00:03:44.776 TEST_HEADER include/spdk/idxd_spec.h 00:03:44.776 TEST_HEADER include/spdk/init.h 00:03:44.776 CC test/nvme/aer/aer.o 00:03:44.776 TEST_HEADER include/spdk/ioat.h 00:03:44.776 CC app/spdk_tgt/spdk_tgt.o 00:03:44.776 TEST_HEADER include/spdk/ioat_spec.h 00:03:44.776 CC test/thread/poller_perf/poller_perf.o 00:03:44.776 TEST_HEADER include/spdk/iscsi_spec.h 00:03:44.776 TEST_HEADER include/spdk/json.h 00:03:44.776 TEST_HEADER include/spdk/jsonrpc.h 00:03:44.776 TEST_HEADER include/spdk/likely.h 00:03:44.776 TEST_HEADER include/spdk/log.h 00:03:44.776 TEST_HEADER include/spdk/lvol.h 00:03:44.776 TEST_HEADER include/spdk/memory.h 00:03:44.776 TEST_HEADER include/spdk/mmio.h 00:03:44.776 TEST_HEADER include/spdk/nbd.h 00:03:44.776 TEST_HEADER include/spdk/notify.h 00:03:44.776 TEST_HEADER include/spdk/nvme.h 00:03:44.776 CC examples/bdev/hello_world/hello_bdev.o 00:03:44.776 TEST_HEADER include/spdk/nvme_intel.h 00:03:44.776 CC examples/nvmf/nvmf/nvmf.o 00:03:44.776 CC examples/bdev/bdevperf/bdevperf.o 00:03:44.776 CC examples/blob/cli/blobcli.o 00:03:44.776 CC test/dma/test_dma/test_dma.o 00:03:44.776 CC test/bdev/bdevio/bdevio.o 00:03:44.776 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:44.777 CC test/blobfs/mkfs/mkfs.o 00:03:44.777 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:44.777 CC test/accel/dif/dif.o 00:03:44.777 CC examples/thread/thread/thread_ex.o 00:03:44.777 TEST_HEADER include/spdk/nvme_spec.h 00:03:44.777 CC examples/blob/hello_world/hello_blob.o 00:03:44.777 TEST_HEADER include/spdk/nvme_zns.h 00:03:44.777 CC test/app/bdev_svc/bdev_svc.o 00:03:44.777 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:44.777 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:44.777 TEST_HEADER include/spdk/nvmf.h 00:03:44.777 TEST_HEADER include/spdk/nvmf_spec.h 00:03:44.777 TEST_HEADER include/spdk/nvmf_transport.h 00:03:44.777 CC test/lvol/esnap/esnap.o 00:03:44.777 TEST_HEADER include/spdk/opal.h 00:03:44.777 TEST_HEADER include/spdk/opal_spec.h 00:03:44.777 TEST_HEADER include/spdk/pci_ids.h 00:03:44.777 TEST_HEADER include/spdk/pipe.h 00:03:44.777 CC test/env/mem_callbacks/mem_callbacks.o 00:03:44.777 TEST_HEADER include/spdk/queue.h 00:03:44.777 TEST_HEADER include/spdk/reduce.h 00:03:44.777 TEST_HEADER include/spdk/rpc.h 00:03:44.777 TEST_HEADER include/spdk/scheduler.h 00:03:44.777 TEST_HEADER include/spdk/scsi.h 00:03:44.777 TEST_HEADER include/spdk/scsi_spec.h 00:03:44.777 TEST_HEADER include/spdk/sock.h 00:03:44.777 TEST_HEADER include/spdk/stdinc.h 00:03:44.777 TEST_HEADER include/spdk/string.h 00:03:44.777 TEST_HEADER include/spdk/thread.h 00:03:44.777 TEST_HEADER include/spdk/trace.h 00:03:44.777 TEST_HEADER include/spdk/trace_parser.h 00:03:44.777 TEST_HEADER include/spdk/tree.h 00:03:44.777 TEST_HEADER include/spdk/ublk.h 00:03:44.777 LINK spdk_lspci 00:03:44.777 TEST_HEADER include/spdk/util.h 00:03:44.777 TEST_HEADER include/spdk/uuid.h 00:03:44.777 TEST_HEADER include/spdk/version.h 00:03:44.777 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:44.777 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:44.777 TEST_HEADER include/spdk/vhost.h 00:03:45.040 TEST_HEADER include/spdk/vmd.h 00:03:45.040 TEST_HEADER include/spdk/xor.h 00:03:45.040 TEST_HEADER include/spdk/zipf.h 00:03:45.040 CXX test/cpp_headers/accel.o 00:03:45.040 LINK rpc_client_test 00:03:45.040 LINK lsvmd 00:03:45.040 LINK led 00:03:45.040 LINK interrupt_tgt 00:03:45.040 LINK zipf 00:03:45.040 LINK spdk_nvme_discover 00:03:45.040 LINK event_perf 00:03:45.040 LINK poller_perf 00:03:45.040 LINK nvmf_tgt 00:03:45.040 LINK cmb_copy 00:03:45.040 LINK pmr_persistence 00:03:45.040 LINK vhost 00:03:45.040 LINK spdk_trace_record 00:03:45.040 LINK iscsi_tgt 00:03:45.040 LINK ioat_perf 00:03:45.040 LINK verify 00:03:45.040 LINK hello_world 00:03:45.040 LINK spdk_tgt 00:03:45.040 LINK bdev_svc 00:03:45.300 LINK hello_sock 00:03:45.300 LINK hotplug 00:03:45.300 LINK mkfs 00:03:45.300 LINK hello_bdev 00:03:45.300 LINK hello_blob 00:03:45.300 LINK thread 00:03:45.300 CXX test/cpp_headers/accel_module.o 00:03:45.300 LINK aer 00:03:45.300 CXX test/cpp_headers/assert.o 00:03:45.300 LINK arbitration 00:03:45.300 LINK idxd_perf 00:03:45.300 LINK spdk_dd 00:03:45.300 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:45.300 LINK nvmf 00:03:45.300 LINK reconnect 00:03:45.560 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:45.560 CC test/env/vtophys/vtophys.o 00:03:45.560 LINK abort 00:03:45.560 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:45.561 CC test/event/reactor/reactor.o 00:03:45.561 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:45.561 CC test/event/reactor_perf/reactor_perf.o 00:03:45.561 LINK spdk_trace 00:03:45.561 LINK dif 00:03:45.561 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:45.561 CC test/event/app_repeat/app_repeat.o 00:03:45.561 LINK bdevio 00:03:45.561 CC test/nvme/sgl/sgl.o 00:03:45.561 CC test/app/histogram_perf/histogram_perf.o 00:03:45.561 CC test/env/memory/memory_ut.o 00:03:45.561 CC test/nvme/reset/reset.o 00:03:45.561 CXX test/cpp_headers/barrier.o 00:03:45.561 LINK test_dma 00:03:45.561 CXX test/cpp_headers/base64.o 00:03:45.561 CC test/app/jsoncat/jsoncat.o 00:03:45.561 LINK accel_perf 00:03:45.561 CC test/env/pci/pci_ut.o 00:03:45.561 CC test/nvme/e2edp/nvme_dp.o 00:03:45.561 CXX test/cpp_headers/bdev.o 00:03:45.561 CC test/event/scheduler/scheduler.o 00:03:45.561 LINK nvme_manage 00:03:45.561 CC app/fio/bdev/fio_plugin.o 00:03:45.561 CXX test/cpp_headers/bdev_module.o 00:03:45.561 CC test/nvme/overhead/overhead.o 00:03:45.561 CXX test/cpp_headers/bdev_zone.o 00:03:45.822 CXX test/cpp_headers/bit_array.o 00:03:45.822 LINK blobcli 00:03:45.822 CC test/nvme/err_injection/err_injection.o 00:03:45.822 CC test/nvme/startup/startup.o 00:03:45.822 LINK spdk_nvme 00:03:45.822 CXX test/cpp_headers/bit_pool.o 00:03:45.822 LINK reactor 00:03:45.822 LINK vtophys 00:03:45.822 LINK reactor_perf 00:03:45.822 CC test/nvme/reserve/reserve.o 00:03:45.822 CC test/app/stub/stub.o 00:03:45.822 CXX test/cpp_headers/blob_bdev.o 00:03:45.822 LINK app_repeat 00:03:45.822 CC test/nvme/simple_copy/simple_copy.o 00:03:45.822 LINK env_dpdk_post_init 00:03:45.822 LINK histogram_perf 00:03:45.822 CC test/nvme/connect_stress/connect_stress.o 00:03:45.822 CC test/nvme/boot_partition/boot_partition.o 00:03:45.822 CC test/nvme/compliance/nvme_compliance.o 00:03:45.822 LINK jsoncat 00:03:45.822 CXX test/cpp_headers/blobfs_bdev.o 00:03:45.822 CC test/nvme/fused_ordering/fused_ordering.o 00:03:45.822 CXX test/cpp_headers/blobfs.o 00:03:45.822 CXX test/cpp_headers/blob.o 00:03:45.822 CXX test/cpp_headers/conf.o 00:03:46.087 CXX test/cpp_headers/config.o 00:03:46.087 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:46.087 CC test/nvme/fdp/fdp.o 00:03:46.087 CXX test/cpp_headers/cpuset.o 00:03:46.087 LINK reset 00:03:46.087 CC test/nvme/cuse/cuse.o 00:03:46.087 CXX test/cpp_headers/crc16.o 00:03:46.087 LINK sgl 00:03:46.087 CXX test/cpp_headers/crc32.o 00:03:46.087 CXX test/cpp_headers/crc64.o 00:03:46.087 LINK mem_callbacks 00:03:46.087 CXX test/cpp_headers/dif.o 00:03:46.087 CXX test/cpp_headers/dma.o 00:03:46.087 CXX test/cpp_headers/endian.o 00:03:46.087 LINK scheduler 00:03:46.087 CXX test/cpp_headers/env_dpdk.o 00:03:46.087 CXX test/cpp_headers/env.o 00:03:46.087 LINK startup 00:03:46.087 CXX test/cpp_headers/event.o 00:03:46.087 CXX test/cpp_headers/fd_group.o 00:03:46.087 LINK err_injection 00:03:46.087 LINK stub 00:03:46.087 CXX test/cpp_headers/fd.o 00:03:46.087 CXX test/cpp_headers/file.o 00:03:46.087 LINK nvme_fuzz 00:03:46.087 LINK nvme_dp 00:03:46.087 CXX test/cpp_headers/ftl.o 00:03:46.087 LINK reserve 00:03:46.087 CXX test/cpp_headers/gpt_spec.o 00:03:46.087 LINK boot_partition 00:03:46.087 LINK connect_stress 00:03:46.350 LINK spdk_nvme_perf 00:03:46.350 LINK spdk_nvme_identify 00:03:46.350 LINK vhost_fuzz 00:03:46.350 LINK overhead 00:03:46.350 LINK bdevperf 00:03:46.350 LINK simple_copy 00:03:46.350 LINK spdk_top 00:03:46.350 CXX test/cpp_headers/hexlify.o 00:03:46.350 CXX test/cpp_headers/histogram_data.o 00:03:46.350 CXX test/cpp_headers/idxd.o 00:03:46.350 CXX test/cpp_headers/idxd_spec.o 00:03:46.350 LINK fused_ordering 00:03:46.350 CXX test/cpp_headers/init.o 00:03:46.350 LINK pci_ut 00:03:46.350 CXX test/cpp_headers/ioat.o 00:03:46.350 CXX test/cpp_headers/ioat_spec.o 00:03:46.350 LINK doorbell_aers 00:03:46.350 CXX test/cpp_headers/iscsi_spec.o 00:03:46.350 CXX test/cpp_headers/json.o 00:03:46.350 CXX test/cpp_headers/jsonrpc.o 00:03:46.350 CXX test/cpp_headers/likely.o 00:03:46.350 CXX test/cpp_headers/log.o 00:03:46.350 CXX test/cpp_headers/lvol.o 00:03:46.350 CXX test/cpp_headers/memory.o 00:03:46.350 CXX test/cpp_headers/mmio.o 00:03:46.350 CXX test/cpp_headers/nbd.o 00:03:46.350 CXX test/cpp_headers/notify.o 00:03:46.350 CXX test/cpp_headers/nvme.o 00:03:46.611 CXX test/cpp_headers/nvme_intel.o 00:03:46.611 CXX test/cpp_headers/nvme_ocssd.o 00:03:46.611 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:46.611 CXX test/cpp_headers/nvme_spec.o 00:03:46.611 CXX test/cpp_headers/nvme_zns.o 00:03:46.611 CXX test/cpp_headers/nvmf_cmd.o 00:03:46.611 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:46.611 CXX test/cpp_headers/nvmf.o 00:03:46.611 CXX test/cpp_headers/nvmf_spec.o 00:03:46.611 CXX test/cpp_headers/nvmf_transport.o 00:03:46.611 CXX test/cpp_headers/opal.o 00:03:46.611 CXX test/cpp_headers/opal_spec.o 00:03:46.611 LINK nvme_compliance 00:03:46.611 CXX test/cpp_headers/pci_ids.o 00:03:46.611 CXX test/cpp_headers/pipe.o 00:03:46.611 CXX test/cpp_headers/queue.o 00:03:46.611 CXX test/cpp_headers/reduce.o 00:03:46.611 CXX test/cpp_headers/rpc.o 00:03:46.611 CXX test/cpp_headers/scheduler.o 00:03:46.611 CXX test/cpp_headers/scsi.o 00:03:46.611 CXX test/cpp_headers/scsi_spec.o 00:03:46.611 CXX test/cpp_headers/sock.o 00:03:46.611 LINK fdp 00:03:46.611 LINK spdk_bdev 00:03:46.611 CXX test/cpp_headers/stdinc.o 00:03:46.611 CXX test/cpp_headers/string.o 00:03:46.611 CXX test/cpp_headers/trace.o 00:03:46.611 CXX test/cpp_headers/thread.o 00:03:46.611 CXX test/cpp_headers/trace_parser.o 00:03:46.611 CXX test/cpp_headers/tree.o 00:03:46.611 CXX test/cpp_headers/ublk.o 00:03:46.611 CXX test/cpp_headers/util.o 00:03:46.611 CXX test/cpp_headers/uuid.o 00:03:46.611 CXX test/cpp_headers/version.o 00:03:46.611 CXX test/cpp_headers/vfio_user_pci.o 00:03:46.872 CXX test/cpp_headers/vfio_user_spec.o 00:03:46.872 CXX test/cpp_headers/vhost.o 00:03:46.872 CXX test/cpp_headers/vmd.o 00:03:46.872 CXX test/cpp_headers/xor.o 00:03:46.872 CXX test/cpp_headers/zipf.o 00:03:47.130 LINK memory_ut 00:03:47.696 LINK cuse 00:03:47.696 LINK iscsi_fuzz 00:03:50.978 LINK esnap 00:03:51.237 00:03:51.237 real 0m38.458s 00:03:51.237 user 7m16.728s 00:03:51.237 sys 1m39.614s 00:03:51.237 17:23:28 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:51.237 17:23:28 -- common/autotest_common.sh@10 -- $ set +x 00:03:51.237 ************************************ 00:03:51.237 END TEST make 00:03:51.237 ************************************ 00:03:51.237 17:23:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:51.237 17:23:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:51.237 17:23:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:51.237 17:23:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:51.237 17:23:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:51.237 17:23:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:51.237 17:23:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:51.237 17:23:28 -- scripts/common.sh@335 -- # IFS=.-: 00:03:51.237 17:23:28 -- scripts/common.sh@335 -- # read -ra ver1 00:03:51.237 17:23:28 -- scripts/common.sh@336 -- # IFS=.-: 00:03:51.237 17:23:28 -- scripts/common.sh@336 -- # read -ra ver2 00:03:51.237 17:23:28 -- scripts/common.sh@337 -- # local 'op=<' 00:03:51.237 17:23:28 -- scripts/common.sh@339 -- # ver1_l=2 00:03:51.237 17:23:28 -- scripts/common.sh@340 -- # ver2_l=1 00:03:51.237 17:23:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:51.237 17:23:28 -- scripts/common.sh@343 -- # case "$op" in 00:03:51.237 17:23:28 -- scripts/common.sh@344 -- # : 1 00:03:51.237 17:23:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:51.237 17:23:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:51.237 17:23:28 -- scripts/common.sh@364 -- # decimal 1 00:03:51.237 17:23:28 -- scripts/common.sh@352 -- # local d=1 00:03:51.237 17:23:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:51.237 17:23:28 -- scripts/common.sh@354 -- # echo 1 00:03:51.237 17:23:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:51.237 17:23:28 -- scripts/common.sh@365 -- # decimal 2 00:03:51.237 17:23:28 -- scripts/common.sh@352 -- # local d=2 00:03:51.237 17:23:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:51.237 17:23:28 -- scripts/common.sh@354 -- # echo 2 00:03:51.237 17:23:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:51.237 17:23:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:51.237 17:23:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:51.237 17:23:28 -- scripts/common.sh@367 -- # return 0 00:03:51.237 17:23:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:51.237 17:23:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:51.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:51.237 --rc genhtml_branch_coverage=1 00:03:51.237 --rc genhtml_function_coverage=1 00:03:51.237 --rc genhtml_legend=1 00:03:51.237 --rc geninfo_all_blocks=1 00:03:51.237 --rc geninfo_unexecuted_blocks=1 00:03:51.237 00:03:51.237 ' 00:03:51.237 17:23:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:51.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:51.237 --rc genhtml_branch_coverage=1 00:03:51.237 --rc genhtml_function_coverage=1 00:03:51.237 --rc genhtml_legend=1 00:03:51.237 --rc geninfo_all_blocks=1 00:03:51.237 --rc geninfo_unexecuted_blocks=1 00:03:51.237 00:03:51.237 ' 00:03:51.237 17:23:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:51.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:51.237 --rc genhtml_branch_coverage=1 00:03:51.237 --rc genhtml_function_coverage=1 00:03:51.237 --rc genhtml_legend=1 00:03:51.237 --rc geninfo_all_blocks=1 00:03:51.237 --rc geninfo_unexecuted_blocks=1 00:03:51.237 00:03:51.237 ' 00:03:51.237 17:23:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:51.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:51.237 --rc genhtml_branch_coverage=1 00:03:51.237 --rc genhtml_function_coverage=1 00:03:51.237 --rc genhtml_legend=1 00:03:51.237 --rc geninfo_all_blocks=1 00:03:51.237 --rc geninfo_unexecuted_blocks=1 00:03:51.237 00:03:51.237 ' 00:03:51.237 17:23:28 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:51.237 17:23:28 -- nvmf/common.sh@7 -- # uname -s 00:03:51.237 17:23:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:51.237 17:23:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:51.237 17:23:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:51.237 17:23:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:51.237 17:23:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:51.237 17:23:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:51.237 17:23:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:51.237 17:23:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:51.237 17:23:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:51.237 17:23:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:51.237 17:23:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:51.237 17:23:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:51.237 17:23:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:51.237 17:23:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:51.237 17:23:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:51.237 17:23:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:51.237 17:23:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:51.237 17:23:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:51.237 17:23:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:51.237 17:23:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:51.237 17:23:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:51.237 17:23:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:51.237 17:23:28 -- paths/export.sh@5 -- # export PATH 00:03:51.237 17:23:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:51.237 17:23:28 -- nvmf/common.sh@46 -- # : 0 00:03:51.237 17:23:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:51.237 17:23:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:51.237 17:23:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:51.237 17:23:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:51.237 17:23:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:51.237 17:23:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:51.237 17:23:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:51.237 17:23:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:51.237 17:23:28 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:51.238 17:23:28 -- spdk/autotest.sh@32 -- # uname -s 00:03:51.238 17:23:28 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:51.238 17:23:28 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:51.238 17:23:28 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:51.238 17:23:28 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:51.238 17:23:28 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:51.238 17:23:28 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:51.238 17:23:28 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:51.238 17:23:28 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:51.238 17:23:28 -- spdk/autotest.sh@48 -- # udevadm_pid=1426909 00:03:51.238 17:23:28 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:51.238 17:23:28 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:51.238 17:23:28 -- spdk/autotest.sh@54 -- # echo 1426911 00:03:51.238 17:23:28 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:51.238 17:23:28 -- spdk/autotest.sh@56 -- # echo 1426912 00:03:51.238 17:23:28 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:51.238 17:23:28 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:51.238 17:23:28 -- spdk/autotest.sh@60 -- # echo 1426913 00:03:51.238 17:23:28 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:51.238 17:23:28 -- spdk/autotest.sh@62 -- # echo 1426914 00:03:51.238 17:23:28 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:51.238 17:23:28 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:51.238 17:23:28 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:51.238 17:23:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:51.238 17:23:28 -- common/autotest_common.sh@10 -- # set +x 00:03:51.238 17:23:28 -- spdk/autotest.sh@70 -- # create_test_list 00:03:51.238 17:23:28 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:51.238 17:23:28 -- common/autotest_common.sh@10 -- # set +x 00:03:51.238 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:51.497 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:51.497 17:23:28 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:51.497 17:23:28 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:51.497 17:23:28 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:51.497 17:23:28 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:51.497 17:23:28 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:51.497 17:23:28 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:51.497 17:23:28 -- common/autotest_common.sh@1450 -- # uname 00:03:51.497 17:23:28 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:51.497 17:23:28 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:51.497 17:23:28 -- common/autotest_common.sh@1470 -- # uname 00:03:51.497 17:23:28 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:51.497 17:23:28 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:51.497 17:23:28 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:51.497 lcov: LCOV version 1.15 00:03:51.497 17:23:28 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:54.813 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:54.813 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:54.813 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:54.813 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:54.813 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:54.813 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:26.901 17:24:01 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:26.901 17:24:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:26.901 17:24:01 -- common/autotest_common.sh@10 -- # set +x 00:04:26.901 17:24:01 -- spdk/autotest.sh@89 -- # rm -f 00:04:26.901 17:24:01 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:26.901 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:26.901 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:26.901 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:26.901 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:26.901 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:26.901 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:26.901 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:26.901 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:26.901 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:26.901 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:26.901 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:26.901 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:26.901 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:26.901 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:26.901 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:26.901 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:26.901 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:26.901 17:24:03 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:26.901 17:24:03 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:26.901 17:24:03 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:26.901 17:24:03 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:26.901 17:24:03 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:26.901 17:24:03 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:26.901 17:24:03 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:26.901 17:24:03 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:26.901 17:24:03 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:26.901 17:24:03 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:26.901 17:24:03 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:26.901 17:24:03 -- spdk/autotest.sh@108 -- # grep -v p 00:04:26.901 17:24:03 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:26.901 17:24:03 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:26.901 17:24:03 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:26.901 17:24:03 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:26.901 17:24:03 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:26.901 No valid GPT data, bailing 00:04:26.901 17:24:03 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:26.901 17:24:03 -- scripts/common.sh@393 -- # pt= 00:04:26.901 17:24:03 -- scripts/common.sh@394 -- # return 1 00:04:26.901 17:24:03 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:26.901 1+0 records in 00:04:26.901 1+0 records out 00:04:26.901 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00165844 s, 632 MB/s 00:04:26.901 17:24:03 -- spdk/autotest.sh@116 -- # sync 00:04:26.901 17:24:03 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:26.901 17:24:03 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:26.901 17:24:03 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:27.838 17:24:05 -- spdk/autotest.sh@122 -- # uname -s 00:04:27.838 17:24:05 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:27.838 17:24:05 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:27.838 17:24:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.838 17:24:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.838 17:24:05 -- common/autotest_common.sh@10 -- # set +x 00:04:27.838 ************************************ 00:04:27.838 START TEST setup.sh 00:04:27.838 ************************************ 00:04:27.838 17:24:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:27.838 * Looking for test storage... 00:04:27.838 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:27.838 17:24:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.838 17:24:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.838 17:24:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:28.096 17:24:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:28.096 17:24:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:28.096 17:24:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:28.096 17:24:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:28.096 17:24:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:28.096 17:24:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:28.096 17:24:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:28.096 17:24:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:28.096 17:24:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:28.096 17:24:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:28.096 17:24:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:28.096 17:24:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:28.096 17:24:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:28.096 17:24:05 -- scripts/common.sh@344 -- # : 1 00:04:28.097 17:24:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:28.097 17:24:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:28.097 17:24:05 -- scripts/common.sh@364 -- # decimal 1 00:04:28.097 17:24:05 -- scripts/common.sh@352 -- # local d=1 00:04:28.097 17:24:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:28.097 17:24:05 -- scripts/common.sh@354 -- # echo 1 00:04:28.097 17:24:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:28.097 17:24:05 -- scripts/common.sh@365 -- # decimal 2 00:04:28.097 17:24:05 -- scripts/common.sh@352 -- # local d=2 00:04:28.097 17:24:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:28.097 17:24:05 -- scripts/common.sh@354 -- # echo 2 00:04:28.097 17:24:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:28.097 17:24:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:28.097 17:24:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:28.097 17:24:05 -- scripts/common.sh@367 -- # return 0 00:04:28.097 17:24:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:28.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.097 --rc genhtml_branch_coverage=1 00:04:28.097 --rc genhtml_function_coverage=1 00:04:28.097 --rc genhtml_legend=1 00:04:28.097 --rc geninfo_all_blocks=1 00:04:28.097 --rc geninfo_unexecuted_blocks=1 00:04:28.097 00:04:28.097 ' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:28.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.097 --rc genhtml_branch_coverage=1 00:04:28.097 --rc genhtml_function_coverage=1 00:04:28.097 --rc genhtml_legend=1 00:04:28.097 --rc geninfo_all_blocks=1 00:04:28.097 --rc geninfo_unexecuted_blocks=1 00:04:28.097 00:04:28.097 ' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:28.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.097 --rc genhtml_branch_coverage=1 00:04:28.097 --rc genhtml_function_coverage=1 00:04:28.097 --rc genhtml_legend=1 00:04:28.097 --rc geninfo_all_blocks=1 00:04:28.097 --rc geninfo_unexecuted_blocks=1 00:04:28.097 00:04:28.097 ' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:28.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.097 --rc genhtml_branch_coverage=1 00:04:28.097 --rc genhtml_function_coverage=1 00:04:28.097 --rc genhtml_legend=1 00:04:28.097 --rc geninfo_all_blocks=1 00:04:28.097 --rc geninfo_unexecuted_blocks=1 00:04:28.097 00:04:28.097 ' 00:04:28.097 17:24:05 -- setup/test-setup.sh@10 -- # uname -s 00:04:28.097 17:24:05 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:28.097 17:24:05 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:28.097 17:24:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.097 17:24:05 -- common/autotest_common.sh@10 -- # set +x 00:04:28.097 ************************************ 00:04:28.097 START TEST acl 00:04:28.097 ************************************ 00:04:28.097 17:24:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:28.097 * Looking for test storage... 00:04:28.097 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:28.097 17:24:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:28.097 17:24:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:28.097 17:24:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:28.097 17:24:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:28.097 17:24:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:28.097 17:24:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:28.097 17:24:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:28.097 17:24:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:28.097 17:24:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:28.097 17:24:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:28.097 17:24:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:28.097 17:24:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:28.097 17:24:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:28.097 17:24:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:28.097 17:24:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:28.097 17:24:05 -- scripts/common.sh@344 -- # : 1 00:04:28.097 17:24:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:28.097 17:24:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:28.097 17:24:05 -- scripts/common.sh@364 -- # decimal 1 00:04:28.097 17:24:05 -- scripts/common.sh@352 -- # local d=1 00:04:28.097 17:24:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:28.097 17:24:05 -- scripts/common.sh@354 -- # echo 1 00:04:28.097 17:24:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:28.097 17:24:05 -- scripts/common.sh@365 -- # decimal 2 00:04:28.097 17:24:05 -- scripts/common.sh@352 -- # local d=2 00:04:28.097 17:24:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:28.097 17:24:05 -- scripts/common.sh@354 -- # echo 2 00:04:28.097 17:24:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:28.097 17:24:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:28.097 17:24:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:28.097 17:24:05 -- scripts/common.sh@367 -- # return 0 00:04:28.097 17:24:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:28.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.097 --rc genhtml_branch_coverage=1 00:04:28.097 --rc genhtml_function_coverage=1 00:04:28.097 --rc genhtml_legend=1 00:04:28.097 --rc geninfo_all_blocks=1 00:04:28.097 --rc geninfo_unexecuted_blocks=1 00:04:28.097 00:04:28.097 ' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:28.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.097 --rc genhtml_branch_coverage=1 00:04:28.097 --rc genhtml_function_coverage=1 00:04:28.097 --rc genhtml_legend=1 00:04:28.097 --rc geninfo_all_blocks=1 00:04:28.097 --rc geninfo_unexecuted_blocks=1 00:04:28.097 00:04:28.097 ' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:28.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.097 --rc genhtml_branch_coverage=1 00:04:28.097 --rc genhtml_function_coverage=1 00:04:28.097 --rc genhtml_legend=1 00:04:28.097 --rc geninfo_all_blocks=1 00:04:28.097 --rc geninfo_unexecuted_blocks=1 00:04:28.097 00:04:28.097 ' 00:04:28.097 17:24:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:28.097 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.097 --rc genhtml_branch_coverage=1 00:04:28.097 --rc genhtml_function_coverage=1 00:04:28.097 --rc genhtml_legend=1 00:04:28.097 --rc geninfo_all_blocks=1 00:04:28.097 --rc geninfo_unexecuted_blocks=1 00:04:28.097 00:04:28.097 ' 00:04:28.097 17:24:05 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:28.097 17:24:05 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:28.097 17:24:05 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:28.097 17:24:05 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:28.097 17:24:05 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:28.097 17:24:05 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:28.097 17:24:05 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:28.097 17:24:05 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:28.097 17:24:05 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:28.097 17:24:05 -- setup/acl.sh@12 -- # devs=() 00:04:28.097 17:24:05 -- setup/acl.sh@12 -- # declare -a devs 00:04:28.097 17:24:05 -- setup/acl.sh@13 -- # drivers=() 00:04:28.097 17:24:05 -- setup/acl.sh@13 -- # declare -A drivers 00:04:28.097 17:24:05 -- setup/acl.sh@51 -- # setup reset 00:04:28.097 17:24:05 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:28.097 17:24:05 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:30.009 17:24:07 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:30.009 17:24:07 -- setup/acl.sh@16 -- # local dev driver 00:04:30.009 17:24:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.009 17:24:07 -- setup/acl.sh@15 -- # setup output status 00:04:30.009 17:24:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:30.009 17:24:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:30.943 Hugepages 00:04:30.943 node hugesize free / total 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 00:04:30.943 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.943 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.943 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:30.943 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # continue 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:30.944 17:24:08 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:30.944 17:24:08 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:30.944 17:24:08 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:30.944 17:24:08 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.944 17:24:08 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:30.944 17:24:08 -- setup/acl.sh@54 -- # run_test denied denied 00:04:30.944 17:24:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.944 17:24:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.944 17:24:08 -- common/autotest_common.sh@10 -- # set +x 00:04:30.944 ************************************ 00:04:30.944 START TEST denied 00:04:30.944 ************************************ 00:04:30.944 17:24:08 -- common/autotest_common.sh@1114 -- # denied 00:04:30.944 17:24:08 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:30.944 17:24:08 -- setup/acl.sh@38 -- # setup output config 00:04:30.944 17:24:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:30.944 17:24:08 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:30.944 17:24:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:32.318 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:32.318 17:24:09 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:32.318 17:24:09 -- setup/acl.sh@28 -- # local dev driver 00:04:32.318 17:24:09 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:32.318 17:24:09 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:32.318 17:24:09 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:32.318 17:24:09 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:32.318 17:24:09 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:32.318 17:24:09 -- setup/acl.sh@41 -- # setup reset 00:04:32.318 17:24:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:32.318 17:24:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:34.852 00:04:34.852 real 0m3.920s 00:04:34.852 user 0m1.155s 00:04:34.852 sys 0m1.867s 00:04:34.852 17:24:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:34.852 17:24:12 -- common/autotest_common.sh@10 -- # set +x 00:04:34.852 ************************************ 00:04:34.852 END TEST denied 00:04:34.852 ************************************ 00:04:34.852 17:24:12 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:34.852 17:24:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.852 17:24:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.852 17:24:12 -- common/autotest_common.sh@10 -- # set +x 00:04:34.852 ************************************ 00:04:34.852 START TEST allowed 00:04:34.852 ************************************ 00:04:34.852 17:24:12 -- common/autotest_common.sh@1114 -- # allowed 00:04:34.852 17:24:12 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:34.852 17:24:12 -- setup/acl.sh@45 -- # setup output config 00:04:34.852 17:24:12 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:34.852 17:24:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:34.852 17:24:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:37.382 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:37.382 17:24:14 -- setup/acl.sh@47 -- # verify 00:04:37.382 17:24:14 -- setup/acl.sh@28 -- # local dev driver 00:04:37.382 17:24:14 -- setup/acl.sh@48 -- # setup reset 00:04:37.382 17:24:14 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:37.382 17:24:14 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:38.758 00:04:38.758 real 0m3.979s 00:04:38.758 user 0m1.007s 00:04:38.758 sys 0m1.859s 00:04:38.758 17:24:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.758 17:24:16 -- common/autotest_common.sh@10 -- # set +x 00:04:38.758 ************************************ 00:04:38.758 END TEST allowed 00:04:38.758 ************************************ 00:04:38.758 00:04:38.758 real 0m10.798s 00:04:38.758 user 0m3.290s 00:04:38.758 sys 0m5.584s 00:04:38.758 17:24:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.758 17:24:16 -- common/autotest_common.sh@10 -- # set +x 00:04:38.758 ************************************ 00:04:38.758 END TEST acl 00:04:38.758 ************************************ 00:04:38.758 17:24:16 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:38.758 17:24:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.758 17:24:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.758 17:24:16 -- common/autotest_common.sh@10 -- # set +x 00:04:38.758 ************************************ 00:04:38.758 START TEST hugepages 00:04:38.758 ************************************ 00:04:38.758 17:24:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:39.019 * Looking for test storage... 00:04:39.019 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:39.019 17:24:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:39.019 17:24:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:39.019 17:24:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:39.019 17:24:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:39.019 17:24:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:39.019 17:24:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:39.019 17:24:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:39.019 17:24:16 -- scripts/common.sh@335 -- # IFS=.-: 00:04:39.019 17:24:16 -- scripts/common.sh@335 -- # read -ra ver1 00:04:39.019 17:24:16 -- scripts/common.sh@336 -- # IFS=.-: 00:04:39.019 17:24:16 -- scripts/common.sh@336 -- # read -ra ver2 00:04:39.019 17:24:16 -- scripts/common.sh@337 -- # local 'op=<' 00:04:39.019 17:24:16 -- scripts/common.sh@339 -- # ver1_l=2 00:04:39.019 17:24:16 -- scripts/common.sh@340 -- # ver2_l=1 00:04:39.019 17:24:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:39.019 17:24:16 -- scripts/common.sh@343 -- # case "$op" in 00:04:39.019 17:24:16 -- scripts/common.sh@344 -- # : 1 00:04:39.019 17:24:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:39.019 17:24:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:39.019 17:24:16 -- scripts/common.sh@364 -- # decimal 1 00:04:39.019 17:24:16 -- scripts/common.sh@352 -- # local d=1 00:04:39.019 17:24:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:39.019 17:24:16 -- scripts/common.sh@354 -- # echo 1 00:04:39.019 17:24:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:39.019 17:24:16 -- scripts/common.sh@365 -- # decimal 2 00:04:39.019 17:24:16 -- scripts/common.sh@352 -- # local d=2 00:04:39.019 17:24:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:39.019 17:24:16 -- scripts/common.sh@354 -- # echo 2 00:04:39.019 17:24:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:39.019 17:24:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:39.019 17:24:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:39.019 17:24:16 -- scripts/common.sh@367 -- # return 0 00:04:39.019 17:24:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:39.019 17:24:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:39.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.019 --rc genhtml_branch_coverage=1 00:04:39.019 --rc genhtml_function_coverage=1 00:04:39.019 --rc genhtml_legend=1 00:04:39.019 --rc geninfo_all_blocks=1 00:04:39.019 --rc geninfo_unexecuted_blocks=1 00:04:39.019 00:04:39.019 ' 00:04:39.019 17:24:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:39.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.019 --rc genhtml_branch_coverage=1 00:04:39.019 --rc genhtml_function_coverage=1 00:04:39.019 --rc genhtml_legend=1 00:04:39.019 --rc geninfo_all_blocks=1 00:04:39.019 --rc geninfo_unexecuted_blocks=1 00:04:39.019 00:04:39.019 ' 00:04:39.019 17:24:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:39.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.019 --rc genhtml_branch_coverage=1 00:04:39.019 --rc genhtml_function_coverage=1 00:04:39.019 --rc genhtml_legend=1 00:04:39.019 --rc geninfo_all_blocks=1 00:04:39.019 --rc geninfo_unexecuted_blocks=1 00:04:39.019 00:04:39.019 ' 00:04:39.019 17:24:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:39.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:39.019 --rc genhtml_branch_coverage=1 00:04:39.019 --rc genhtml_function_coverage=1 00:04:39.019 --rc genhtml_legend=1 00:04:39.019 --rc geninfo_all_blocks=1 00:04:39.019 --rc geninfo_unexecuted_blocks=1 00:04:39.019 00:04:39.019 ' 00:04:39.019 17:24:16 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:39.019 17:24:16 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:39.019 17:24:16 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:39.019 17:24:16 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:39.019 17:24:16 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:39.019 17:24:16 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:39.019 17:24:16 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:39.019 17:24:16 -- setup/common.sh@18 -- # local node= 00:04:39.019 17:24:16 -- setup/common.sh@19 -- # local var val 00:04:39.019 17:24:16 -- setup/common.sh@20 -- # local mem_f mem 00:04:39.019 17:24:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:39.019 17:24:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:39.019 17:24:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:39.019 17:24:16 -- setup/common.sh@28 -- # mapfile -t mem 00:04:39.019 17:24:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:39.019 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.019 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 41210628 kB' 'MemAvailable: 44961500 kB' 'Buffers: 2708 kB' 'Cached: 12665960 kB' 'SwapCached: 0 kB' 'Active: 9365308 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972060 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453104 kB' 'Mapped: 222900 kB' 'Shmem: 8522340 kB' 'KReclaimable: 196732 kB' 'Slab: 682616 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 485884 kB' 'KernelStack: 12800 kB' 'PageTables: 8244 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 10026608 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198168 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.020 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.020 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # continue 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # IFS=': ' 00:04:39.021 17:24:16 -- setup/common.sh@31 -- # read -r var val _ 00:04:39.021 17:24:16 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:39.021 17:24:16 -- setup/common.sh@33 -- # echo 2048 00:04:39.021 17:24:16 -- setup/common.sh@33 -- # return 0 00:04:39.021 17:24:16 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:39.021 17:24:16 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:39.021 17:24:16 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:39.021 17:24:16 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:39.021 17:24:16 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:39.021 17:24:16 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:39.021 17:24:16 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:39.021 17:24:16 -- setup/hugepages.sh@207 -- # get_nodes 00:04:39.021 17:24:16 -- setup/hugepages.sh@27 -- # local node 00:04:39.021 17:24:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:39.021 17:24:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:39.021 17:24:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:39.021 17:24:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:39.021 17:24:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:39.021 17:24:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:39.021 17:24:16 -- setup/hugepages.sh@208 -- # clear_hp 00:04:39.021 17:24:16 -- setup/hugepages.sh@37 -- # local node hp 00:04:39.021 17:24:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:39.021 17:24:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:39.021 17:24:16 -- setup/hugepages.sh@41 -- # echo 0 00:04:39.021 17:24:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:39.021 17:24:16 -- setup/hugepages.sh@41 -- # echo 0 00:04:39.021 17:24:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:39.021 17:24:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:39.021 17:24:16 -- setup/hugepages.sh@41 -- # echo 0 00:04:39.021 17:24:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:39.021 17:24:16 -- setup/hugepages.sh@41 -- # echo 0 00:04:39.021 17:24:16 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:39.021 17:24:16 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:39.021 17:24:16 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:39.021 17:24:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.021 17:24:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.021 17:24:16 -- common/autotest_common.sh@10 -- # set +x 00:04:39.021 ************************************ 00:04:39.021 START TEST default_setup 00:04:39.021 ************************************ 00:04:39.021 17:24:16 -- common/autotest_common.sh@1114 -- # default_setup 00:04:39.021 17:24:16 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:39.021 17:24:16 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:39.021 17:24:16 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:39.021 17:24:16 -- setup/hugepages.sh@51 -- # shift 00:04:39.021 17:24:16 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:39.021 17:24:16 -- setup/hugepages.sh@52 -- # local node_ids 00:04:39.021 17:24:16 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:39.021 17:24:16 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:39.021 17:24:16 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:39.021 17:24:16 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:39.021 17:24:16 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:39.021 17:24:16 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:39.021 17:24:16 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:39.021 17:24:16 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:39.021 17:24:16 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:39.021 17:24:16 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:39.021 17:24:16 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:39.021 17:24:16 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:39.021 17:24:16 -- setup/hugepages.sh@73 -- # return 0 00:04:39.021 17:24:16 -- setup/hugepages.sh@137 -- # setup output 00:04:39.021 17:24:16 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.021 17:24:16 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:40.400 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:40.400 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:40.400 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:40.400 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:40.400 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:40.400 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:40.400 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:40.400 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:40.400 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:40.400 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:40.400 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:40.400 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:40.400 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:40.400 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:40.400 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:40.400 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:41.338 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:41.601 17:24:18 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:41.601 17:24:18 -- setup/hugepages.sh@89 -- # local node 00:04:41.602 17:24:18 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:41.602 17:24:18 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:41.602 17:24:18 -- setup/hugepages.sh@92 -- # local surp 00:04:41.602 17:24:18 -- setup/hugepages.sh@93 -- # local resv 00:04:41.602 17:24:18 -- setup/hugepages.sh@94 -- # local anon 00:04:41.602 17:24:18 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:41.602 17:24:18 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:41.602 17:24:18 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:41.602 17:24:18 -- setup/common.sh@18 -- # local node= 00:04:41.602 17:24:18 -- setup/common.sh@19 -- # local var val 00:04:41.602 17:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.602 17:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.602 17:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:41.602 17:24:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:41.602 17:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.602 17:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43334160 kB' 'MemAvailable: 47085032 kB' 'Buffers: 2708 kB' 'Cached: 12666052 kB' 'SwapCached: 0 kB' 'Active: 9366064 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972816 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453716 kB' 'Mapped: 222456 kB' 'Shmem: 8522432 kB' 'KReclaimable: 196732 kB' 'Slab: 683068 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 486336 kB' 'KernelStack: 12720 kB' 'PageTables: 8348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10032676 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.602 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.602 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:41.603 17:24:18 -- setup/common.sh@33 -- # echo 0 00:04:41.603 17:24:18 -- setup/common.sh@33 -- # return 0 00:04:41.603 17:24:18 -- setup/hugepages.sh@97 -- # anon=0 00:04:41.603 17:24:18 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:41.603 17:24:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:41.603 17:24:18 -- setup/common.sh@18 -- # local node= 00:04:41.603 17:24:18 -- setup/common.sh@19 -- # local var val 00:04:41.603 17:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.603 17:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.603 17:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:41.603 17:24:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:41.603 17:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.603 17:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43334460 kB' 'MemAvailable: 47085332 kB' 'Buffers: 2708 kB' 'Cached: 12666056 kB' 'SwapCached: 0 kB' 'Active: 9366616 kB' 'Inactive: 3753080 kB' 'Active(anon): 8973368 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454296 kB' 'Mapped: 222532 kB' 'Shmem: 8522436 kB' 'KReclaimable: 196732 kB' 'Slab: 683000 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 486268 kB' 'KernelStack: 12784 kB' 'PageTables: 8144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10032688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.603 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.603 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.604 17:24:18 -- setup/common.sh@33 -- # echo 0 00:04:41.604 17:24:18 -- setup/common.sh@33 -- # return 0 00:04:41.604 17:24:18 -- setup/hugepages.sh@99 -- # surp=0 00:04:41.604 17:24:18 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:41.604 17:24:18 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:41.604 17:24:18 -- setup/common.sh@18 -- # local node= 00:04:41.604 17:24:18 -- setup/common.sh@19 -- # local var val 00:04:41.604 17:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.604 17:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.604 17:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:41.604 17:24:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:41.604 17:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.604 17:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43334464 kB' 'MemAvailable: 47085336 kB' 'Buffers: 2708 kB' 'Cached: 12666056 kB' 'SwapCached: 0 kB' 'Active: 9365712 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972464 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453392 kB' 'Mapped: 222508 kB' 'Shmem: 8522436 kB' 'KReclaimable: 196732 kB' 'Slab: 683000 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 486268 kB' 'KernelStack: 12784 kB' 'PageTables: 8040 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10032700 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.604 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.604 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.605 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.605 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:41.606 17:24:18 -- setup/common.sh@33 -- # echo 0 00:04:41.606 17:24:18 -- setup/common.sh@33 -- # return 0 00:04:41.606 17:24:18 -- setup/hugepages.sh@100 -- # resv=0 00:04:41.606 17:24:18 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:41.606 nr_hugepages=1024 00:04:41.606 17:24:18 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:41.606 resv_hugepages=0 00:04:41.606 17:24:18 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:41.606 surplus_hugepages=0 00:04:41.606 17:24:18 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:41.606 anon_hugepages=0 00:04:41.606 17:24:18 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:41.606 17:24:18 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:41.606 17:24:18 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:41.606 17:24:18 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:41.606 17:24:18 -- setup/common.sh@18 -- # local node= 00:04:41.606 17:24:18 -- setup/common.sh@19 -- # local var val 00:04:41.606 17:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.606 17:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.606 17:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:41.606 17:24:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:41.606 17:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.606 17:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43334892 kB' 'MemAvailable: 47085764 kB' 'Buffers: 2708 kB' 'Cached: 12666080 kB' 'SwapCached: 0 kB' 'Active: 9366188 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972940 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453796 kB' 'Mapped: 222432 kB' 'Shmem: 8522460 kB' 'KReclaimable: 196732 kB' 'Slab: 682960 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 486228 kB' 'KernelStack: 12768 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10032716 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.606 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.606 17:24:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.607 17:24:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:41.607 17:24:18 -- setup/common.sh@33 -- # echo 1024 00:04:41.607 17:24:18 -- setup/common.sh@33 -- # return 0 00:04:41.607 17:24:18 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:41.607 17:24:18 -- setup/hugepages.sh@112 -- # get_nodes 00:04:41.607 17:24:18 -- setup/hugepages.sh@27 -- # local node 00:04:41.607 17:24:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:41.607 17:24:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:41.607 17:24:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:41.607 17:24:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:41.607 17:24:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:41.607 17:24:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:41.607 17:24:18 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:41.607 17:24:18 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:41.607 17:24:18 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:41.607 17:24:18 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:41.607 17:24:18 -- setup/common.sh@18 -- # local node=0 00:04:41.607 17:24:18 -- setup/common.sh@19 -- # local var val 00:04:41.607 17:24:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:41.607 17:24:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:41.607 17:24:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:41.607 17:24:18 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:41.607 17:24:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:41.607 17:24:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.607 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 25372584 kB' 'MemUsed: 7502340 kB' 'SwapCached: 0 kB' 'Active: 3966156 kB' 'Inactive: 109700 kB' 'Active(anon): 3816700 kB' 'Inactive(anon): 0 kB' 'Active(file): 149456 kB' 'Inactive(file): 109700 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3854872 kB' 'Mapped: 90120 kB' 'AnonPages: 224176 kB' 'Shmem: 3595716 kB' 'KernelStack: 8040 kB' 'PageTables: 4280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 125796 kB' 'Slab: 435576 kB' 'SReclaimable: 125796 kB' 'SUnreclaim: 309780 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # continue 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:41.608 17:24:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:41.608 17:24:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:41.608 17:24:19 -- setup/common.sh@33 -- # echo 0 00:04:41.608 17:24:19 -- setup/common.sh@33 -- # return 0 00:04:41.608 17:24:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:41.608 17:24:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:41.608 17:24:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:41.608 17:24:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:41.608 17:24:19 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:41.608 node0=1024 expecting 1024 00:04:41.609 17:24:19 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:41.609 00:04:41.609 real 0m2.587s 00:04:41.609 user 0m0.659s 00:04:41.609 sys 0m1.016s 00:04:41.609 17:24:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:41.609 17:24:19 -- common/autotest_common.sh@10 -- # set +x 00:04:41.609 ************************************ 00:04:41.609 END TEST default_setup 00:04:41.609 ************************************ 00:04:41.609 17:24:19 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:41.609 17:24:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:41.609 17:24:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:41.609 17:24:19 -- common/autotest_common.sh@10 -- # set +x 00:04:41.609 ************************************ 00:04:41.609 START TEST per_node_1G_alloc 00:04:41.609 ************************************ 00:04:41.609 17:24:19 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:41.609 17:24:19 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:41.609 17:24:19 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:41.609 17:24:19 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:41.609 17:24:19 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:41.609 17:24:19 -- setup/hugepages.sh@51 -- # shift 00:04:41.609 17:24:19 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:41.609 17:24:19 -- setup/hugepages.sh@52 -- # local node_ids 00:04:41.609 17:24:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:41.609 17:24:19 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:41.609 17:24:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:41.609 17:24:19 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:41.609 17:24:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:41.609 17:24:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:41.609 17:24:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:41.609 17:24:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:41.609 17:24:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:41.609 17:24:19 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:41.609 17:24:19 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:41.609 17:24:19 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:41.609 17:24:19 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:41.609 17:24:19 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:41.609 17:24:19 -- setup/hugepages.sh@73 -- # return 0 00:04:41.609 17:24:19 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:41.609 17:24:19 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:41.609 17:24:19 -- setup/hugepages.sh@146 -- # setup output 00:04:41.609 17:24:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:41.609 17:24:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:43.000 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.000 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:43.000 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.000 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.000 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.000 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.000 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.000 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.000 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.000 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.000 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.000 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.000 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.000 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.000 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.000 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.000 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.000 17:24:20 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:43.000 17:24:20 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:43.000 17:24:20 -- setup/hugepages.sh@89 -- # local node 00:04:43.000 17:24:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:43.000 17:24:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:43.000 17:24:20 -- setup/hugepages.sh@92 -- # local surp 00:04:43.000 17:24:20 -- setup/hugepages.sh@93 -- # local resv 00:04:43.000 17:24:20 -- setup/hugepages.sh@94 -- # local anon 00:04:43.000 17:24:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:43.000 17:24:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:43.000 17:24:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:43.000 17:24:20 -- setup/common.sh@18 -- # local node= 00:04:43.000 17:24:20 -- setup/common.sh@19 -- # local var val 00:04:43.000 17:24:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.000 17:24:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.000 17:24:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.000 17:24:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.000 17:24:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.000 17:24:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43345480 kB' 'MemAvailable: 47096352 kB' 'Buffers: 2708 kB' 'Cached: 12666140 kB' 'SwapCached: 0 kB' 'Active: 9368068 kB' 'Inactive: 3753080 kB' 'Active(anon): 8974820 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455692 kB' 'Mapped: 222460 kB' 'Shmem: 8522520 kB' 'KReclaimable: 196732 kB' 'Slab: 682992 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 486260 kB' 'KernelStack: 12816 kB' 'PageTables: 8100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10033020 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.000 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.000 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.001 17:24:20 -- setup/common.sh@33 -- # echo 0 00:04:43.001 17:24:20 -- setup/common.sh@33 -- # return 0 00:04:43.001 17:24:20 -- setup/hugepages.sh@97 -- # anon=0 00:04:43.001 17:24:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:43.001 17:24:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.001 17:24:20 -- setup/common.sh@18 -- # local node= 00:04:43.001 17:24:20 -- setup/common.sh@19 -- # local var val 00:04:43.001 17:24:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.001 17:24:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.001 17:24:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.001 17:24:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.001 17:24:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.001 17:24:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43353188 kB' 'MemAvailable: 47104060 kB' 'Buffers: 2708 kB' 'Cached: 12666144 kB' 'SwapCached: 0 kB' 'Active: 9367220 kB' 'Inactive: 3753080 kB' 'Active(anon): 8973972 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454944 kB' 'Mapped: 222516 kB' 'Shmem: 8522524 kB' 'KReclaimable: 196732 kB' 'Slab: 682976 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 486244 kB' 'KernelStack: 12784 kB' 'PageTables: 7996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10033032 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.001 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.001 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.002 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.002 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.003 17:24:20 -- setup/common.sh@33 -- # echo 0 00:04:43.003 17:24:20 -- setup/common.sh@33 -- # return 0 00:04:43.003 17:24:20 -- setup/hugepages.sh@99 -- # surp=0 00:04:43.003 17:24:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:43.003 17:24:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:43.003 17:24:20 -- setup/common.sh@18 -- # local node= 00:04:43.003 17:24:20 -- setup/common.sh@19 -- # local var val 00:04:43.003 17:24:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.003 17:24:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.003 17:24:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.003 17:24:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.003 17:24:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.003 17:24:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43353668 kB' 'MemAvailable: 47104540 kB' 'Buffers: 2708 kB' 'Cached: 12666144 kB' 'SwapCached: 0 kB' 'Active: 9366656 kB' 'Inactive: 3753080 kB' 'Active(anon): 8973408 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454324 kB' 'Mapped: 222516 kB' 'Shmem: 8522524 kB' 'KReclaimable: 196732 kB' 'Slab: 682976 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 486244 kB' 'KernelStack: 12784 kB' 'PageTables: 7988 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10033048 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.003 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.003 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.004 17:24:20 -- setup/common.sh@33 -- # echo 0 00:04:43.004 17:24:20 -- setup/common.sh@33 -- # return 0 00:04:43.004 17:24:20 -- setup/hugepages.sh@100 -- # resv=0 00:04:43.004 17:24:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:43.004 nr_hugepages=1024 00:04:43.004 17:24:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:43.004 resv_hugepages=0 00:04:43.004 17:24:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:43.004 surplus_hugepages=0 00:04:43.004 17:24:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:43.004 anon_hugepages=0 00:04:43.004 17:24:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:43.004 17:24:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:43.004 17:24:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:43.004 17:24:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:43.004 17:24:20 -- setup/common.sh@18 -- # local node= 00:04:43.004 17:24:20 -- setup/common.sh@19 -- # local var val 00:04:43.004 17:24:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.004 17:24:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.004 17:24:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.004 17:24:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.004 17:24:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.004 17:24:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43352412 kB' 'MemAvailable: 47103284 kB' 'Buffers: 2708 kB' 'Cached: 12666156 kB' 'SwapCached: 0 kB' 'Active: 9366408 kB' 'Inactive: 3753080 kB' 'Active(anon): 8973160 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454028 kB' 'Mapped: 222516 kB' 'Shmem: 8522536 kB' 'KReclaimable: 196732 kB' 'Slab: 682976 kB' 'SReclaimable: 196732 kB' 'SUnreclaim: 486244 kB' 'KernelStack: 12736 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10033060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.004 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.004 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.005 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.005 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.006 17:24:20 -- setup/common.sh@33 -- # echo 1024 00:04:43.006 17:24:20 -- setup/common.sh@33 -- # return 0 00:04:43.006 17:24:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:43.006 17:24:20 -- setup/hugepages.sh@112 -- # get_nodes 00:04:43.006 17:24:20 -- setup/hugepages.sh@27 -- # local node 00:04:43.006 17:24:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.006 17:24:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:43.006 17:24:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.006 17:24:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:43.006 17:24:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:43.006 17:24:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:43.006 17:24:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:43.006 17:24:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:43.006 17:24:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:43.006 17:24:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.006 17:24:20 -- setup/common.sh@18 -- # local node=0 00:04:43.006 17:24:20 -- setup/common.sh@19 -- # local var val 00:04:43.006 17:24:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.006 17:24:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.006 17:24:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:43.006 17:24:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:43.006 17:24:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.006 17:24:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26426548 kB' 'MemUsed: 6448376 kB' 'SwapCached: 0 kB' 'Active: 3965772 kB' 'Inactive: 109700 kB' 'Active(anon): 3816316 kB' 'Inactive(anon): 0 kB' 'Active(file): 149456 kB' 'Inactive(file): 109700 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3854908 kB' 'Mapped: 90120 kB' 'AnonPages: 223856 kB' 'Shmem: 3595752 kB' 'KernelStack: 8072 kB' 'PageTables: 4360 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 125796 kB' 'Slab: 435540 kB' 'SReclaimable: 125796 kB' 'SUnreclaim: 309744 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.006 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.006 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.266 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.266 17:24:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@33 -- # echo 0 00:04:43.267 17:24:20 -- setup/common.sh@33 -- # return 0 00:04:43.267 17:24:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:43.267 17:24:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:43.267 17:24:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:43.267 17:24:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:43.267 17:24:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.267 17:24:20 -- setup/common.sh@18 -- # local node=1 00:04:43.267 17:24:20 -- setup/common.sh@19 -- # local var val 00:04:43.267 17:24:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.267 17:24:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.267 17:24:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:43.267 17:24:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:43.267 17:24:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.267 17:24:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660752 kB' 'MemFree: 16925360 kB' 'MemUsed: 10735392 kB' 'SwapCached: 0 kB' 'Active: 5403196 kB' 'Inactive: 3643380 kB' 'Active(anon): 5159404 kB' 'Inactive(anon): 0 kB' 'Active(file): 243792 kB' 'Inactive(file): 3643380 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8813996 kB' 'Mapped: 132756 kB' 'AnonPages: 232716 kB' 'Shmem: 4926824 kB' 'KernelStack: 4744 kB' 'PageTables: 3712 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70936 kB' 'Slab: 247420 kB' 'SReclaimable: 70936 kB' 'SUnreclaim: 176484 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.267 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.267 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # continue 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.268 17:24:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.268 17:24:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.268 17:24:20 -- setup/common.sh@33 -- # echo 0 00:04:43.268 17:24:20 -- setup/common.sh@33 -- # return 0 00:04:43.268 17:24:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:43.268 17:24:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:43.268 17:24:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:43.268 17:24:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:43.268 17:24:20 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:43.268 node0=512 expecting 512 00:04:43.268 17:24:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:43.268 17:24:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:43.268 17:24:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:43.268 17:24:20 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:43.268 node1=512 expecting 512 00:04:43.268 17:24:20 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:43.268 00:04:43.268 real 0m1.489s 00:04:43.268 user 0m0.613s 00:04:43.268 sys 0m0.843s 00:04:43.268 17:24:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.268 17:24:20 -- common/autotest_common.sh@10 -- # set +x 00:04:43.268 ************************************ 00:04:43.268 END TEST per_node_1G_alloc 00:04:43.268 ************************************ 00:04:43.268 17:24:20 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:43.268 17:24:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.268 17:24:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.268 17:24:20 -- common/autotest_common.sh@10 -- # set +x 00:04:43.268 ************************************ 00:04:43.268 START TEST even_2G_alloc 00:04:43.268 ************************************ 00:04:43.268 17:24:20 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:43.268 17:24:20 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:43.268 17:24:20 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:43.268 17:24:20 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:43.268 17:24:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:43.268 17:24:20 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:43.268 17:24:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:43.268 17:24:20 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:43.268 17:24:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:43.268 17:24:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:43.268 17:24:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:43.268 17:24:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:43.268 17:24:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:43.268 17:24:20 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:43.268 17:24:20 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:43.268 17:24:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.268 17:24:20 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:43.268 17:24:20 -- setup/hugepages.sh@83 -- # : 512 00:04:43.268 17:24:20 -- setup/hugepages.sh@84 -- # : 1 00:04:43.268 17:24:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.268 17:24:20 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:43.268 17:24:20 -- setup/hugepages.sh@83 -- # : 0 00:04:43.268 17:24:20 -- setup/hugepages.sh@84 -- # : 0 00:04:43.268 17:24:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.268 17:24:20 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:43.268 17:24:20 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:43.268 17:24:20 -- setup/hugepages.sh@153 -- # setup output 00:04:43.268 17:24:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:43.268 17:24:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:44.647 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:44.647 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:44.647 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:44.647 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:44.647 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:44.647 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:44.647 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:44.647 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:44.647 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:44.647 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:44.647 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:44.647 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:44.647 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:44.647 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:44.647 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:44.647 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:44.647 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:44.647 17:24:21 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:44.647 17:24:21 -- setup/hugepages.sh@89 -- # local node 00:04:44.647 17:24:21 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:44.647 17:24:21 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:44.647 17:24:21 -- setup/hugepages.sh@92 -- # local surp 00:04:44.647 17:24:21 -- setup/hugepages.sh@93 -- # local resv 00:04:44.647 17:24:21 -- setup/hugepages.sh@94 -- # local anon 00:04:44.647 17:24:21 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:44.647 17:24:21 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:44.647 17:24:21 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:44.647 17:24:21 -- setup/common.sh@18 -- # local node= 00:04:44.647 17:24:21 -- setup/common.sh@19 -- # local var val 00:04:44.647 17:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.647 17:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.647 17:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.647 17:24:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.647 17:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.647 17:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43331328 kB' 'MemAvailable: 47082196 kB' 'Buffers: 2708 kB' 'Cached: 12666232 kB' 'SwapCached: 0 kB' 'Active: 9366912 kB' 'Inactive: 3753080 kB' 'Active(anon): 8973664 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454352 kB' 'Mapped: 222576 kB' 'Shmem: 8522612 kB' 'KReclaimable: 196724 kB' 'Slab: 682964 kB' 'SReclaimable: 196724 kB' 'SUnreclaim: 486240 kB' 'KernelStack: 12816 kB' 'PageTables: 8084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10033112 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.647 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.647 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:44.648 17:24:21 -- setup/common.sh@33 -- # echo 0 00:04:44.648 17:24:21 -- setup/common.sh@33 -- # return 0 00:04:44.648 17:24:21 -- setup/hugepages.sh@97 -- # anon=0 00:04:44.648 17:24:21 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:44.648 17:24:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.648 17:24:21 -- setup/common.sh@18 -- # local node= 00:04:44.648 17:24:21 -- setup/common.sh@19 -- # local var val 00:04:44.648 17:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.648 17:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.648 17:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.648 17:24:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.648 17:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.648 17:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43331076 kB' 'MemAvailable: 47081944 kB' 'Buffers: 2708 kB' 'Cached: 12666236 kB' 'SwapCached: 0 kB' 'Active: 9366588 kB' 'Inactive: 3753080 kB' 'Active(anon): 8973340 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454024 kB' 'Mapped: 222524 kB' 'Shmem: 8522616 kB' 'KReclaimable: 196724 kB' 'Slab: 682964 kB' 'SReclaimable: 196724 kB' 'SUnreclaim: 486240 kB' 'KernelStack: 12832 kB' 'PageTables: 8092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10033124 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.648 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.648 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.649 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.649 17:24:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.650 17:24:21 -- setup/common.sh@33 -- # echo 0 00:04:44.650 17:24:21 -- setup/common.sh@33 -- # return 0 00:04:44.650 17:24:21 -- setup/hugepages.sh@99 -- # surp=0 00:04:44.650 17:24:21 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:44.650 17:24:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:44.650 17:24:21 -- setup/common.sh@18 -- # local node= 00:04:44.650 17:24:21 -- setup/common.sh@19 -- # local var val 00:04:44.650 17:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.650 17:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.650 17:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.650 17:24:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.650 17:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.650 17:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43331076 kB' 'MemAvailable: 47081944 kB' 'Buffers: 2708 kB' 'Cached: 12666240 kB' 'SwapCached: 0 kB' 'Active: 9366184 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972936 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453580 kB' 'Mapped: 222444 kB' 'Shmem: 8522620 kB' 'KReclaimable: 196724 kB' 'Slab: 682984 kB' 'SReclaimable: 196724 kB' 'SUnreclaim: 486260 kB' 'KernelStack: 12848 kB' 'PageTables: 8088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10033140 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.650 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.650 17:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:44.651 17:24:21 -- setup/common.sh@33 -- # echo 0 00:04:44.651 17:24:21 -- setup/common.sh@33 -- # return 0 00:04:44.651 17:24:21 -- setup/hugepages.sh@100 -- # resv=0 00:04:44.651 17:24:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:44.651 nr_hugepages=1024 00:04:44.651 17:24:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:44.651 resv_hugepages=0 00:04:44.651 17:24:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:44.651 surplus_hugepages=0 00:04:44.651 17:24:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:44.651 anon_hugepages=0 00:04:44.651 17:24:21 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:44.651 17:24:21 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:44.651 17:24:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:44.651 17:24:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:44.651 17:24:21 -- setup/common.sh@18 -- # local node= 00:04:44.651 17:24:21 -- setup/common.sh@19 -- # local var val 00:04:44.651 17:24:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.651 17:24:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.651 17:24:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:44.651 17:24:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:44.651 17:24:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.651 17:24:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43330824 kB' 'MemAvailable: 47081692 kB' 'Buffers: 2708 kB' 'Cached: 12666260 kB' 'SwapCached: 0 kB' 'Active: 9366488 kB' 'Inactive: 3753080 kB' 'Active(anon): 8973240 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453860 kB' 'Mapped: 222444 kB' 'Shmem: 8522640 kB' 'KReclaimable: 196724 kB' 'Slab: 682984 kB' 'SReclaimable: 196724 kB' 'SUnreclaim: 486260 kB' 'KernelStack: 12848 kB' 'PageTables: 8088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10033156 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.651 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.651 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.652 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.652 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:21 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:44.653 17:24:22 -- setup/common.sh@33 -- # echo 1024 00:04:44.653 17:24:22 -- setup/common.sh@33 -- # return 0 00:04:44.653 17:24:22 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:44.653 17:24:22 -- setup/hugepages.sh@112 -- # get_nodes 00:04:44.653 17:24:22 -- setup/hugepages.sh@27 -- # local node 00:04:44.653 17:24:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:44.653 17:24:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:44.653 17:24:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:44.653 17:24:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:44.653 17:24:22 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:44.653 17:24:22 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:44.653 17:24:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:44.653 17:24:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:44.653 17:24:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:44.653 17:24:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.653 17:24:22 -- setup/common.sh@18 -- # local node=0 00:04:44.653 17:24:22 -- setup/common.sh@19 -- # local var val 00:04:44.653 17:24:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.653 17:24:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.653 17:24:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:44.653 17:24:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:44.653 17:24:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.653 17:24:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26421080 kB' 'MemUsed: 6453844 kB' 'SwapCached: 0 kB' 'Active: 3965656 kB' 'Inactive: 109700 kB' 'Active(anon): 3816200 kB' 'Inactive(anon): 0 kB' 'Active(file): 149456 kB' 'Inactive(file): 109700 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3854912 kB' 'Mapped: 90120 kB' 'AnonPages: 223592 kB' 'Shmem: 3595756 kB' 'KernelStack: 8072 kB' 'PageTables: 4324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 125788 kB' 'Slab: 435496 kB' 'SReclaimable: 125788 kB' 'SUnreclaim: 309708 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.653 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.653 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@33 -- # echo 0 00:04:44.654 17:24:22 -- setup/common.sh@33 -- # return 0 00:04:44.654 17:24:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:44.654 17:24:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:44.654 17:24:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:44.654 17:24:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:44.654 17:24:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:44.654 17:24:22 -- setup/common.sh@18 -- # local node=1 00:04:44.654 17:24:22 -- setup/common.sh@19 -- # local var val 00:04:44.654 17:24:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:44.654 17:24:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:44.654 17:24:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:44.654 17:24:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:44.654 17:24:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:44.654 17:24:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660752 kB' 'MemFree: 16909492 kB' 'MemUsed: 10751260 kB' 'SwapCached: 0 kB' 'Active: 5400572 kB' 'Inactive: 3643380 kB' 'Active(anon): 5156780 kB' 'Inactive(anon): 0 kB' 'Active(file): 243792 kB' 'Inactive(file): 3643380 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8814072 kB' 'Mapped: 132324 kB' 'AnonPages: 230000 kB' 'Shmem: 4926900 kB' 'KernelStack: 4776 kB' 'PageTables: 3764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70936 kB' 'Slab: 247480 kB' 'SReclaimable: 70936 kB' 'SUnreclaim: 176544 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.654 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.654 17:24:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # continue 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:44.655 17:24:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:44.655 17:24:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:44.655 17:24:22 -- setup/common.sh@33 -- # echo 0 00:04:44.655 17:24:22 -- setup/common.sh@33 -- # return 0 00:04:44.655 17:24:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:44.655 17:24:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:44.655 17:24:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:44.655 17:24:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:44.655 17:24:22 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:44.655 node0=512 expecting 512 00:04:44.655 17:24:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:44.655 17:24:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:44.655 17:24:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:44.655 17:24:22 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:44.655 node1=512 expecting 512 00:04:44.655 17:24:22 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:44.655 00:04:44.655 real 0m1.499s 00:04:44.655 user 0m0.632s 00:04:44.655 sys 0m0.823s 00:04:44.655 17:24:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.655 17:24:22 -- common/autotest_common.sh@10 -- # set +x 00:04:44.655 ************************************ 00:04:44.655 END TEST even_2G_alloc 00:04:44.655 ************************************ 00:04:44.655 17:24:22 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:44.655 17:24:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.655 17:24:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.655 17:24:22 -- common/autotest_common.sh@10 -- # set +x 00:04:44.655 ************************************ 00:04:44.655 START TEST odd_alloc 00:04:44.655 ************************************ 00:04:44.655 17:24:22 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:44.655 17:24:22 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:44.655 17:24:22 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:44.655 17:24:22 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:44.655 17:24:22 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:44.655 17:24:22 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:44.655 17:24:22 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:44.655 17:24:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:44.655 17:24:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:44.655 17:24:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:44.655 17:24:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:44.655 17:24:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:44.655 17:24:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:44.655 17:24:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:44.655 17:24:22 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:44.655 17:24:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:44.655 17:24:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:44.655 17:24:22 -- setup/hugepages.sh@83 -- # : 513 00:04:44.655 17:24:22 -- setup/hugepages.sh@84 -- # : 1 00:04:44.655 17:24:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:44.655 17:24:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:44.655 17:24:22 -- setup/hugepages.sh@83 -- # : 0 00:04:44.655 17:24:22 -- setup/hugepages.sh@84 -- # : 0 00:04:44.655 17:24:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:44.655 17:24:22 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:44.655 17:24:22 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:44.655 17:24:22 -- setup/hugepages.sh@160 -- # setup output 00:04:44.655 17:24:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:44.655 17:24:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:46.035 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.035 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:46.035 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.035 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.035 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.035 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.035 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.035 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.035 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.035 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.035 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.035 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.035 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.035 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.035 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.035 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.035 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.035 17:24:23 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:46.035 17:24:23 -- setup/hugepages.sh@89 -- # local node 00:04:46.035 17:24:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:46.035 17:24:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:46.035 17:24:23 -- setup/hugepages.sh@92 -- # local surp 00:04:46.035 17:24:23 -- setup/hugepages.sh@93 -- # local resv 00:04:46.035 17:24:23 -- setup/hugepages.sh@94 -- # local anon 00:04:46.035 17:24:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:46.035 17:24:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:46.035 17:24:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:46.035 17:24:23 -- setup/common.sh@18 -- # local node= 00:04:46.035 17:24:23 -- setup/common.sh@19 -- # local var val 00:04:46.035 17:24:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.035 17:24:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.035 17:24:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.035 17:24:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.035 17:24:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.035 17:24:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.035 17:24:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43325520 kB' 'MemAvailable: 47076372 kB' 'Buffers: 2708 kB' 'Cached: 12666320 kB' 'SwapCached: 0 kB' 'Active: 9364528 kB' 'Inactive: 3753080 kB' 'Active(anon): 8971280 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451768 kB' 'Mapped: 221484 kB' 'Shmem: 8522700 kB' 'KReclaimable: 196692 kB' 'Slab: 682748 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 486056 kB' 'KernelStack: 12864 kB' 'PageTables: 8004 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10020776 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:46.035 17:24:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.035 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.035 17:24:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.035 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.035 17:24:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.035 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.035 17:24:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.035 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.035 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.036 17:24:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.036 17:24:23 -- setup/common.sh@33 -- # echo 0 00:04:46.036 17:24:23 -- setup/common.sh@33 -- # return 0 00:04:46.036 17:24:23 -- setup/hugepages.sh@97 -- # anon=0 00:04:46.036 17:24:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:46.036 17:24:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.036 17:24:23 -- setup/common.sh@18 -- # local node= 00:04:46.036 17:24:23 -- setup/common.sh@19 -- # local var val 00:04:46.036 17:24:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.036 17:24:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.036 17:24:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.036 17:24:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.036 17:24:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.036 17:24:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.036 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43325628 kB' 'MemAvailable: 47076480 kB' 'Buffers: 2708 kB' 'Cached: 12666324 kB' 'SwapCached: 0 kB' 'Active: 9364824 kB' 'Inactive: 3753080 kB' 'Active(anon): 8971576 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452120 kB' 'Mapped: 221612 kB' 'Shmem: 8522704 kB' 'KReclaimable: 196692 kB' 'Slab: 682848 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 486156 kB' 'KernelStack: 12720 kB' 'PageTables: 7568 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10020788 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.037 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.037 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.038 17:24:23 -- setup/common.sh@33 -- # echo 0 00:04:46.038 17:24:23 -- setup/common.sh@33 -- # return 0 00:04:46.038 17:24:23 -- setup/hugepages.sh@99 -- # surp=0 00:04:46.038 17:24:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:46.038 17:24:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:46.038 17:24:23 -- setup/common.sh@18 -- # local node= 00:04:46.038 17:24:23 -- setup/common.sh@19 -- # local var val 00:04:46.038 17:24:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.038 17:24:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.038 17:24:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.038 17:24:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.038 17:24:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.038 17:24:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43326024 kB' 'MemAvailable: 47076876 kB' 'Buffers: 2708 kB' 'Cached: 12666340 kB' 'SwapCached: 0 kB' 'Active: 9364680 kB' 'Inactive: 3753080 kB' 'Active(anon): 8971432 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451940 kB' 'Mapped: 221580 kB' 'Shmem: 8522720 kB' 'KReclaimable: 196692 kB' 'Slab: 682848 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 486156 kB' 'KernelStack: 12800 kB' 'PageTables: 7744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10021172 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.038 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.038 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.039 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.039 17:24:23 -- setup/common.sh@33 -- # echo 0 00:04:46.039 17:24:23 -- setup/common.sh@33 -- # return 0 00:04:46.039 17:24:23 -- setup/hugepages.sh@100 -- # resv=0 00:04:46.039 17:24:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:46.039 nr_hugepages=1025 00:04:46.039 17:24:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:46.039 resv_hugepages=0 00:04:46.039 17:24:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:46.039 surplus_hugepages=0 00:04:46.039 17:24:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:46.039 anon_hugepages=0 00:04:46.039 17:24:23 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:46.039 17:24:23 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:46.039 17:24:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:46.039 17:24:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:46.039 17:24:23 -- setup/common.sh@18 -- # local node= 00:04:46.039 17:24:23 -- setup/common.sh@19 -- # local var val 00:04:46.039 17:24:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.039 17:24:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.039 17:24:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.039 17:24:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.039 17:24:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.039 17:24:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.039 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43326024 kB' 'MemAvailable: 47076876 kB' 'Buffers: 2708 kB' 'Cached: 12666356 kB' 'SwapCached: 0 kB' 'Active: 9364588 kB' 'Inactive: 3753080 kB' 'Active(anon): 8971340 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451896 kB' 'Mapped: 221452 kB' 'Shmem: 8522736 kB' 'KReclaimable: 196692 kB' 'Slab: 682840 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 486148 kB' 'KernelStack: 12784 kB' 'PageTables: 7692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10021188 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.040 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.040 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.041 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.041 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.041 17:24:23 -- setup/common.sh@33 -- # echo 1025 00:04:46.041 17:24:23 -- setup/common.sh@33 -- # return 0 00:04:46.041 17:24:23 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:46.302 17:24:23 -- setup/hugepages.sh@112 -- # get_nodes 00:04:46.302 17:24:23 -- setup/hugepages.sh@27 -- # local node 00:04:46.302 17:24:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:46.302 17:24:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:46.302 17:24:23 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:46.302 17:24:23 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:46.302 17:24:23 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:46.302 17:24:23 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:46.302 17:24:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:46.302 17:24:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:46.302 17:24:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:46.302 17:24:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.302 17:24:23 -- setup/common.sh@18 -- # local node=0 00:04:46.302 17:24:23 -- setup/common.sh@19 -- # local var val 00:04:46.302 17:24:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.302 17:24:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.302 17:24:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:46.302 17:24:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:46.302 17:24:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.302 17:24:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26412068 kB' 'MemUsed: 6462856 kB' 'SwapCached: 0 kB' 'Active: 3965016 kB' 'Inactive: 109700 kB' 'Active(anon): 3815560 kB' 'Inactive(anon): 0 kB' 'Active(file): 149456 kB' 'Inactive(file): 109700 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3854960 kB' 'Mapped: 89260 kB' 'AnonPages: 222884 kB' 'Shmem: 3595804 kB' 'KernelStack: 8040 kB' 'PageTables: 3992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 125756 kB' 'Slab: 435568 kB' 'SReclaimable: 125756 kB' 'SUnreclaim: 309812 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.302 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.302 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@33 -- # echo 0 00:04:46.303 17:24:23 -- setup/common.sh@33 -- # return 0 00:04:46.303 17:24:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:46.303 17:24:23 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:46.303 17:24:23 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:46.303 17:24:23 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:46.303 17:24:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.303 17:24:23 -- setup/common.sh@18 -- # local node=1 00:04:46.303 17:24:23 -- setup/common.sh@19 -- # local var val 00:04:46.303 17:24:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.303 17:24:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.303 17:24:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:46.303 17:24:23 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:46.303 17:24:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.303 17:24:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660752 kB' 'MemFree: 16922020 kB' 'MemUsed: 10738732 kB' 'SwapCached: 0 kB' 'Active: 5399548 kB' 'Inactive: 3643380 kB' 'Active(anon): 5155756 kB' 'Inactive(anon): 0 kB' 'Active(file): 243792 kB' 'Inactive(file): 3643380 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8814112 kB' 'Mapped: 132192 kB' 'AnonPages: 228972 kB' 'Shmem: 4926940 kB' 'KernelStack: 4712 kB' 'PageTables: 3656 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70936 kB' 'Slab: 247272 kB' 'SReclaimable: 70936 kB' 'SUnreclaim: 176336 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.303 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.303 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # continue 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.304 17:24:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.304 17:24:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.304 17:24:23 -- setup/common.sh@33 -- # echo 0 00:04:46.304 17:24:23 -- setup/common.sh@33 -- # return 0 00:04:46.304 17:24:23 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:46.304 17:24:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:46.304 17:24:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:46.304 17:24:23 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:46.304 node0=512 expecting 513 00:04:46.304 17:24:23 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:46.304 17:24:23 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:46.304 17:24:23 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:46.304 17:24:23 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:46.304 node1=513 expecting 512 00:04:46.304 17:24:23 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:46.304 00:04:46.304 real 0m1.490s 00:04:46.304 user 0m0.598s 00:04:46.304 sys 0m0.853s 00:04:46.304 17:24:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.304 17:24:23 -- common/autotest_common.sh@10 -- # set +x 00:04:46.304 ************************************ 00:04:46.304 END TEST odd_alloc 00:04:46.304 ************************************ 00:04:46.304 17:24:23 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:46.304 17:24:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.304 17:24:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.304 17:24:23 -- common/autotest_common.sh@10 -- # set +x 00:04:46.304 ************************************ 00:04:46.304 START TEST custom_alloc 00:04:46.304 ************************************ 00:04:46.304 17:24:23 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:46.304 17:24:23 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:46.304 17:24:23 -- setup/hugepages.sh@169 -- # local node 00:04:46.304 17:24:23 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:46.304 17:24:23 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:46.304 17:24:23 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:46.304 17:24:23 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:46.304 17:24:23 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:46.304 17:24:23 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:46.304 17:24:23 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:46.304 17:24:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:46.304 17:24:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:46.304 17:24:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:46.304 17:24:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:46.304 17:24:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:46.304 17:24:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:46.304 17:24:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:46.304 17:24:23 -- setup/hugepages.sh@83 -- # : 256 00:04:46.304 17:24:23 -- setup/hugepages.sh@84 -- # : 1 00:04:46.304 17:24:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:46.304 17:24:23 -- setup/hugepages.sh@83 -- # : 0 00:04:46.304 17:24:23 -- setup/hugepages.sh@84 -- # : 0 00:04:46.304 17:24:23 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:46.304 17:24:23 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:46.304 17:24:23 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:46.304 17:24:23 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:46.304 17:24:23 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:46.304 17:24:23 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:46.305 17:24:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:46.305 17:24:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:46.305 17:24:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:46.305 17:24:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:46.305 17:24:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:46.305 17:24:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:46.305 17:24:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:46.305 17:24:23 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:46.305 17:24:23 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:46.305 17:24:23 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:46.305 17:24:23 -- setup/hugepages.sh@78 -- # return 0 00:04:46.305 17:24:23 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:46.305 17:24:23 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:46.305 17:24:23 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:46.305 17:24:23 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:46.305 17:24:23 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:46.305 17:24:23 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:46.305 17:24:23 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:46.305 17:24:23 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:46.305 17:24:23 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:46.305 17:24:23 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:46.305 17:24:23 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:46.305 17:24:23 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:46.305 17:24:23 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:46.305 17:24:23 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:46.305 17:24:23 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:46.305 17:24:23 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:46.305 17:24:23 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:46.305 17:24:23 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:46.305 17:24:23 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:46.305 17:24:23 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:46.305 17:24:23 -- setup/hugepages.sh@78 -- # return 0 00:04:46.305 17:24:23 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:46.305 17:24:23 -- setup/hugepages.sh@187 -- # setup output 00:04:46.305 17:24:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:46.305 17:24:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:47.253 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.253 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:47.253 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.253 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.253 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.253 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.253 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.253 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.253 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.253 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.253 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.253 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.253 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.253 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.253 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.253 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.253 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.515 17:24:24 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:47.515 17:24:24 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:47.515 17:24:24 -- setup/hugepages.sh@89 -- # local node 00:04:47.515 17:24:24 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:47.515 17:24:24 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:47.515 17:24:24 -- setup/hugepages.sh@92 -- # local surp 00:04:47.515 17:24:24 -- setup/hugepages.sh@93 -- # local resv 00:04:47.515 17:24:24 -- setup/hugepages.sh@94 -- # local anon 00:04:47.515 17:24:24 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:47.515 17:24:24 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:47.515 17:24:24 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:47.516 17:24:24 -- setup/common.sh@18 -- # local node= 00:04:47.516 17:24:24 -- setup/common.sh@19 -- # local var val 00:04:47.516 17:24:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.516 17:24:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.516 17:24:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.516 17:24:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.516 17:24:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.516 17:24:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 42280040 kB' 'MemAvailable: 46030892 kB' 'Buffers: 2708 kB' 'Cached: 12666424 kB' 'SwapCached: 0 kB' 'Active: 9365660 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972412 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452380 kB' 'Mapped: 221500 kB' 'Shmem: 8522804 kB' 'KReclaimable: 196692 kB' 'Slab: 682496 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485804 kB' 'KernelStack: 12816 kB' 'PageTables: 7800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10021376 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.516 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.516 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:47.517 17:24:24 -- setup/common.sh@33 -- # echo 0 00:04:47.517 17:24:24 -- setup/common.sh@33 -- # return 0 00:04:47.517 17:24:24 -- setup/hugepages.sh@97 -- # anon=0 00:04:47.517 17:24:24 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:47.517 17:24:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.517 17:24:24 -- setup/common.sh@18 -- # local node= 00:04:47.517 17:24:24 -- setup/common.sh@19 -- # local var val 00:04:47.517 17:24:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.517 17:24:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.517 17:24:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.517 17:24:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.517 17:24:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.517 17:24:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 42284772 kB' 'MemAvailable: 46035624 kB' 'Buffers: 2708 kB' 'Cached: 12666428 kB' 'SwapCached: 0 kB' 'Active: 9365564 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972316 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452720 kB' 'Mapped: 221500 kB' 'Shmem: 8522808 kB' 'KReclaimable: 196692 kB' 'Slab: 682548 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485856 kB' 'KernelStack: 12848 kB' 'PageTables: 7868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10021388 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.517 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.517 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.518 17:24:24 -- setup/common.sh@33 -- # echo 0 00:04:47.518 17:24:24 -- setup/common.sh@33 -- # return 0 00:04:47.518 17:24:24 -- setup/hugepages.sh@99 -- # surp=0 00:04:47.518 17:24:24 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:47.518 17:24:24 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:47.518 17:24:24 -- setup/common.sh@18 -- # local node= 00:04:47.518 17:24:24 -- setup/common.sh@19 -- # local var val 00:04:47.518 17:24:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.518 17:24:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.518 17:24:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.518 17:24:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.518 17:24:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.518 17:24:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 42285776 kB' 'MemAvailable: 46036628 kB' 'Buffers: 2708 kB' 'Cached: 12666440 kB' 'SwapCached: 0 kB' 'Active: 9364912 kB' 'Inactive: 3753080 kB' 'Active(anon): 8971664 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452012 kB' 'Mapped: 221456 kB' 'Shmem: 8522820 kB' 'KReclaimable: 196692 kB' 'Slab: 682548 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485856 kB' 'KernelStack: 12832 kB' 'PageTables: 7812 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10021404 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.518 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.518 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.519 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.519 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:47.520 17:24:24 -- setup/common.sh@33 -- # echo 0 00:04:47.520 17:24:24 -- setup/common.sh@33 -- # return 0 00:04:47.520 17:24:24 -- setup/hugepages.sh@100 -- # resv=0 00:04:47.520 17:24:24 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:47.520 nr_hugepages=1536 00:04:47.520 17:24:24 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:47.520 resv_hugepages=0 00:04:47.520 17:24:24 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:47.520 surplus_hugepages=0 00:04:47.520 17:24:24 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:47.520 anon_hugepages=0 00:04:47.520 17:24:24 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:47.520 17:24:24 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:47.520 17:24:24 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:47.520 17:24:24 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:47.520 17:24:24 -- setup/common.sh@18 -- # local node= 00:04:47.520 17:24:24 -- setup/common.sh@19 -- # local var val 00:04:47.520 17:24:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.520 17:24:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.520 17:24:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:47.520 17:24:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:47.520 17:24:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.520 17:24:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 42285780 kB' 'MemAvailable: 46036632 kB' 'Buffers: 2708 kB' 'Cached: 12666452 kB' 'SwapCached: 0 kB' 'Active: 9364808 kB' 'Inactive: 3753080 kB' 'Active(anon): 8971560 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451940 kB' 'Mapped: 221456 kB' 'Shmem: 8522832 kB' 'KReclaimable: 196692 kB' 'Slab: 682548 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485856 kB' 'KernelStack: 12784 kB' 'PageTables: 7648 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10021420 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.520 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.520 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.521 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.521 17:24:24 -- setup/common.sh@33 -- # echo 1536 00:04:47.521 17:24:24 -- setup/common.sh@33 -- # return 0 00:04:47.521 17:24:24 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:47.521 17:24:24 -- setup/hugepages.sh@112 -- # get_nodes 00:04:47.521 17:24:24 -- setup/hugepages.sh@27 -- # local node 00:04:47.521 17:24:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.521 17:24:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:47.521 17:24:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.521 17:24:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:47.521 17:24:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:47.521 17:24:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:47.521 17:24:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.521 17:24:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.521 17:24:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:47.521 17:24:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.521 17:24:24 -- setup/common.sh@18 -- # local node=0 00:04:47.521 17:24:24 -- setup/common.sh@19 -- # local var val 00:04:47.521 17:24:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.521 17:24:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.521 17:24:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:47.521 17:24:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:47.521 17:24:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.521 17:24:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.521 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 26409440 kB' 'MemUsed: 6465484 kB' 'SwapCached: 0 kB' 'Active: 3964948 kB' 'Inactive: 109700 kB' 'Active(anon): 3815492 kB' 'Inactive(anon): 0 kB' 'Active(file): 149456 kB' 'Inactive(file): 109700 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3855060 kB' 'Mapped: 89260 kB' 'AnonPages: 222740 kB' 'Shmem: 3595904 kB' 'KernelStack: 8072 kB' 'PageTables: 4088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 125756 kB' 'Slab: 435340 kB' 'SReclaimable: 125756 kB' 'SUnreclaim: 309584 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.522 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.522 17:24:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.522 17:24:24 -- setup/common.sh@33 -- # echo 0 00:04:47.522 17:24:24 -- setup/common.sh@33 -- # return 0 00:04:47.522 17:24:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.522 17:24:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.522 17:24:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.522 17:24:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:47.522 17:24:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.522 17:24:24 -- setup/common.sh@18 -- # local node=1 00:04:47.522 17:24:24 -- setup/common.sh@19 -- # local var val 00:04:47.522 17:24:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.522 17:24:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.522 17:24:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:47.522 17:24:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:47.522 17:24:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.523 17:24:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660752 kB' 'MemFree: 15876724 kB' 'MemUsed: 11784028 kB' 'SwapCached: 0 kB' 'Active: 5399992 kB' 'Inactive: 3643380 kB' 'Active(anon): 5156200 kB' 'Inactive(anon): 0 kB' 'Active(file): 243792 kB' 'Inactive(file): 3643380 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8814116 kB' 'Mapped: 132196 kB' 'AnonPages: 229324 kB' 'Shmem: 4926944 kB' 'KernelStack: 4760 kB' 'PageTables: 3704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 70936 kB' 'Slab: 247208 kB' 'SReclaimable: 70936 kB' 'SUnreclaim: 176272 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.523 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.523 17:24:25 -- setup/common.sh@32 -- # continue 00:04:47.782 17:24:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.782 17:24:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.782 17:24:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.782 17:24:25 -- setup/common.sh@33 -- # echo 0 00:04:47.782 17:24:25 -- setup/common.sh@33 -- # return 0 00:04:47.782 17:24:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.782 17:24:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.782 17:24:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.782 17:24:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.782 17:24:25 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:47.782 node0=512 expecting 512 00:04:47.782 17:24:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.782 17:24:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.782 17:24:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.782 17:24:25 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:47.782 node1=1024 expecting 1024 00:04:47.782 17:24:25 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:47.782 00:04:47.782 real 0m1.421s 00:04:47.782 user 0m0.570s 00:04:47.782 sys 0m0.815s 00:04:47.782 17:24:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.782 17:24:25 -- common/autotest_common.sh@10 -- # set +x 00:04:47.782 ************************************ 00:04:47.782 END TEST custom_alloc 00:04:47.782 ************************************ 00:04:47.782 17:24:25 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:47.782 17:24:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.782 17:24:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.782 17:24:25 -- common/autotest_common.sh@10 -- # set +x 00:04:47.782 ************************************ 00:04:47.782 START TEST no_shrink_alloc 00:04:47.782 ************************************ 00:04:47.782 17:24:25 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:47.782 17:24:25 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:47.782 17:24:25 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:47.782 17:24:25 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:47.782 17:24:25 -- setup/hugepages.sh@51 -- # shift 00:04:47.782 17:24:25 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:47.782 17:24:25 -- setup/hugepages.sh@52 -- # local node_ids 00:04:47.782 17:24:25 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:47.782 17:24:25 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:47.782 17:24:25 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:47.782 17:24:25 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:47.782 17:24:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:47.782 17:24:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:47.782 17:24:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:47.782 17:24:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:47.782 17:24:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:47.782 17:24:25 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:47.782 17:24:25 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:47.782 17:24:25 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:47.782 17:24:25 -- setup/hugepages.sh@73 -- # return 0 00:04:47.782 17:24:25 -- setup/hugepages.sh@198 -- # setup output 00:04:47.782 17:24:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.782 17:24:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:48.718 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.718 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:48.718 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.718 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.718 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.718 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.718 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.718 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.718 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.718 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.718 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.718 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.718 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.718 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.718 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.718 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.718 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.980 17:24:26 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:48.980 17:24:26 -- setup/hugepages.sh@89 -- # local node 00:04:48.980 17:24:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:48.980 17:24:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:48.980 17:24:26 -- setup/hugepages.sh@92 -- # local surp 00:04:48.980 17:24:26 -- setup/hugepages.sh@93 -- # local resv 00:04:48.980 17:24:26 -- setup/hugepages.sh@94 -- # local anon 00:04:48.980 17:24:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:48.980 17:24:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:48.980 17:24:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:48.980 17:24:26 -- setup/common.sh@18 -- # local node= 00:04:48.980 17:24:26 -- setup/common.sh@19 -- # local var val 00:04:48.980 17:24:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.980 17:24:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.980 17:24:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.980 17:24:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.980 17:24:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.980 17:24:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.980 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.980 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.980 17:24:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43320848 kB' 'MemAvailable: 47071700 kB' 'Buffers: 2708 kB' 'Cached: 12666508 kB' 'SwapCached: 0 kB' 'Active: 9370796 kB' 'Inactive: 3753080 kB' 'Active(anon): 8977548 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457880 kB' 'Mapped: 222268 kB' 'Shmem: 8522888 kB' 'KReclaimable: 196692 kB' 'Slab: 682152 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485460 kB' 'KernelStack: 12832 kB' 'PageTables: 7776 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10027588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198428 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:48.980 17:24:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.980 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.981 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.981 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.982 17:24:26 -- setup/common.sh@33 -- # echo 0 00:04:48.982 17:24:26 -- setup/common.sh@33 -- # return 0 00:04:48.982 17:24:26 -- setup/hugepages.sh@97 -- # anon=0 00:04:48.982 17:24:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:48.982 17:24:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.982 17:24:26 -- setup/common.sh@18 -- # local node= 00:04:48.982 17:24:26 -- setup/common.sh@19 -- # local var val 00:04:48.982 17:24:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.982 17:24:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.982 17:24:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.982 17:24:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.982 17:24:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.982 17:24:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43332816 kB' 'MemAvailable: 47083668 kB' 'Buffers: 2708 kB' 'Cached: 12666516 kB' 'SwapCached: 0 kB' 'Active: 9366180 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972932 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453280 kB' 'Mapped: 222004 kB' 'Shmem: 8522896 kB' 'KReclaimable: 196692 kB' 'Slab: 682256 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485564 kB' 'KernelStack: 12864 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10021480 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.982 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.982 17:24:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.983 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.983 17:24:26 -- setup/common.sh@33 -- # echo 0 00:04:48.983 17:24:26 -- setup/common.sh@33 -- # return 0 00:04:48.983 17:24:26 -- setup/hugepages.sh@99 -- # surp=0 00:04:48.983 17:24:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:48.983 17:24:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:48.983 17:24:26 -- setup/common.sh@18 -- # local node= 00:04:48.983 17:24:26 -- setup/common.sh@19 -- # local var val 00:04:48.983 17:24:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.983 17:24:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.983 17:24:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.983 17:24:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.983 17:24:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.983 17:24:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.983 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43332060 kB' 'MemAvailable: 47082912 kB' 'Buffers: 2708 kB' 'Cached: 12666528 kB' 'SwapCached: 0 kB' 'Active: 9368444 kB' 'Inactive: 3753080 kB' 'Active(anon): 8975196 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 455940 kB' 'Mapped: 221980 kB' 'Shmem: 8522908 kB' 'KReclaimable: 196692 kB' 'Slab: 682256 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485564 kB' 'KernelStack: 12832 kB' 'PageTables: 7704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10025488 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.984 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.984 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.985 17:24:26 -- setup/common.sh@33 -- # echo 0 00:04:48.985 17:24:26 -- setup/common.sh@33 -- # return 0 00:04:48.985 17:24:26 -- setup/hugepages.sh@100 -- # resv=0 00:04:48.985 17:24:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:48.985 nr_hugepages=1024 00:04:48.985 17:24:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:48.985 resv_hugepages=0 00:04:48.985 17:24:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:48.985 surplus_hugepages=0 00:04:48.985 17:24:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:48.985 anon_hugepages=0 00:04:48.985 17:24:26 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.985 17:24:26 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:48.985 17:24:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:48.985 17:24:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:48.985 17:24:26 -- setup/common.sh@18 -- # local node= 00:04:48.985 17:24:26 -- setup/common.sh@19 -- # local var val 00:04:48.985 17:24:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.985 17:24:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.985 17:24:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.985 17:24:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.985 17:24:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.985 17:24:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43328296 kB' 'MemAvailable: 47079148 kB' 'Buffers: 2708 kB' 'Cached: 12666544 kB' 'SwapCached: 0 kB' 'Active: 9370676 kB' 'Inactive: 3753080 kB' 'Active(anon): 8977428 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 457688 kB' 'Mapped: 222340 kB' 'Shmem: 8522924 kB' 'KReclaimable: 196692 kB' 'Slab: 682236 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485544 kB' 'KernelStack: 12816 kB' 'PageTables: 7672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10027628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198396 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.985 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.985 17:24:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.986 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.986 17:24:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.987 17:24:26 -- setup/common.sh@33 -- # echo 1024 00:04:48.987 17:24:26 -- setup/common.sh@33 -- # return 0 00:04:48.987 17:24:26 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.987 17:24:26 -- setup/hugepages.sh@112 -- # get_nodes 00:04:48.987 17:24:26 -- setup/hugepages.sh@27 -- # local node 00:04:48.987 17:24:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.987 17:24:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:48.987 17:24:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.987 17:24:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:48.987 17:24:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:48.987 17:24:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:48.987 17:24:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.987 17:24:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.987 17:24:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:48.987 17:24:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.987 17:24:26 -- setup/common.sh@18 -- # local node=0 00:04:48.987 17:24:26 -- setup/common.sh@19 -- # local var val 00:04:48.987 17:24:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.987 17:24:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.987 17:24:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:48.987 17:24:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:48.987 17:24:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.987 17:24:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 25366556 kB' 'MemUsed: 7508368 kB' 'SwapCached: 0 kB' 'Active: 3964804 kB' 'Inactive: 109700 kB' 'Active(anon): 3815348 kB' 'Inactive(anon): 0 kB' 'Active(file): 149456 kB' 'Inactive(file): 109700 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3855144 kB' 'Mapped: 89260 kB' 'AnonPages: 222464 kB' 'Shmem: 3595988 kB' 'KernelStack: 8008 kB' 'PageTables: 3844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 125756 kB' 'Slab: 435092 kB' 'SReclaimable: 125756 kB' 'SUnreclaim: 309336 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.987 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.987 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # continue 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.988 17:24:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.988 17:24:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.988 17:24:26 -- setup/common.sh@33 -- # echo 0 00:04:48.988 17:24:26 -- setup/common.sh@33 -- # return 0 00:04:48.988 17:24:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.988 17:24:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.988 17:24:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.988 17:24:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.988 17:24:26 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:48.988 node0=1024 expecting 1024 00:04:48.988 17:24:26 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:48.988 17:24:26 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:48.988 17:24:26 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:48.988 17:24:26 -- setup/hugepages.sh@202 -- # setup output 00:04:48.988 17:24:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.988 17:24:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:50.365 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.365 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:50.365 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.365 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.365 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.365 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.365 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.365 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.365 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.365 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.365 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.365 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.365 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.365 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.365 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.365 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.365 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.365 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:50.365 17:24:27 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:50.365 17:24:27 -- setup/hugepages.sh@89 -- # local node 00:04:50.365 17:24:27 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:50.365 17:24:27 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:50.365 17:24:27 -- setup/hugepages.sh@92 -- # local surp 00:04:50.365 17:24:27 -- setup/hugepages.sh@93 -- # local resv 00:04:50.365 17:24:27 -- setup/hugepages.sh@94 -- # local anon 00:04:50.365 17:24:27 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:50.365 17:24:27 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:50.365 17:24:27 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:50.365 17:24:27 -- setup/common.sh@18 -- # local node= 00:04:50.365 17:24:27 -- setup/common.sh@19 -- # local var val 00:04:50.365 17:24:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.365 17:24:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.365 17:24:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.365 17:24:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.365 17:24:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.365 17:24:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43311196 kB' 'MemAvailable: 47062048 kB' 'Buffers: 2708 kB' 'Cached: 12666588 kB' 'SwapCached: 0 kB' 'Active: 9365104 kB' 'Inactive: 3753080 kB' 'Active(anon): 8971856 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452212 kB' 'Mapped: 221484 kB' 'Shmem: 8522968 kB' 'KReclaimable: 196692 kB' 'Slab: 682216 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485524 kB' 'KernelStack: 12864 kB' 'PageTables: 7808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10021676 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.365 17:24:27 -- setup/common.sh@33 -- # echo 0 00:04:50.365 17:24:27 -- setup/common.sh@33 -- # return 0 00:04:50.365 17:24:27 -- setup/hugepages.sh@97 -- # anon=0 00:04:50.365 17:24:27 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:50.365 17:24:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.365 17:24:27 -- setup/common.sh@18 -- # local node= 00:04:50.365 17:24:27 -- setup/common.sh@19 -- # local var val 00:04:50.365 17:24:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.365 17:24:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.365 17:24:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.365 17:24:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.365 17:24:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.365 17:24:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43315892 kB' 'MemAvailable: 47066744 kB' 'Buffers: 2708 kB' 'Cached: 12666592 kB' 'SwapCached: 0 kB' 'Active: 9365512 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972264 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452620 kB' 'Mapped: 221488 kB' 'Shmem: 8522972 kB' 'KReclaimable: 196692 kB' 'Slab: 682192 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485500 kB' 'KernelStack: 12848 kB' 'PageTables: 7744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10021688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.365 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.365 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.366 17:24:27 -- setup/common.sh@33 -- # echo 0 00:04:50.366 17:24:27 -- setup/common.sh@33 -- # return 0 00:04:50.366 17:24:27 -- setup/hugepages.sh@99 -- # surp=0 00:04:50.366 17:24:27 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:50.366 17:24:27 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:50.366 17:24:27 -- setup/common.sh@18 -- # local node= 00:04:50.366 17:24:27 -- setup/common.sh@19 -- # local var val 00:04:50.366 17:24:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.366 17:24:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.366 17:24:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.366 17:24:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.366 17:24:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.366 17:24:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43316516 kB' 'MemAvailable: 47067368 kB' 'Buffers: 2708 kB' 'Cached: 12666596 kB' 'SwapCached: 0 kB' 'Active: 9365520 kB' 'Inactive: 3753080 kB' 'Active(anon): 8972272 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452656 kB' 'Mapped: 221488 kB' 'Shmem: 8522976 kB' 'KReclaimable: 196692 kB' 'Slab: 682192 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485500 kB' 'KernelStack: 12832 kB' 'PageTables: 7696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10021700 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.366 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.366 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.367 17:24:27 -- setup/common.sh@33 -- # echo 0 00:04:50.367 17:24:27 -- setup/common.sh@33 -- # return 0 00:04:50.367 17:24:27 -- setup/hugepages.sh@100 -- # resv=0 00:04:50.367 17:24:27 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:50.367 nr_hugepages=1024 00:04:50.367 17:24:27 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:50.367 resv_hugepages=0 00:04:50.367 17:24:27 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:50.367 surplus_hugepages=0 00:04:50.367 17:24:27 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:50.367 anon_hugepages=0 00:04:50.367 17:24:27 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:50.367 17:24:27 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:50.367 17:24:27 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:50.367 17:24:27 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:50.367 17:24:27 -- setup/common.sh@18 -- # local node= 00:04:50.367 17:24:27 -- setup/common.sh@19 -- # local var val 00:04:50.367 17:24:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.367 17:24:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.367 17:24:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.367 17:24:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.367 17:24:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.367 17:24:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535676 kB' 'MemFree: 43316532 kB' 'MemAvailable: 47067384 kB' 'Buffers: 2708 kB' 'Cached: 12666616 kB' 'SwapCached: 0 kB' 'Active: 9365148 kB' 'Inactive: 3753080 kB' 'Active(anon): 8971900 kB' 'Inactive(anon): 0 kB' 'Active(file): 393248 kB' 'Inactive(file): 3753080 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 452164 kB' 'Mapped: 221468 kB' 'Shmem: 8522996 kB' 'KReclaimable: 196692 kB' 'Slab: 682224 kB' 'SReclaimable: 196692 kB' 'SUnreclaim: 485532 kB' 'KernelStack: 12816 kB' 'PageTables: 7656 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10021716 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1689180 kB' 'DirectMap2M: 11862016 kB' 'DirectMap1G: 56623104 kB' 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.367 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.367 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.368 17:24:27 -- setup/common.sh@33 -- # echo 1024 00:04:50.368 17:24:27 -- setup/common.sh@33 -- # return 0 00:04:50.368 17:24:27 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:50.368 17:24:27 -- setup/hugepages.sh@112 -- # get_nodes 00:04:50.368 17:24:27 -- setup/hugepages.sh@27 -- # local node 00:04:50.368 17:24:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.368 17:24:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:50.368 17:24:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.368 17:24:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:50.368 17:24:27 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:50.368 17:24:27 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:50.368 17:24:27 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.368 17:24:27 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.368 17:24:27 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:50.368 17:24:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.368 17:24:27 -- setup/common.sh@18 -- # local node=0 00:04:50.368 17:24:27 -- setup/common.sh@19 -- # local var val 00:04:50.368 17:24:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.368 17:24:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.368 17:24:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:50.368 17:24:27 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:50.368 17:24:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.368 17:24:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 25370420 kB' 'MemUsed: 7504504 kB' 'SwapCached: 0 kB' 'Active: 3965072 kB' 'Inactive: 109700 kB' 'Active(anon): 3815616 kB' 'Inactive(anon): 0 kB' 'Active(file): 149456 kB' 'Inactive(file): 109700 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3855216 kB' 'Mapped: 89260 kB' 'AnonPages: 222680 kB' 'Shmem: 3596060 kB' 'KernelStack: 8040 kB' 'PageTables: 3896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 125756 kB' 'Slab: 434992 kB' 'SReclaimable: 125756 kB' 'SUnreclaim: 309236 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # continue 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.368 17:24:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.368 17:24:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.368 17:24:27 -- setup/common.sh@33 -- # echo 0 00:04:50.368 17:24:27 -- setup/common.sh@33 -- # return 0 00:04:50.368 17:24:27 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.368 17:24:27 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.368 17:24:27 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.368 17:24:27 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.368 17:24:27 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:50.368 node0=1024 expecting 1024 00:04:50.368 17:24:27 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:50.368 00:04:50.368 real 0m2.752s 00:04:50.368 user 0m1.151s 00:04:50.368 sys 0m1.521s 00:04:50.368 17:24:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.368 17:24:27 -- common/autotest_common.sh@10 -- # set +x 00:04:50.368 ************************************ 00:04:50.368 END TEST no_shrink_alloc 00:04:50.368 ************************************ 00:04:50.368 17:24:27 -- setup/hugepages.sh@217 -- # clear_hp 00:04:50.368 17:24:27 -- setup/hugepages.sh@37 -- # local node hp 00:04:50.368 17:24:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:50.368 17:24:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:50.368 17:24:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:50.368 17:24:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:50.368 17:24:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:50.368 17:24:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:50.368 17:24:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:50.368 17:24:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:50.368 17:24:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:50.368 17:24:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:50.368 17:24:27 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:50.368 17:24:27 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:50.368 00:04:50.368 real 0m11.593s 00:04:50.368 user 0m4.418s 00:04:50.368 sys 0m6.065s 00:04:50.368 17:24:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.368 17:24:27 -- common/autotest_common.sh@10 -- # set +x 00:04:50.368 ************************************ 00:04:50.368 END TEST hugepages 00:04:50.368 ************************************ 00:04:50.368 17:24:27 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:50.368 17:24:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.368 17:24:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.368 17:24:27 -- common/autotest_common.sh@10 -- # set +x 00:04:50.368 ************************************ 00:04:50.368 START TEST driver 00:04:50.368 ************************************ 00:04:50.368 17:24:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:50.627 * Looking for test storage... 00:04:50.627 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:50.627 17:24:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:50.627 17:24:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:50.627 17:24:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:50.627 17:24:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:50.627 17:24:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:50.627 17:24:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:50.627 17:24:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:50.627 17:24:27 -- scripts/common.sh@335 -- # IFS=.-: 00:04:50.627 17:24:27 -- scripts/common.sh@335 -- # read -ra ver1 00:04:50.627 17:24:27 -- scripts/common.sh@336 -- # IFS=.-: 00:04:50.627 17:24:27 -- scripts/common.sh@336 -- # read -ra ver2 00:04:50.627 17:24:27 -- scripts/common.sh@337 -- # local 'op=<' 00:04:50.627 17:24:27 -- scripts/common.sh@339 -- # ver1_l=2 00:04:50.627 17:24:27 -- scripts/common.sh@340 -- # ver2_l=1 00:04:50.627 17:24:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:50.627 17:24:27 -- scripts/common.sh@343 -- # case "$op" in 00:04:50.627 17:24:27 -- scripts/common.sh@344 -- # : 1 00:04:50.627 17:24:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:50.627 17:24:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:50.627 17:24:27 -- scripts/common.sh@364 -- # decimal 1 00:04:50.627 17:24:27 -- scripts/common.sh@352 -- # local d=1 00:04:50.627 17:24:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:50.627 17:24:27 -- scripts/common.sh@354 -- # echo 1 00:04:50.627 17:24:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:50.627 17:24:27 -- scripts/common.sh@365 -- # decimal 2 00:04:50.627 17:24:27 -- scripts/common.sh@352 -- # local d=2 00:04:50.627 17:24:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:50.627 17:24:27 -- scripts/common.sh@354 -- # echo 2 00:04:50.627 17:24:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:50.627 17:24:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:50.627 17:24:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:50.627 17:24:27 -- scripts/common.sh@367 -- # return 0 00:04:50.628 17:24:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:50.628 17:24:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:50.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.628 --rc genhtml_branch_coverage=1 00:04:50.628 --rc genhtml_function_coverage=1 00:04:50.628 --rc genhtml_legend=1 00:04:50.628 --rc geninfo_all_blocks=1 00:04:50.628 --rc geninfo_unexecuted_blocks=1 00:04:50.628 00:04:50.628 ' 00:04:50.628 17:24:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:50.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.628 --rc genhtml_branch_coverage=1 00:04:50.628 --rc genhtml_function_coverage=1 00:04:50.628 --rc genhtml_legend=1 00:04:50.628 --rc geninfo_all_blocks=1 00:04:50.628 --rc geninfo_unexecuted_blocks=1 00:04:50.628 00:04:50.628 ' 00:04:50.628 17:24:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:50.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.628 --rc genhtml_branch_coverage=1 00:04:50.628 --rc genhtml_function_coverage=1 00:04:50.628 --rc genhtml_legend=1 00:04:50.628 --rc geninfo_all_blocks=1 00:04:50.628 --rc geninfo_unexecuted_blocks=1 00:04:50.628 00:04:50.628 ' 00:04:50.628 17:24:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:50.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:50.628 --rc genhtml_branch_coverage=1 00:04:50.628 --rc genhtml_function_coverage=1 00:04:50.628 --rc genhtml_legend=1 00:04:50.628 --rc geninfo_all_blocks=1 00:04:50.628 --rc geninfo_unexecuted_blocks=1 00:04:50.628 00:04:50.628 ' 00:04:50.628 17:24:27 -- setup/driver.sh@68 -- # setup reset 00:04:50.628 17:24:27 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:50.628 17:24:27 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:53.157 17:24:30 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:53.157 17:24:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:53.157 17:24:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:53.157 17:24:30 -- common/autotest_common.sh@10 -- # set +x 00:04:53.157 ************************************ 00:04:53.157 START TEST guess_driver 00:04:53.157 ************************************ 00:04:53.157 17:24:30 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:53.157 17:24:30 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:53.157 17:24:30 -- setup/driver.sh@47 -- # local fail=0 00:04:53.157 17:24:30 -- setup/driver.sh@49 -- # pick_driver 00:04:53.157 17:24:30 -- setup/driver.sh@36 -- # vfio 00:04:53.157 17:24:30 -- setup/driver.sh@21 -- # local iommu_grups 00:04:53.157 17:24:30 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:53.157 17:24:30 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:53.157 17:24:30 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:53.157 17:24:30 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:53.157 17:24:30 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:53.157 17:24:30 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:53.157 17:24:30 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:53.157 17:24:30 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:53.157 17:24:30 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:53.157 17:24:30 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:53.157 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:53.157 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:53.157 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:53.157 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:53.157 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:53.157 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:53.157 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:53.157 17:24:30 -- setup/driver.sh@30 -- # return 0 00:04:53.157 17:24:30 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:53.157 17:24:30 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:53.157 17:24:30 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:53.157 17:24:30 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:53.157 Looking for driver=vfio-pci 00:04:53.157 17:24:30 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.157 17:24:30 -- setup/driver.sh@45 -- # setup output config 00:04:53.157 17:24:30 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:53.157 17:24:30 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.536 17:24:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.536 17:24:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.536 17:24:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.514 17:24:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:55.514 17:24:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:55.514 17:24:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:55.514 17:24:32 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:55.514 17:24:32 -- setup/driver.sh@65 -- # setup reset 00:04:55.514 17:24:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:55.514 17:24:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:58.053 00:04:58.053 real 0m4.686s 00:04:58.053 user 0m1.045s 00:04:58.053 sys 0m1.791s 00:04:58.053 17:24:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.053 17:24:35 -- common/autotest_common.sh@10 -- # set +x 00:04:58.053 ************************************ 00:04:58.053 END TEST guess_driver 00:04:58.053 ************************************ 00:04:58.053 00:04:58.053 real 0m7.403s 00:04:58.053 user 0m1.717s 00:04:58.053 sys 0m2.896s 00:04:58.053 17:24:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:58.053 17:24:35 -- common/autotest_common.sh@10 -- # set +x 00:04:58.053 ************************************ 00:04:58.053 END TEST driver 00:04:58.053 ************************************ 00:04:58.053 17:24:35 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:58.053 17:24:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.053 17:24:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.053 17:24:35 -- common/autotest_common.sh@10 -- # set +x 00:04:58.053 ************************************ 00:04:58.053 START TEST devices 00:04:58.053 ************************************ 00:04:58.053 17:24:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:58.053 * Looking for test storage... 00:04:58.053 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:58.053 17:24:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:58.053 17:24:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:58.053 17:24:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:58.053 17:24:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:58.053 17:24:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:58.053 17:24:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:58.053 17:24:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:58.053 17:24:35 -- scripts/common.sh@335 -- # IFS=.-: 00:04:58.053 17:24:35 -- scripts/common.sh@335 -- # read -ra ver1 00:04:58.053 17:24:35 -- scripts/common.sh@336 -- # IFS=.-: 00:04:58.053 17:24:35 -- scripts/common.sh@336 -- # read -ra ver2 00:04:58.053 17:24:35 -- scripts/common.sh@337 -- # local 'op=<' 00:04:58.053 17:24:35 -- scripts/common.sh@339 -- # ver1_l=2 00:04:58.053 17:24:35 -- scripts/common.sh@340 -- # ver2_l=1 00:04:58.053 17:24:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:58.053 17:24:35 -- scripts/common.sh@343 -- # case "$op" in 00:04:58.053 17:24:35 -- scripts/common.sh@344 -- # : 1 00:04:58.053 17:24:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:58.053 17:24:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:58.053 17:24:35 -- scripts/common.sh@364 -- # decimal 1 00:04:58.053 17:24:35 -- scripts/common.sh@352 -- # local d=1 00:04:58.053 17:24:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:58.053 17:24:35 -- scripts/common.sh@354 -- # echo 1 00:04:58.053 17:24:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:58.053 17:24:35 -- scripts/common.sh@365 -- # decimal 2 00:04:58.053 17:24:35 -- scripts/common.sh@352 -- # local d=2 00:04:58.053 17:24:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:58.053 17:24:35 -- scripts/common.sh@354 -- # echo 2 00:04:58.053 17:24:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:58.053 17:24:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:58.053 17:24:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:58.053 17:24:35 -- scripts/common.sh@367 -- # return 0 00:04:58.053 17:24:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:58.053 17:24:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:58.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:58.053 --rc genhtml_branch_coverage=1 00:04:58.053 --rc genhtml_function_coverage=1 00:04:58.053 --rc genhtml_legend=1 00:04:58.053 --rc geninfo_all_blocks=1 00:04:58.053 --rc geninfo_unexecuted_blocks=1 00:04:58.053 00:04:58.053 ' 00:04:58.053 17:24:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:58.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:58.053 --rc genhtml_branch_coverage=1 00:04:58.053 --rc genhtml_function_coverage=1 00:04:58.053 --rc genhtml_legend=1 00:04:58.053 --rc geninfo_all_blocks=1 00:04:58.053 --rc geninfo_unexecuted_blocks=1 00:04:58.053 00:04:58.053 ' 00:04:58.053 17:24:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:58.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:58.053 --rc genhtml_branch_coverage=1 00:04:58.053 --rc genhtml_function_coverage=1 00:04:58.053 --rc genhtml_legend=1 00:04:58.053 --rc geninfo_all_blocks=1 00:04:58.053 --rc geninfo_unexecuted_blocks=1 00:04:58.053 00:04:58.053 ' 00:04:58.054 17:24:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:58.054 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:58.054 --rc genhtml_branch_coverage=1 00:04:58.054 --rc genhtml_function_coverage=1 00:04:58.054 --rc genhtml_legend=1 00:04:58.054 --rc geninfo_all_blocks=1 00:04:58.054 --rc geninfo_unexecuted_blocks=1 00:04:58.054 00:04:58.054 ' 00:04:58.054 17:24:35 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:58.054 17:24:35 -- setup/devices.sh@192 -- # setup reset 00:04:58.054 17:24:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:58.054 17:24:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:59.434 17:24:36 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:59.434 17:24:36 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:59.434 17:24:36 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:59.434 17:24:36 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:59.434 17:24:36 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:59.434 17:24:36 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:59.434 17:24:36 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:59.434 17:24:36 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:59.434 17:24:36 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:59.434 17:24:36 -- setup/devices.sh@196 -- # blocks=() 00:04:59.434 17:24:36 -- setup/devices.sh@196 -- # declare -a blocks 00:04:59.434 17:24:36 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:59.434 17:24:36 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:59.434 17:24:36 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:59.434 17:24:36 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:59.434 17:24:36 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:59.434 17:24:36 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:59.434 17:24:36 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:59.434 17:24:36 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:59.434 17:24:36 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:59.434 17:24:36 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:59.434 17:24:36 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:59.434 No valid GPT data, bailing 00:04:59.434 17:24:36 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:59.434 17:24:36 -- scripts/common.sh@393 -- # pt= 00:04:59.434 17:24:36 -- scripts/common.sh@394 -- # return 1 00:04:59.434 17:24:36 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:59.434 17:24:36 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:59.434 17:24:36 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:59.434 17:24:36 -- setup/common.sh@80 -- # echo 1000204886016 00:04:59.434 17:24:36 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:59.434 17:24:36 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:59.434 17:24:36 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:59.434 17:24:36 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:59.434 17:24:36 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:59.434 17:24:36 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:59.434 17:24:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:59.434 17:24:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:59.434 17:24:36 -- common/autotest_common.sh@10 -- # set +x 00:04:59.434 ************************************ 00:04:59.434 START TEST nvme_mount 00:04:59.434 ************************************ 00:04:59.434 17:24:36 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:59.434 17:24:36 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:59.434 17:24:36 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:59.434 17:24:36 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:59.434 17:24:36 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:59.434 17:24:36 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:59.434 17:24:36 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:59.434 17:24:36 -- setup/common.sh@40 -- # local part_no=1 00:04:59.434 17:24:36 -- setup/common.sh@41 -- # local size=1073741824 00:04:59.434 17:24:36 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:59.434 17:24:36 -- setup/common.sh@44 -- # parts=() 00:04:59.434 17:24:36 -- setup/common.sh@44 -- # local parts 00:04:59.434 17:24:36 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:59.434 17:24:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:59.434 17:24:36 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:59.434 17:24:36 -- setup/common.sh@46 -- # (( part++ )) 00:04:59.434 17:24:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:59.434 17:24:36 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:59.434 17:24:36 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:59.434 17:24:36 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:00.813 Creating new GPT entries in memory. 00:05:00.813 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:00.813 other utilities. 00:05:00.813 17:24:37 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:00.813 17:24:37 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:00.813 17:24:37 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:00.813 17:24:37 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:00.813 17:24:37 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:01.750 Creating new GPT entries in memory. 00:05:01.750 The operation has completed successfully. 00:05:01.750 17:24:38 -- setup/common.sh@57 -- # (( part++ )) 00:05:01.750 17:24:38 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:01.750 17:24:38 -- setup/common.sh@62 -- # wait 1447598 00:05:01.750 17:24:38 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.750 17:24:38 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:01.750 17:24:38 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.750 17:24:38 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:01.750 17:24:38 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:01.750 17:24:38 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.750 17:24:39 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:01.750 17:24:39 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:01.750 17:24:39 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:01.750 17:24:39 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:01.750 17:24:39 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:01.750 17:24:39 -- setup/devices.sh@53 -- # local found=0 00:05:01.750 17:24:39 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:01.750 17:24:39 -- setup/devices.sh@56 -- # : 00:05:01.750 17:24:39 -- setup/devices.sh@59 -- # local pci status 00:05:01.750 17:24:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.750 17:24:39 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:01.750 17:24:39 -- setup/devices.sh@47 -- # setup output config 00:05:01.750 17:24:39 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:01.750 17:24:39 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:02.685 17:24:40 -- setup/devices.sh@63 -- # found=1 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.685 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.685 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.686 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.686 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.686 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.686 17:24:40 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.686 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.945 17:24:40 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:02.945 17:24:40 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:02.945 17:24:40 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.945 17:24:40 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:02.945 17:24:40 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.945 17:24:40 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:02.945 17:24:40 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.945 17:24:40 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.945 17:24:40 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:02.945 17:24:40 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:02.945 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:02.945 17:24:40 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:02.945 17:24:40 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:03.203 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:03.203 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:03.203 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:03.203 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:03.203 17:24:40 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:03.204 17:24:40 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:03.204 17:24:40 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.204 17:24:40 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:03.204 17:24:40 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:03.204 17:24:40 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.204 17:24:40 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:03.204 17:24:40 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:03.204 17:24:40 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:03.204 17:24:40 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.204 17:24:40 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:03.204 17:24:40 -- setup/devices.sh@53 -- # local found=0 00:05:03.204 17:24:40 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:03.204 17:24:40 -- setup/devices.sh@56 -- # : 00:05:03.204 17:24:40 -- setup/devices.sh@59 -- # local pci status 00:05:03.204 17:24:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.204 17:24:40 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:03.204 17:24:40 -- setup/devices.sh@47 -- # setup output config 00:05:03.204 17:24:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:03.204 17:24:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:04.137 17:24:41 -- setup/devices.sh@63 -- # found=1 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.137 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.137 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.397 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.397 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.397 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.397 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.397 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.397 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.397 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.397 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.397 17:24:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:04.397 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.397 17:24:41 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:04.397 17:24:41 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:04.397 17:24:41 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:04.397 17:24:41 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:04.397 17:24:41 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:04.397 17:24:41 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:04.397 17:24:41 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:04.397 17:24:41 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:04.397 17:24:41 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:04.398 17:24:41 -- setup/devices.sh@50 -- # local mount_point= 00:05:04.398 17:24:41 -- setup/devices.sh@51 -- # local test_file= 00:05:04.398 17:24:41 -- setup/devices.sh@53 -- # local found=0 00:05:04.398 17:24:41 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:04.398 17:24:41 -- setup/devices.sh@59 -- # local pci status 00:05:04.398 17:24:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:04.398 17:24:41 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:04.398 17:24:41 -- setup/devices.sh@47 -- # setup output config 00:05:04.398 17:24:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:04.398 17:24:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:05.781 17:24:42 -- setup/devices.sh@63 -- # found=1 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.781 17:24:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.781 17:24:43 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:05.781 17:24:43 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:05.781 17:24:43 -- setup/devices.sh@68 -- # return 0 00:05:05.781 17:24:43 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:05.781 17:24:43 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.781 17:24:43 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:05.781 17:24:43 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:05.781 17:24:43 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:05.781 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:05.781 00:05:05.781 real 0m6.243s 00:05:05.781 user 0m1.449s 00:05:05.781 sys 0m2.365s 00:05:05.781 17:24:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.781 17:24:43 -- common/autotest_common.sh@10 -- # set +x 00:05:05.781 ************************************ 00:05:05.781 END TEST nvme_mount 00:05:05.781 ************************************ 00:05:05.781 17:24:43 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:05.781 17:24:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.781 17:24:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.781 17:24:43 -- common/autotest_common.sh@10 -- # set +x 00:05:05.782 ************************************ 00:05:05.782 START TEST dm_mount 00:05:05.782 ************************************ 00:05:05.782 17:24:43 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:05.782 17:24:43 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:05.782 17:24:43 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:05.782 17:24:43 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:05.782 17:24:43 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:05.782 17:24:43 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:05.782 17:24:43 -- setup/common.sh@40 -- # local part_no=2 00:05:05.782 17:24:43 -- setup/common.sh@41 -- # local size=1073741824 00:05:05.782 17:24:43 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:05.782 17:24:43 -- setup/common.sh@44 -- # parts=() 00:05:05.782 17:24:43 -- setup/common.sh@44 -- # local parts 00:05:05.782 17:24:43 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:05.782 17:24:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.782 17:24:43 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:05.782 17:24:43 -- setup/common.sh@46 -- # (( part++ )) 00:05:05.782 17:24:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.782 17:24:43 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:05.782 17:24:43 -- setup/common.sh@46 -- # (( part++ )) 00:05:05.782 17:24:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.782 17:24:43 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:05.782 17:24:43 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:05.782 17:24:43 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:06.723 Creating new GPT entries in memory. 00:05:06.723 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:06.723 other utilities. 00:05:06.723 17:24:44 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:06.723 17:24:44 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.723 17:24:44 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:06.723 17:24:44 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:06.723 17:24:44 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:08.106 Creating new GPT entries in memory. 00:05:08.106 The operation has completed successfully. 00:05:08.106 17:24:45 -- setup/common.sh@57 -- # (( part++ )) 00:05:08.106 17:24:45 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:08.106 17:24:45 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:08.106 17:24:45 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:08.106 17:24:45 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:09.046 The operation has completed successfully. 00:05:09.046 17:24:46 -- setup/common.sh@57 -- # (( part++ )) 00:05:09.046 17:24:46 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:09.046 17:24:46 -- setup/common.sh@62 -- # wait 1450056 00:05:09.046 17:24:46 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:09.046 17:24:46 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.046 17:24:46 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:09.046 17:24:46 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:09.046 17:24:46 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:09.046 17:24:46 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:09.046 17:24:46 -- setup/devices.sh@161 -- # break 00:05:09.046 17:24:46 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:09.046 17:24:46 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:09.046 17:24:46 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:09.046 17:24:46 -- setup/devices.sh@166 -- # dm=dm-0 00:05:09.046 17:24:46 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:09.046 17:24:46 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:09.046 17:24:46 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.046 17:24:46 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:09.046 17:24:46 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.046 17:24:46 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:09.046 17:24:46 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:09.046 17:24:46 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.046 17:24:46 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:09.046 17:24:46 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:09.047 17:24:46 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:09.047 17:24:46 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.047 17:24:46 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:09.047 17:24:46 -- setup/devices.sh@53 -- # local found=0 00:05:09.047 17:24:46 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:09.047 17:24:46 -- setup/devices.sh@56 -- # : 00:05:09.047 17:24:46 -- setup/devices.sh@59 -- # local pci status 00:05:09.047 17:24:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.047 17:24:46 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:09.047 17:24:46 -- setup/devices.sh@47 -- # setup output config 00:05:09.047 17:24:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:09.047 17:24:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:09.984 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.984 17:24:47 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:09.984 17:24:47 -- setup/devices.sh@63 -- # found=1 00:05:09.984 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.984 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.984 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.985 17:24:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.985 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.245 17:24:47 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:10.245 17:24:47 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:10.245 17:24:47 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:10.245 17:24:47 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:10.245 17:24:47 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:10.245 17:24:47 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:10.245 17:24:47 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:10.245 17:24:47 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:10.245 17:24:47 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:10.245 17:24:47 -- setup/devices.sh@50 -- # local mount_point= 00:05:10.245 17:24:47 -- setup/devices.sh@51 -- # local test_file= 00:05:10.245 17:24:47 -- setup/devices.sh@53 -- # local found=0 00:05:10.245 17:24:47 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:10.245 17:24:47 -- setup/devices.sh@59 -- # local pci status 00:05:10.245 17:24:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.245 17:24:47 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:10.245 17:24:47 -- setup/devices.sh@47 -- # setup output config 00:05:10.245 17:24:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:10.245 17:24:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:11.186 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.186 17:24:48 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:11.186 17:24:48 -- setup/devices.sh@63 -- # found=1 00:05:11.186 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.186 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.186 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.187 17:24:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.187 17:24:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.447 17:24:48 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:11.447 17:24:48 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:11.447 17:24:48 -- setup/devices.sh@68 -- # return 0 00:05:11.447 17:24:48 -- setup/devices.sh@187 -- # cleanup_dm 00:05:11.447 17:24:48 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:11.447 17:24:48 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:11.447 17:24:48 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:11.447 17:24:48 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.447 17:24:48 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:11.447 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:11.447 17:24:48 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:11.447 17:24:48 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:11.447 00:05:11.447 real 0m5.714s 00:05:11.447 user 0m0.930s 00:05:11.447 sys 0m1.649s 00:05:11.447 17:24:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.447 17:24:48 -- common/autotest_common.sh@10 -- # set +x 00:05:11.447 ************************************ 00:05:11.447 END TEST dm_mount 00:05:11.447 ************************************ 00:05:11.447 17:24:48 -- setup/devices.sh@1 -- # cleanup 00:05:11.447 17:24:48 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:11.447 17:24:48 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:11.447 17:24:48 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.447 17:24:48 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:11.447 17:24:48 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:11.447 17:24:48 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:11.706 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:11.706 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:11.706 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:11.706 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:11.706 17:24:49 -- setup/devices.sh@12 -- # cleanup_dm 00:05:11.706 17:24:49 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:11.706 17:24:49 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:11.706 17:24:49 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.706 17:24:49 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:11.706 17:24:49 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:11.706 17:24:49 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:11.706 00:05:11.706 real 0m13.876s 00:05:11.706 user 0m3.084s 00:05:11.706 sys 0m4.999s 00:05:11.706 17:24:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.706 17:24:49 -- common/autotest_common.sh@10 -- # set +x 00:05:11.706 ************************************ 00:05:11.706 END TEST devices 00:05:11.706 ************************************ 00:05:11.706 00:05:11.706 real 0m43.911s 00:05:11.706 user 0m12.632s 00:05:11.706 sys 0m19.686s 00:05:11.706 17:24:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.706 17:24:49 -- common/autotest_common.sh@10 -- # set +x 00:05:11.706 ************************************ 00:05:11.707 END TEST setup.sh 00:05:11.707 ************************************ 00:05:11.707 17:24:49 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:13.097 Hugepages 00:05:13.097 node hugesize free / total 00:05:13.097 node0 1048576kB 0 / 0 00:05:13.097 node0 2048kB 2048 / 2048 00:05:13.097 node1 1048576kB 0 / 0 00:05:13.098 node1 2048kB 0 / 0 00:05:13.098 00:05:13.098 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:13.098 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:13.098 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:13.098 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:13.098 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:13.098 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:13.098 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:13.098 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:13.098 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:13.098 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:13.098 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:13.098 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:13.098 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:13.098 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:13.098 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:13.098 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:13.098 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:13.098 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:13.098 17:24:50 -- spdk/autotest.sh@128 -- # uname -s 00:05:13.098 17:24:50 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:13.098 17:24:50 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:13.098 17:24:50 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:14.476 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:14.476 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:14.476 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:14.476 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:14.476 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:14.476 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:14.476 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:14.476 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:14.476 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:14.476 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:14.476 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:14.476 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:14.476 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:14.476 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:14.476 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:14.476 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:15.417 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:15.417 17:24:52 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:16.357 17:24:53 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:16.357 17:24:53 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:16.357 17:24:53 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:16.357 17:24:53 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:16.357 17:24:53 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:16.357 17:24:53 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:16.357 17:24:53 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:16.357 17:24:53 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:16.357 17:24:53 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:16.617 17:24:53 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:16.617 17:24:53 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:16.617 17:24:53 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:17.555 Waiting for block devices as requested 00:05:17.555 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:17.815 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:17.815 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:17.815 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:18.075 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:18.075 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:18.075 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:18.075 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:18.336 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:18.336 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:18.336 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:18.336 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:18.596 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:18.596 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:18.596 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:18.596 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:18.856 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:18.856 17:24:56 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:18.856 17:24:56 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:18.856 17:24:56 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:18.856 17:24:56 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:18.856 17:24:56 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:18.856 17:24:56 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:18.856 17:24:56 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:18.856 17:24:56 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:18.856 17:24:56 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:18.856 17:24:56 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:18.856 17:24:56 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:18.856 17:24:56 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:18.856 17:24:56 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:18.856 17:24:56 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:18.856 17:24:56 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:18.856 17:24:56 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:18.856 17:24:56 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:18.856 17:24:56 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:18.856 17:24:56 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:18.856 17:24:56 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:18.856 17:24:56 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:18.856 17:24:56 -- common/autotest_common.sh@1552 -- # continue 00:05:18.856 17:24:56 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:18.856 17:24:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:18.856 17:24:56 -- common/autotest_common.sh@10 -- # set +x 00:05:18.856 17:24:56 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:18.856 17:24:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:18.856 17:24:56 -- common/autotest_common.sh@10 -- # set +x 00:05:18.856 17:24:56 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:20.237 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:20.237 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:20.237 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:20.237 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:20.237 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:20.237 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:20.237 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:20.237 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:20.237 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:20.237 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:20.237 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:20.237 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:20.237 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:20.237 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:20.237 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:20.237 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:21.178 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:21.438 17:24:58 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:21.438 17:24:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:21.438 17:24:58 -- common/autotest_common.sh@10 -- # set +x 00:05:21.438 17:24:58 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:21.438 17:24:58 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:21.438 17:24:58 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:21.438 17:24:58 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:21.438 17:24:58 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:21.438 17:24:58 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:21.438 17:24:58 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:21.438 17:24:58 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:21.438 17:24:58 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:21.438 17:24:58 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:21.438 17:24:58 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:21.438 17:24:58 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:21.438 17:24:58 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:21.438 17:24:58 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:21.438 17:24:58 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:21.438 17:24:58 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:21.438 17:24:58 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:21.438 17:24:58 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:21.438 17:24:58 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:21.438 17:24:58 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:21.438 17:24:58 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=1455356 00:05:21.438 17:24:58 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:21.438 17:24:58 -- common/autotest_common.sh@1593 -- # waitforlisten 1455356 00:05:21.438 17:24:58 -- common/autotest_common.sh@829 -- # '[' -z 1455356 ']' 00:05:21.438 17:24:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:21.438 17:24:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.438 17:24:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:21.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:21.438 17:24:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.438 17:24:58 -- common/autotest_common.sh@10 -- # set +x 00:05:21.438 [2024-11-16 17:24:58.831082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.438 [2024-11-16 17:24:58.831185] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1455356 ] 00:05:21.438 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.438 [2024-11-16 17:24:58.889874] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.698 [2024-11-16 17:24:58.976954] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.698 [2024-11-16 17:24:58.977138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.644 17:24:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.644 17:24:59 -- common/autotest_common.sh@862 -- # return 0 00:05:22.644 17:24:59 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:22.644 17:24:59 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:22.644 17:24:59 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:25.941 nvme0n1 00:05:25.941 17:25:02 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:25.941 [2024-11-16 17:25:03.116644] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:25.941 [2024-11-16 17:25:03.116686] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:25.941 request: 00:05:25.941 { 00:05:25.941 "nvme_ctrlr_name": "nvme0", 00:05:25.941 "password": "test", 00:05:25.941 "method": "bdev_nvme_opal_revert", 00:05:25.941 "req_id": 1 00:05:25.941 } 00:05:25.941 Got JSON-RPC error response 00:05:25.941 response: 00:05:25.941 { 00:05:25.941 "code": -32603, 00:05:25.941 "message": "Internal error" 00:05:25.941 } 00:05:25.941 17:25:03 -- common/autotest_common.sh@1599 -- # true 00:05:25.941 17:25:03 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:25.941 17:25:03 -- common/autotest_common.sh@1603 -- # killprocess 1455356 00:05:25.941 17:25:03 -- common/autotest_common.sh@936 -- # '[' -z 1455356 ']' 00:05:25.941 17:25:03 -- common/autotest_common.sh@940 -- # kill -0 1455356 00:05:25.941 17:25:03 -- common/autotest_common.sh@941 -- # uname 00:05:25.941 17:25:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:25.941 17:25:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1455356 00:05:25.941 17:25:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:25.941 17:25:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:25.941 17:25:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1455356' 00:05:25.941 killing process with pid 1455356 00:05:25.941 17:25:03 -- common/autotest_common.sh@955 -- # kill 1455356 00:05:25.941 17:25:03 -- common/autotest_common.sh@960 -- # wait 1455356 00:05:27.849 17:25:04 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:27.850 17:25:04 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:27.850 17:25:04 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:27.850 17:25:04 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:27.850 17:25:04 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:27.850 17:25:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:27.850 17:25:04 -- common/autotest_common.sh@10 -- # set +x 00:05:27.850 17:25:04 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:27.850 17:25:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.850 17:25:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.850 17:25:04 -- common/autotest_common.sh@10 -- # set +x 00:05:27.850 ************************************ 00:05:27.850 START TEST env 00:05:27.850 ************************************ 00:05:27.850 17:25:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:27.850 * Looking for test storage... 00:05:27.850 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:27.850 17:25:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:27.850 17:25:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:27.850 17:25:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:27.850 17:25:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:27.850 17:25:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:27.850 17:25:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:27.850 17:25:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:27.850 17:25:05 -- scripts/common.sh@335 -- # IFS=.-: 00:05:27.850 17:25:05 -- scripts/common.sh@335 -- # read -ra ver1 00:05:27.850 17:25:05 -- scripts/common.sh@336 -- # IFS=.-: 00:05:27.850 17:25:05 -- scripts/common.sh@336 -- # read -ra ver2 00:05:27.850 17:25:05 -- scripts/common.sh@337 -- # local 'op=<' 00:05:27.850 17:25:05 -- scripts/common.sh@339 -- # ver1_l=2 00:05:27.850 17:25:05 -- scripts/common.sh@340 -- # ver2_l=1 00:05:27.850 17:25:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:27.850 17:25:05 -- scripts/common.sh@343 -- # case "$op" in 00:05:27.850 17:25:05 -- scripts/common.sh@344 -- # : 1 00:05:27.850 17:25:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:27.850 17:25:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:27.850 17:25:05 -- scripts/common.sh@364 -- # decimal 1 00:05:27.850 17:25:05 -- scripts/common.sh@352 -- # local d=1 00:05:27.850 17:25:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:27.850 17:25:05 -- scripts/common.sh@354 -- # echo 1 00:05:27.850 17:25:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:27.850 17:25:05 -- scripts/common.sh@365 -- # decimal 2 00:05:27.850 17:25:05 -- scripts/common.sh@352 -- # local d=2 00:05:27.850 17:25:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:27.850 17:25:05 -- scripts/common.sh@354 -- # echo 2 00:05:27.850 17:25:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:27.850 17:25:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:27.850 17:25:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:27.850 17:25:05 -- scripts/common.sh@367 -- # return 0 00:05:27.850 17:25:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:27.850 17:25:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:27.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.850 --rc genhtml_branch_coverage=1 00:05:27.850 --rc genhtml_function_coverage=1 00:05:27.850 --rc genhtml_legend=1 00:05:27.850 --rc geninfo_all_blocks=1 00:05:27.850 --rc geninfo_unexecuted_blocks=1 00:05:27.850 00:05:27.850 ' 00:05:27.850 17:25:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:27.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.850 --rc genhtml_branch_coverage=1 00:05:27.850 --rc genhtml_function_coverage=1 00:05:27.850 --rc genhtml_legend=1 00:05:27.850 --rc geninfo_all_blocks=1 00:05:27.850 --rc geninfo_unexecuted_blocks=1 00:05:27.850 00:05:27.850 ' 00:05:27.850 17:25:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:27.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.850 --rc genhtml_branch_coverage=1 00:05:27.850 --rc genhtml_function_coverage=1 00:05:27.850 --rc genhtml_legend=1 00:05:27.850 --rc geninfo_all_blocks=1 00:05:27.850 --rc geninfo_unexecuted_blocks=1 00:05:27.850 00:05:27.850 ' 00:05:27.850 17:25:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:27.850 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.850 --rc genhtml_branch_coverage=1 00:05:27.850 --rc genhtml_function_coverage=1 00:05:27.850 --rc genhtml_legend=1 00:05:27.850 --rc geninfo_all_blocks=1 00:05:27.850 --rc geninfo_unexecuted_blocks=1 00:05:27.850 00:05:27.850 ' 00:05:27.850 17:25:05 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:27.850 17:25:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.850 17:25:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.850 17:25:05 -- common/autotest_common.sh@10 -- # set +x 00:05:27.850 ************************************ 00:05:27.850 START TEST env_memory 00:05:27.850 ************************************ 00:05:27.850 17:25:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:27.850 00:05:27.850 00:05:27.850 CUnit - A unit testing framework for C - Version 2.1-3 00:05:27.850 http://cunit.sourceforge.net/ 00:05:27.850 00:05:27.850 00:05:27.850 Suite: memory 00:05:27.850 Test: alloc and free memory map ...[2024-11-16 17:25:05.123226] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:27.850 passed 00:05:27.850 Test: mem map translation ...[2024-11-16 17:25:05.143083] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:27.850 [2024-11-16 17:25:05.143104] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:27.850 [2024-11-16 17:25:05.143150] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:27.850 [2024-11-16 17:25:05.143162] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:27.850 passed 00:05:27.850 Test: mem map registration ...[2024-11-16 17:25:05.183614] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:27.850 [2024-11-16 17:25:05.183636] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:27.850 passed 00:05:27.850 Test: mem map adjacent registrations ...passed 00:05:27.850 00:05:27.850 Run Summary: Type Total Ran Passed Failed Inactive 00:05:27.850 suites 1 1 n/a 0 0 00:05:27.850 tests 4 4 4 0 0 00:05:27.850 asserts 152 152 152 0 n/a 00:05:27.850 00:05:27.850 Elapsed time = 0.140 seconds 00:05:27.850 00:05:27.850 real 0m0.149s 00:05:27.850 user 0m0.141s 00:05:27.850 sys 0m0.008s 00:05:27.850 17:25:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.850 17:25:05 -- common/autotest_common.sh@10 -- # set +x 00:05:27.850 ************************************ 00:05:27.850 END TEST env_memory 00:05:27.850 ************************************ 00:05:27.850 17:25:05 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:27.850 17:25:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.850 17:25:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.850 17:25:05 -- common/autotest_common.sh@10 -- # set +x 00:05:27.850 ************************************ 00:05:27.850 START TEST env_vtophys 00:05:27.850 ************************************ 00:05:27.850 17:25:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:27.850 EAL: lib.eal log level changed from notice to debug 00:05:27.850 EAL: Detected lcore 0 as core 0 on socket 0 00:05:27.850 EAL: Detected lcore 1 as core 1 on socket 0 00:05:27.850 EAL: Detected lcore 2 as core 2 on socket 0 00:05:27.850 EAL: Detected lcore 3 as core 3 on socket 0 00:05:27.850 EAL: Detected lcore 4 as core 4 on socket 0 00:05:27.850 EAL: Detected lcore 5 as core 5 on socket 0 00:05:27.850 EAL: Detected lcore 6 as core 8 on socket 0 00:05:27.850 EAL: Detected lcore 7 as core 9 on socket 0 00:05:27.850 EAL: Detected lcore 8 as core 10 on socket 0 00:05:27.850 EAL: Detected lcore 9 as core 11 on socket 0 00:05:27.850 EAL: Detected lcore 10 as core 12 on socket 0 00:05:27.850 EAL: Detected lcore 11 as core 13 on socket 0 00:05:27.850 EAL: Detected lcore 12 as core 0 on socket 1 00:05:27.850 EAL: Detected lcore 13 as core 1 on socket 1 00:05:27.850 EAL: Detected lcore 14 as core 2 on socket 1 00:05:27.850 EAL: Detected lcore 15 as core 3 on socket 1 00:05:27.850 EAL: Detected lcore 16 as core 4 on socket 1 00:05:27.850 EAL: Detected lcore 17 as core 5 on socket 1 00:05:27.851 EAL: Detected lcore 18 as core 8 on socket 1 00:05:27.851 EAL: Detected lcore 19 as core 9 on socket 1 00:05:27.851 EAL: Detected lcore 20 as core 10 on socket 1 00:05:27.851 EAL: Detected lcore 21 as core 11 on socket 1 00:05:27.851 EAL: Detected lcore 22 as core 12 on socket 1 00:05:27.851 EAL: Detected lcore 23 as core 13 on socket 1 00:05:27.851 EAL: Detected lcore 24 as core 0 on socket 0 00:05:27.851 EAL: Detected lcore 25 as core 1 on socket 0 00:05:27.851 EAL: Detected lcore 26 as core 2 on socket 0 00:05:27.851 EAL: Detected lcore 27 as core 3 on socket 0 00:05:27.851 EAL: Detected lcore 28 as core 4 on socket 0 00:05:27.851 EAL: Detected lcore 29 as core 5 on socket 0 00:05:27.851 EAL: Detected lcore 30 as core 8 on socket 0 00:05:27.851 EAL: Detected lcore 31 as core 9 on socket 0 00:05:27.851 EAL: Detected lcore 32 as core 10 on socket 0 00:05:27.851 EAL: Detected lcore 33 as core 11 on socket 0 00:05:27.851 EAL: Detected lcore 34 as core 12 on socket 0 00:05:27.851 EAL: Detected lcore 35 as core 13 on socket 0 00:05:27.851 EAL: Detected lcore 36 as core 0 on socket 1 00:05:27.851 EAL: Detected lcore 37 as core 1 on socket 1 00:05:27.851 EAL: Detected lcore 38 as core 2 on socket 1 00:05:27.851 EAL: Detected lcore 39 as core 3 on socket 1 00:05:27.851 EAL: Detected lcore 40 as core 4 on socket 1 00:05:27.851 EAL: Detected lcore 41 as core 5 on socket 1 00:05:27.851 EAL: Detected lcore 42 as core 8 on socket 1 00:05:27.851 EAL: Detected lcore 43 as core 9 on socket 1 00:05:27.851 EAL: Detected lcore 44 as core 10 on socket 1 00:05:27.851 EAL: Detected lcore 45 as core 11 on socket 1 00:05:27.851 EAL: Detected lcore 46 as core 12 on socket 1 00:05:27.851 EAL: Detected lcore 47 as core 13 on socket 1 00:05:27.851 EAL: Maximum logical cores by configuration: 128 00:05:27.851 EAL: Detected CPU lcores: 48 00:05:27.851 EAL: Detected NUMA nodes: 2 00:05:27.851 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:27.851 EAL: Detected shared linkage of DPDK 00:05:27.851 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:27.851 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:27.851 EAL: Registered [vdev] bus. 00:05:27.851 EAL: bus.vdev log level changed from disabled to notice 00:05:27.851 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:27.851 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:27.851 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:27.851 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:27.851 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:27.851 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:27.851 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:27.851 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:27.851 EAL: No shared files mode enabled, IPC will be disabled 00:05:27.851 EAL: No shared files mode enabled, IPC is disabled 00:05:27.851 EAL: Bus pci wants IOVA as 'DC' 00:05:27.851 EAL: Bus vdev wants IOVA as 'DC' 00:05:27.851 EAL: Buses did not request a specific IOVA mode. 00:05:27.851 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:27.851 EAL: Selected IOVA mode 'VA' 00:05:27.851 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.851 EAL: Probing VFIO support... 00:05:27.851 EAL: IOMMU type 1 (Type 1) is supported 00:05:27.851 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:27.851 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:27.851 EAL: VFIO support initialized 00:05:27.851 EAL: Ask a virtual area of 0x2e000 bytes 00:05:27.851 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:27.851 EAL: Setting up physically contiguous memory... 00:05:27.851 EAL: Setting maximum number of open files to 524288 00:05:27.851 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:27.851 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:27.851 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:27.851 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.851 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:27.851 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.851 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.851 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:27.851 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:27.851 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.851 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:27.851 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.851 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.851 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:27.851 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:27.851 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.851 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:27.851 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.851 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.851 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:27.851 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:27.851 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.851 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:27.851 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.851 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.851 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:27.851 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:27.851 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:27.851 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.851 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:27.851 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.851 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.851 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:27.851 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:27.851 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.851 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:27.851 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.851 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.851 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:27.851 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:27.851 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.851 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:27.851 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.851 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.851 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:27.851 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:27.851 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.851 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:27.851 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.851 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.851 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:27.851 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:27.851 EAL: Hugepages will be freed exactly as allocated. 00:05:27.851 EAL: No shared files mode enabled, IPC is disabled 00:05:27.851 EAL: No shared files mode enabled, IPC is disabled 00:05:27.851 EAL: TSC frequency is ~2700000 KHz 00:05:27.851 EAL: Main lcore 0 is ready (tid=7f976702da00;cpuset=[0]) 00:05:27.851 EAL: Trying to obtain current memory policy. 00:05:27.851 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.851 EAL: Restoring previous memory policy: 0 00:05:27.851 EAL: request: mp_malloc_sync 00:05:27.851 EAL: No shared files mode enabled, IPC is disabled 00:05:27.851 EAL: Heap on socket 0 was expanded by 2MB 00:05:27.851 EAL: No shared files mode enabled, IPC is disabled 00:05:27.851 EAL: No shared files mode enabled, IPC is disabled 00:05:27.851 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:27.851 EAL: Mem event callback 'spdk:(nil)' registered 00:05:28.112 00:05:28.112 00:05:28.112 CUnit - A unit testing framework for C - Version 2.1-3 00:05:28.112 http://cunit.sourceforge.net/ 00:05:28.112 00:05:28.112 00:05:28.112 Suite: components_suite 00:05:28.112 Test: vtophys_malloc_test ...passed 00:05:28.112 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:28.112 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.112 EAL: Restoring previous memory policy: 4 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was expanded by 4MB 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was shrunk by 4MB 00:05:28.112 EAL: Trying to obtain current memory policy. 00:05:28.112 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.112 EAL: Restoring previous memory policy: 4 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was expanded by 6MB 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was shrunk by 6MB 00:05:28.112 EAL: Trying to obtain current memory policy. 00:05:28.112 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.112 EAL: Restoring previous memory policy: 4 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was expanded by 10MB 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was shrunk by 10MB 00:05:28.112 EAL: Trying to obtain current memory policy. 00:05:28.112 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.112 EAL: Restoring previous memory policy: 4 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was expanded by 18MB 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was shrunk by 18MB 00:05:28.112 EAL: Trying to obtain current memory policy. 00:05:28.112 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.112 EAL: Restoring previous memory policy: 4 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was expanded by 34MB 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was shrunk by 34MB 00:05:28.112 EAL: Trying to obtain current memory policy. 00:05:28.112 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.112 EAL: Restoring previous memory policy: 4 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was expanded by 66MB 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was shrunk by 66MB 00:05:28.112 EAL: Trying to obtain current memory policy. 00:05:28.112 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.112 EAL: Restoring previous memory policy: 4 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was expanded by 130MB 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was shrunk by 130MB 00:05:28.112 EAL: Trying to obtain current memory policy. 00:05:28.112 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.112 EAL: Restoring previous memory policy: 4 00:05:28.112 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.112 EAL: request: mp_malloc_sync 00:05:28.112 EAL: No shared files mode enabled, IPC is disabled 00:05:28.112 EAL: Heap on socket 0 was expanded by 258MB 00:05:28.372 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.372 EAL: request: mp_malloc_sync 00:05:28.372 EAL: No shared files mode enabled, IPC is disabled 00:05:28.372 EAL: Heap on socket 0 was shrunk by 258MB 00:05:28.372 EAL: Trying to obtain current memory policy. 00:05:28.372 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.372 EAL: Restoring previous memory policy: 4 00:05:28.372 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.372 EAL: request: mp_malloc_sync 00:05:28.372 EAL: No shared files mode enabled, IPC is disabled 00:05:28.372 EAL: Heap on socket 0 was expanded by 514MB 00:05:28.630 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.630 EAL: request: mp_malloc_sync 00:05:28.631 EAL: No shared files mode enabled, IPC is disabled 00:05:28.631 EAL: Heap on socket 0 was shrunk by 514MB 00:05:28.631 EAL: Trying to obtain current memory policy. 00:05:28.631 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.890 EAL: Restoring previous memory policy: 4 00:05:28.890 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.890 EAL: request: mp_malloc_sync 00:05:28.890 EAL: No shared files mode enabled, IPC is disabled 00:05:28.890 EAL: Heap on socket 0 was expanded by 1026MB 00:05:29.149 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.409 EAL: request: mp_malloc_sync 00:05:29.409 EAL: No shared files mode enabled, IPC is disabled 00:05:29.409 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:29.409 passed 00:05:29.409 00:05:29.409 Run Summary: Type Total Ran Passed Failed Inactive 00:05:29.409 suites 1 1 n/a 0 0 00:05:29.409 tests 2 2 2 0 0 00:05:29.409 asserts 497 497 497 0 n/a 00:05:29.409 00:05:29.409 Elapsed time = 1.372 seconds 00:05:29.409 EAL: Calling mem event callback 'spdk:(nil)' 00:05:29.409 EAL: request: mp_malloc_sync 00:05:29.409 EAL: No shared files mode enabled, IPC is disabled 00:05:29.409 EAL: Heap on socket 0 was shrunk by 2MB 00:05:29.409 EAL: No shared files mode enabled, IPC is disabled 00:05:29.409 EAL: No shared files mode enabled, IPC is disabled 00:05:29.409 EAL: No shared files mode enabled, IPC is disabled 00:05:29.409 00:05:29.409 real 0m1.488s 00:05:29.409 user 0m0.864s 00:05:29.409 sys 0m0.593s 00:05:29.409 17:25:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.409 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:05:29.409 ************************************ 00:05:29.409 END TEST env_vtophys 00:05:29.409 ************************************ 00:05:29.409 17:25:06 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:29.409 17:25:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:29.409 17:25:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.409 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:05:29.409 ************************************ 00:05:29.409 START TEST env_pci 00:05:29.409 ************************************ 00:05:29.409 17:25:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:29.409 00:05:29.409 00:05:29.409 CUnit - A unit testing framework for C - Version 2.1-3 00:05:29.409 http://cunit.sourceforge.net/ 00:05:29.409 00:05:29.409 00:05:29.409 Suite: pci 00:05:29.409 Test: pci_hook ...[2024-11-16 17:25:06.792908] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1456399 has claimed it 00:05:29.409 EAL: Cannot find device (10000:00:01.0) 00:05:29.409 EAL: Failed to attach device on primary process 00:05:29.409 passed 00:05:29.409 00:05:29.409 Run Summary: Type Total Ran Passed Failed Inactive 00:05:29.410 suites 1 1 n/a 0 0 00:05:29.410 tests 1 1 1 0 0 00:05:29.410 asserts 25 25 25 0 n/a 00:05:29.410 00:05:29.410 Elapsed time = 0.021 seconds 00:05:29.410 00:05:29.410 real 0m0.034s 00:05:29.410 user 0m0.011s 00:05:29.410 sys 0m0.023s 00:05:29.410 17:25:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.410 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:05:29.410 ************************************ 00:05:29.410 END TEST env_pci 00:05:29.410 ************************************ 00:05:29.410 17:25:06 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:29.410 17:25:06 -- env/env.sh@15 -- # uname 00:05:29.410 17:25:06 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:29.410 17:25:06 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:29.410 17:25:06 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:29.410 17:25:06 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:29.410 17:25:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.410 17:25:06 -- common/autotest_common.sh@10 -- # set +x 00:05:29.410 ************************************ 00:05:29.410 START TEST env_dpdk_post_init 00:05:29.410 ************************************ 00:05:29.410 17:25:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:29.410 EAL: Detected CPU lcores: 48 00:05:29.410 EAL: Detected NUMA nodes: 2 00:05:29.410 EAL: Detected shared linkage of DPDK 00:05:29.410 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:29.410 EAL: Selected IOVA mode 'VA' 00:05:29.410 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.410 EAL: VFIO support initialized 00:05:29.410 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:29.668 EAL: Using IOMMU type 1 (Type 1) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:29.668 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:30.687 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:34.007 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:34.007 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:34.007 Starting DPDK initialization... 00:05:34.007 Starting SPDK post initialization... 00:05:34.007 SPDK NVMe probe 00:05:34.007 Attaching to 0000:88:00.0 00:05:34.007 Attached to 0000:88:00.0 00:05:34.007 Cleaning up... 00:05:34.007 00:05:34.007 real 0m4.386s 00:05:34.007 user 0m3.249s 00:05:34.007 sys 0m0.191s 00:05:34.007 17:25:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.007 17:25:11 -- common/autotest_common.sh@10 -- # set +x 00:05:34.007 ************************************ 00:05:34.007 END TEST env_dpdk_post_init 00:05:34.007 ************************************ 00:05:34.007 17:25:11 -- env/env.sh@26 -- # uname 00:05:34.007 17:25:11 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:34.007 17:25:11 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:34.007 17:25:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.007 17:25:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.007 17:25:11 -- common/autotest_common.sh@10 -- # set +x 00:05:34.007 ************************************ 00:05:34.007 START TEST env_mem_callbacks 00:05:34.007 ************************************ 00:05:34.007 17:25:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:34.007 EAL: Detected CPU lcores: 48 00:05:34.007 EAL: Detected NUMA nodes: 2 00:05:34.007 EAL: Detected shared linkage of DPDK 00:05:34.007 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:34.007 EAL: Selected IOVA mode 'VA' 00:05:34.007 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.007 EAL: VFIO support initialized 00:05:34.007 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:34.008 00:05:34.008 00:05:34.008 CUnit - A unit testing framework for C - Version 2.1-3 00:05:34.008 http://cunit.sourceforge.net/ 00:05:34.008 00:05:34.008 00:05:34.008 Suite: memory 00:05:34.008 Test: test ... 00:05:34.008 register 0x200000200000 2097152 00:05:34.008 malloc 3145728 00:05:34.008 register 0x200000400000 4194304 00:05:34.008 buf 0x200000500000 len 3145728 PASSED 00:05:34.008 malloc 64 00:05:34.008 buf 0x2000004fff40 len 64 PASSED 00:05:34.008 malloc 4194304 00:05:34.008 register 0x200000800000 6291456 00:05:34.008 buf 0x200000a00000 len 4194304 PASSED 00:05:34.008 free 0x200000500000 3145728 00:05:34.008 free 0x2000004fff40 64 00:05:34.008 unregister 0x200000400000 4194304 PASSED 00:05:34.008 free 0x200000a00000 4194304 00:05:34.008 unregister 0x200000800000 6291456 PASSED 00:05:34.008 malloc 8388608 00:05:34.008 register 0x200000400000 10485760 00:05:34.008 buf 0x200000600000 len 8388608 PASSED 00:05:34.008 free 0x200000600000 8388608 00:05:34.008 unregister 0x200000400000 10485760 PASSED 00:05:34.008 passed 00:05:34.008 00:05:34.008 Run Summary: Type Total Ran Passed Failed Inactive 00:05:34.008 suites 1 1 n/a 0 0 00:05:34.008 tests 1 1 1 0 0 00:05:34.008 asserts 15 15 15 0 n/a 00:05:34.008 00:05:34.008 Elapsed time = 0.006 seconds 00:05:34.008 00:05:34.008 real 0m0.048s 00:05:34.008 user 0m0.011s 00:05:34.008 sys 0m0.036s 00:05:34.008 17:25:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.008 17:25:11 -- common/autotest_common.sh@10 -- # set +x 00:05:34.008 ************************************ 00:05:34.008 END TEST env_mem_callbacks 00:05:34.008 ************************************ 00:05:34.008 00:05:34.008 real 0m6.372s 00:05:34.008 user 0m4.418s 00:05:34.008 sys 0m1.003s 00:05:34.008 17:25:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.008 17:25:11 -- common/autotest_common.sh@10 -- # set +x 00:05:34.008 ************************************ 00:05:34.008 END TEST env 00:05:34.008 ************************************ 00:05:34.008 17:25:11 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:34.008 17:25:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.008 17:25:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.008 17:25:11 -- common/autotest_common.sh@10 -- # set +x 00:05:34.008 ************************************ 00:05:34.008 START TEST rpc 00:05:34.008 ************************************ 00:05:34.008 17:25:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:34.008 * Looking for test storage... 00:05:34.008 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:34.008 17:25:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:34.008 17:25:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:34.008 17:25:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:34.008 17:25:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:34.008 17:25:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:34.008 17:25:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:34.008 17:25:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:34.008 17:25:11 -- scripts/common.sh@335 -- # IFS=.-: 00:05:34.008 17:25:11 -- scripts/common.sh@335 -- # read -ra ver1 00:05:34.008 17:25:11 -- scripts/common.sh@336 -- # IFS=.-: 00:05:34.008 17:25:11 -- scripts/common.sh@336 -- # read -ra ver2 00:05:34.008 17:25:11 -- scripts/common.sh@337 -- # local 'op=<' 00:05:34.008 17:25:11 -- scripts/common.sh@339 -- # ver1_l=2 00:05:34.008 17:25:11 -- scripts/common.sh@340 -- # ver2_l=1 00:05:34.008 17:25:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:34.008 17:25:11 -- scripts/common.sh@343 -- # case "$op" in 00:05:34.008 17:25:11 -- scripts/common.sh@344 -- # : 1 00:05:34.008 17:25:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:34.008 17:25:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:34.267 17:25:11 -- scripts/common.sh@364 -- # decimal 1 00:05:34.267 17:25:11 -- scripts/common.sh@352 -- # local d=1 00:05:34.267 17:25:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:34.267 17:25:11 -- scripts/common.sh@354 -- # echo 1 00:05:34.267 17:25:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:34.267 17:25:11 -- scripts/common.sh@365 -- # decimal 2 00:05:34.267 17:25:11 -- scripts/common.sh@352 -- # local d=2 00:05:34.267 17:25:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:34.267 17:25:11 -- scripts/common.sh@354 -- # echo 2 00:05:34.267 17:25:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:34.267 17:25:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:34.267 17:25:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:34.267 17:25:11 -- scripts/common.sh@367 -- # return 0 00:05:34.267 17:25:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:34.267 17:25:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:34.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.267 --rc genhtml_branch_coverage=1 00:05:34.267 --rc genhtml_function_coverage=1 00:05:34.267 --rc genhtml_legend=1 00:05:34.267 --rc geninfo_all_blocks=1 00:05:34.267 --rc geninfo_unexecuted_blocks=1 00:05:34.267 00:05:34.267 ' 00:05:34.267 17:25:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:34.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.267 --rc genhtml_branch_coverage=1 00:05:34.267 --rc genhtml_function_coverage=1 00:05:34.267 --rc genhtml_legend=1 00:05:34.267 --rc geninfo_all_blocks=1 00:05:34.267 --rc geninfo_unexecuted_blocks=1 00:05:34.267 00:05:34.267 ' 00:05:34.267 17:25:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:34.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.267 --rc genhtml_branch_coverage=1 00:05:34.267 --rc genhtml_function_coverage=1 00:05:34.267 --rc genhtml_legend=1 00:05:34.267 --rc geninfo_all_blocks=1 00:05:34.267 --rc geninfo_unexecuted_blocks=1 00:05:34.267 00:05:34.267 ' 00:05:34.267 17:25:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:34.267 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.267 --rc genhtml_branch_coverage=1 00:05:34.267 --rc genhtml_function_coverage=1 00:05:34.267 --rc genhtml_legend=1 00:05:34.267 --rc geninfo_all_blocks=1 00:05:34.267 --rc geninfo_unexecuted_blocks=1 00:05:34.267 00:05:34.267 ' 00:05:34.267 17:25:11 -- rpc/rpc.sh@65 -- # spdk_pid=1457077 00:05:34.267 17:25:11 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:34.267 17:25:11 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:34.267 17:25:11 -- rpc/rpc.sh@67 -- # waitforlisten 1457077 00:05:34.267 17:25:11 -- common/autotest_common.sh@829 -- # '[' -z 1457077 ']' 00:05:34.267 17:25:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.267 17:25:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:34.267 17:25:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.267 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.267 17:25:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:34.267 17:25:11 -- common/autotest_common.sh@10 -- # set +x 00:05:34.267 [2024-11-16 17:25:11.556735] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.267 [2024-11-16 17:25:11.556832] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1457077 ] 00:05:34.267 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.267 [2024-11-16 17:25:11.615995] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.267 [2024-11-16 17:25:11.709853] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.267 [2024-11-16 17:25:11.710002] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:34.267 [2024-11-16 17:25:11.710020] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1457077' to capture a snapshot of events at runtime. 00:05:34.267 [2024-11-16 17:25:11.710032] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1457077 for offline analysis/debug. 00:05:34.267 [2024-11-16 17:25:11.710060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.204 17:25:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:35.204 17:25:12 -- common/autotest_common.sh@862 -- # return 0 00:05:35.204 17:25:12 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:35.204 17:25:12 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:35.204 17:25:12 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:35.204 17:25:12 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:35.204 17:25:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.204 17:25:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.204 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.204 ************************************ 00:05:35.204 START TEST rpc_integrity 00:05:35.204 ************************************ 00:05:35.204 17:25:12 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:35.204 17:25:12 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:35.204 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.204 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.204 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.204 17:25:12 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:35.204 17:25:12 -- rpc/rpc.sh@13 -- # jq length 00:05:35.204 17:25:12 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:35.204 17:25:12 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:35.204 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.204 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.204 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.204 17:25:12 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:35.204 17:25:12 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:35.204 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.204 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.204 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.204 17:25:12 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:35.204 { 00:05:35.204 "name": "Malloc0", 00:05:35.204 "aliases": [ 00:05:35.204 "6e805443-655a-44ef-83a7-d6c097dad5bd" 00:05:35.204 ], 00:05:35.204 "product_name": "Malloc disk", 00:05:35.204 "block_size": 512, 00:05:35.204 "num_blocks": 16384, 00:05:35.204 "uuid": "6e805443-655a-44ef-83a7-d6c097dad5bd", 00:05:35.205 "assigned_rate_limits": { 00:05:35.205 "rw_ios_per_sec": 0, 00:05:35.205 "rw_mbytes_per_sec": 0, 00:05:35.205 "r_mbytes_per_sec": 0, 00:05:35.205 "w_mbytes_per_sec": 0 00:05:35.205 }, 00:05:35.205 "claimed": false, 00:05:35.205 "zoned": false, 00:05:35.205 "supported_io_types": { 00:05:35.205 "read": true, 00:05:35.205 "write": true, 00:05:35.205 "unmap": true, 00:05:35.205 "write_zeroes": true, 00:05:35.205 "flush": true, 00:05:35.205 "reset": true, 00:05:35.205 "compare": false, 00:05:35.205 "compare_and_write": false, 00:05:35.205 "abort": true, 00:05:35.205 "nvme_admin": false, 00:05:35.205 "nvme_io": false 00:05:35.205 }, 00:05:35.205 "memory_domains": [ 00:05:35.205 { 00:05:35.205 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.205 "dma_device_type": 2 00:05:35.205 } 00:05:35.205 ], 00:05:35.205 "driver_specific": {} 00:05:35.205 } 00:05:35.205 ]' 00:05:35.205 17:25:12 -- rpc/rpc.sh@17 -- # jq length 00:05:35.205 17:25:12 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:35.205 17:25:12 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:35.205 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.205 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.205 [2024-11-16 17:25:12.628511] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:35.205 [2024-11-16 17:25:12.628559] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:35.205 [2024-11-16 17:25:12.628584] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1c2abf0 00:05:35.205 [2024-11-16 17:25:12.628599] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:35.205 [2024-11-16 17:25:12.630128] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:35.205 [2024-11-16 17:25:12.630155] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:35.205 Passthru0 00:05:35.205 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.205 17:25:12 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:35.205 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.205 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.205 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.205 17:25:12 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:35.205 { 00:05:35.205 "name": "Malloc0", 00:05:35.205 "aliases": [ 00:05:35.205 "6e805443-655a-44ef-83a7-d6c097dad5bd" 00:05:35.205 ], 00:05:35.205 "product_name": "Malloc disk", 00:05:35.205 "block_size": 512, 00:05:35.205 "num_blocks": 16384, 00:05:35.205 "uuid": "6e805443-655a-44ef-83a7-d6c097dad5bd", 00:05:35.205 "assigned_rate_limits": { 00:05:35.205 "rw_ios_per_sec": 0, 00:05:35.205 "rw_mbytes_per_sec": 0, 00:05:35.205 "r_mbytes_per_sec": 0, 00:05:35.205 "w_mbytes_per_sec": 0 00:05:35.205 }, 00:05:35.205 "claimed": true, 00:05:35.205 "claim_type": "exclusive_write", 00:05:35.205 "zoned": false, 00:05:35.205 "supported_io_types": { 00:05:35.205 "read": true, 00:05:35.205 "write": true, 00:05:35.205 "unmap": true, 00:05:35.205 "write_zeroes": true, 00:05:35.205 "flush": true, 00:05:35.205 "reset": true, 00:05:35.205 "compare": false, 00:05:35.205 "compare_and_write": false, 00:05:35.205 "abort": true, 00:05:35.205 "nvme_admin": false, 00:05:35.205 "nvme_io": false 00:05:35.205 }, 00:05:35.205 "memory_domains": [ 00:05:35.205 { 00:05:35.205 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.205 "dma_device_type": 2 00:05:35.205 } 00:05:35.205 ], 00:05:35.205 "driver_specific": {} 00:05:35.205 }, 00:05:35.205 { 00:05:35.205 "name": "Passthru0", 00:05:35.205 "aliases": [ 00:05:35.205 "59dbd1c9-2bfe-52eb-99ec-13d1361a03a6" 00:05:35.205 ], 00:05:35.205 "product_name": "passthru", 00:05:35.205 "block_size": 512, 00:05:35.205 "num_blocks": 16384, 00:05:35.205 "uuid": "59dbd1c9-2bfe-52eb-99ec-13d1361a03a6", 00:05:35.205 "assigned_rate_limits": { 00:05:35.205 "rw_ios_per_sec": 0, 00:05:35.205 "rw_mbytes_per_sec": 0, 00:05:35.205 "r_mbytes_per_sec": 0, 00:05:35.205 "w_mbytes_per_sec": 0 00:05:35.205 }, 00:05:35.205 "claimed": false, 00:05:35.205 "zoned": false, 00:05:35.205 "supported_io_types": { 00:05:35.205 "read": true, 00:05:35.205 "write": true, 00:05:35.205 "unmap": true, 00:05:35.205 "write_zeroes": true, 00:05:35.205 "flush": true, 00:05:35.205 "reset": true, 00:05:35.205 "compare": false, 00:05:35.205 "compare_and_write": false, 00:05:35.205 "abort": true, 00:05:35.205 "nvme_admin": false, 00:05:35.205 "nvme_io": false 00:05:35.205 }, 00:05:35.205 "memory_domains": [ 00:05:35.205 { 00:05:35.205 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.205 "dma_device_type": 2 00:05:35.205 } 00:05:35.205 ], 00:05:35.205 "driver_specific": { 00:05:35.205 "passthru": { 00:05:35.205 "name": "Passthru0", 00:05:35.205 "base_bdev_name": "Malloc0" 00:05:35.205 } 00:05:35.205 } 00:05:35.205 } 00:05:35.205 ]' 00:05:35.205 17:25:12 -- rpc/rpc.sh@21 -- # jq length 00:05:35.205 17:25:12 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:35.205 17:25:12 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:35.205 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.205 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.205 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.205 17:25:12 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:35.205 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.205 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.465 17:25:12 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:35.465 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.465 17:25:12 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:35.465 17:25:12 -- rpc/rpc.sh@26 -- # jq length 00:05:35.465 17:25:12 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:35.465 00:05:35.465 real 0m0.225s 00:05:35.465 user 0m0.148s 00:05:35.465 sys 0m0.019s 00:05:35.465 17:25:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 ************************************ 00:05:35.465 END TEST rpc_integrity 00:05:35.465 ************************************ 00:05:35.465 17:25:12 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:35.465 17:25:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.465 17:25:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 ************************************ 00:05:35.465 START TEST rpc_plugins 00:05:35.465 ************************************ 00:05:35.465 17:25:12 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:35.465 17:25:12 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:35.465 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.465 17:25:12 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:35.465 17:25:12 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:35.465 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.465 17:25:12 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:35.465 { 00:05:35.465 "name": "Malloc1", 00:05:35.465 "aliases": [ 00:05:35.465 "a6d1ba68-757e-4a28-b5fd-9cd8ecfbcaef" 00:05:35.465 ], 00:05:35.465 "product_name": "Malloc disk", 00:05:35.465 "block_size": 4096, 00:05:35.465 "num_blocks": 256, 00:05:35.465 "uuid": "a6d1ba68-757e-4a28-b5fd-9cd8ecfbcaef", 00:05:35.465 "assigned_rate_limits": { 00:05:35.465 "rw_ios_per_sec": 0, 00:05:35.465 "rw_mbytes_per_sec": 0, 00:05:35.465 "r_mbytes_per_sec": 0, 00:05:35.465 "w_mbytes_per_sec": 0 00:05:35.465 }, 00:05:35.465 "claimed": false, 00:05:35.465 "zoned": false, 00:05:35.465 "supported_io_types": { 00:05:35.465 "read": true, 00:05:35.465 "write": true, 00:05:35.465 "unmap": true, 00:05:35.465 "write_zeroes": true, 00:05:35.465 "flush": true, 00:05:35.465 "reset": true, 00:05:35.465 "compare": false, 00:05:35.465 "compare_and_write": false, 00:05:35.465 "abort": true, 00:05:35.465 "nvme_admin": false, 00:05:35.465 "nvme_io": false 00:05:35.465 }, 00:05:35.465 "memory_domains": [ 00:05:35.465 { 00:05:35.465 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.465 "dma_device_type": 2 00:05:35.465 } 00:05:35.465 ], 00:05:35.465 "driver_specific": {} 00:05:35.465 } 00:05:35.465 ]' 00:05:35.465 17:25:12 -- rpc/rpc.sh@32 -- # jq length 00:05:35.465 17:25:12 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:35.465 17:25:12 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:35.465 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.465 17:25:12 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:35.465 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.465 17:25:12 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:35.465 17:25:12 -- rpc/rpc.sh@36 -- # jq length 00:05:35.465 17:25:12 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:35.465 00:05:35.465 real 0m0.112s 00:05:35.465 user 0m0.071s 00:05:35.465 sys 0m0.013s 00:05:35.465 17:25:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 ************************************ 00:05:35.465 END TEST rpc_plugins 00:05:35.465 ************************************ 00:05:35.465 17:25:12 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:35.465 17:25:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.465 17:25:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 ************************************ 00:05:35.465 START TEST rpc_trace_cmd_test 00:05:35.465 ************************************ 00:05:35.465 17:25:12 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:35.465 17:25:12 -- rpc/rpc.sh@40 -- # local info 00:05:35.465 17:25:12 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:35.465 17:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.465 17:25:12 -- common/autotest_common.sh@10 -- # set +x 00:05:35.465 17:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.465 17:25:12 -- rpc/rpc.sh@42 -- # info='{ 00:05:35.465 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1457077", 00:05:35.465 "tpoint_group_mask": "0x8", 00:05:35.465 "iscsi_conn": { 00:05:35.466 "mask": "0x2", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "scsi": { 00:05:35.466 "mask": "0x4", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "bdev": { 00:05:35.466 "mask": "0x8", 00:05:35.466 "tpoint_mask": "0xffffffffffffffff" 00:05:35.466 }, 00:05:35.466 "nvmf_rdma": { 00:05:35.466 "mask": "0x10", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "nvmf_tcp": { 00:05:35.466 "mask": "0x20", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "ftl": { 00:05:35.466 "mask": "0x40", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "blobfs": { 00:05:35.466 "mask": "0x80", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "dsa": { 00:05:35.466 "mask": "0x200", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "thread": { 00:05:35.466 "mask": "0x400", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "nvme_pcie": { 00:05:35.466 "mask": "0x800", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "iaa": { 00:05:35.466 "mask": "0x1000", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "nvme_tcp": { 00:05:35.466 "mask": "0x2000", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 }, 00:05:35.466 "bdev_nvme": { 00:05:35.466 "mask": "0x4000", 00:05:35.466 "tpoint_mask": "0x0" 00:05:35.466 } 00:05:35.466 }' 00:05:35.466 17:25:12 -- rpc/rpc.sh@43 -- # jq length 00:05:35.726 17:25:12 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:35.726 17:25:12 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:35.726 17:25:12 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:35.726 17:25:13 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:35.726 17:25:13 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:35.726 17:25:13 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:35.726 17:25:13 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:35.726 17:25:13 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:35.726 17:25:13 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:35.726 00:05:35.726 real 0m0.201s 00:05:35.726 user 0m0.172s 00:05:35.726 sys 0m0.020s 00:05:35.726 17:25:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.726 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.726 ************************************ 00:05:35.726 END TEST rpc_trace_cmd_test 00:05:35.726 ************************************ 00:05:35.726 17:25:13 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:35.726 17:25:13 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:35.726 17:25:13 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:35.726 17:25:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.726 17:25:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.726 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.726 ************************************ 00:05:35.726 START TEST rpc_daemon_integrity 00:05:35.726 ************************************ 00:05:35.726 17:25:13 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:35.726 17:25:13 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:35.726 17:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.726 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.726 17:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.726 17:25:13 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:35.726 17:25:13 -- rpc/rpc.sh@13 -- # jq length 00:05:35.726 17:25:13 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:35.726 17:25:13 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:35.726 17:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.726 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.726 17:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.726 17:25:13 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:35.726 17:25:13 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:35.726 17:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.726 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.726 17:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.726 17:25:13 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:35.726 { 00:05:35.726 "name": "Malloc2", 00:05:35.726 "aliases": [ 00:05:35.726 "87fd67d1-605a-4d61-8276-80963ddf6769" 00:05:35.726 ], 00:05:35.726 "product_name": "Malloc disk", 00:05:35.726 "block_size": 512, 00:05:35.726 "num_blocks": 16384, 00:05:35.726 "uuid": "87fd67d1-605a-4d61-8276-80963ddf6769", 00:05:35.726 "assigned_rate_limits": { 00:05:35.726 "rw_ios_per_sec": 0, 00:05:35.726 "rw_mbytes_per_sec": 0, 00:05:35.726 "r_mbytes_per_sec": 0, 00:05:35.726 "w_mbytes_per_sec": 0 00:05:35.726 }, 00:05:35.726 "claimed": false, 00:05:35.726 "zoned": false, 00:05:35.726 "supported_io_types": { 00:05:35.726 "read": true, 00:05:35.726 "write": true, 00:05:35.726 "unmap": true, 00:05:35.726 "write_zeroes": true, 00:05:35.726 "flush": true, 00:05:35.726 "reset": true, 00:05:35.726 "compare": false, 00:05:35.726 "compare_and_write": false, 00:05:35.726 "abort": true, 00:05:35.726 "nvme_admin": false, 00:05:35.726 "nvme_io": false 00:05:35.726 }, 00:05:35.726 "memory_domains": [ 00:05:35.726 { 00:05:35.726 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.726 "dma_device_type": 2 00:05:35.726 } 00:05:35.726 ], 00:05:35.727 "driver_specific": {} 00:05:35.727 } 00:05:35.727 ]' 00:05:35.727 17:25:13 -- rpc/rpc.sh@17 -- # jq length 00:05:35.987 17:25:13 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:35.987 17:25:13 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:35.987 17:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.987 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.987 [2024-11-16 17:25:13.242306] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:35.987 [2024-11-16 17:25:13.242352] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:35.987 [2024-11-16 17:25:13.242375] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1dca940 00:05:35.987 [2024-11-16 17:25:13.242391] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:35.988 [2024-11-16 17:25:13.243740] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:35.988 [2024-11-16 17:25:13.243765] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:35.988 Passthru0 00:05:35.988 17:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.988 17:25:13 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:35.988 17:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.988 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.988 17:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.988 17:25:13 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:35.988 { 00:05:35.988 "name": "Malloc2", 00:05:35.988 "aliases": [ 00:05:35.988 "87fd67d1-605a-4d61-8276-80963ddf6769" 00:05:35.988 ], 00:05:35.988 "product_name": "Malloc disk", 00:05:35.988 "block_size": 512, 00:05:35.988 "num_blocks": 16384, 00:05:35.988 "uuid": "87fd67d1-605a-4d61-8276-80963ddf6769", 00:05:35.988 "assigned_rate_limits": { 00:05:35.988 "rw_ios_per_sec": 0, 00:05:35.988 "rw_mbytes_per_sec": 0, 00:05:35.988 "r_mbytes_per_sec": 0, 00:05:35.988 "w_mbytes_per_sec": 0 00:05:35.988 }, 00:05:35.988 "claimed": true, 00:05:35.988 "claim_type": "exclusive_write", 00:05:35.988 "zoned": false, 00:05:35.988 "supported_io_types": { 00:05:35.988 "read": true, 00:05:35.988 "write": true, 00:05:35.988 "unmap": true, 00:05:35.988 "write_zeroes": true, 00:05:35.988 "flush": true, 00:05:35.988 "reset": true, 00:05:35.988 "compare": false, 00:05:35.988 "compare_and_write": false, 00:05:35.988 "abort": true, 00:05:35.988 "nvme_admin": false, 00:05:35.988 "nvme_io": false 00:05:35.988 }, 00:05:35.988 "memory_domains": [ 00:05:35.988 { 00:05:35.988 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.988 "dma_device_type": 2 00:05:35.988 } 00:05:35.988 ], 00:05:35.988 "driver_specific": {} 00:05:35.988 }, 00:05:35.988 { 00:05:35.988 "name": "Passthru0", 00:05:35.988 "aliases": [ 00:05:35.988 "52db0147-c0f3-5e5a-b8f1-56f601adeb0e" 00:05:35.988 ], 00:05:35.988 "product_name": "passthru", 00:05:35.988 "block_size": 512, 00:05:35.988 "num_blocks": 16384, 00:05:35.988 "uuid": "52db0147-c0f3-5e5a-b8f1-56f601adeb0e", 00:05:35.988 "assigned_rate_limits": { 00:05:35.988 "rw_ios_per_sec": 0, 00:05:35.988 "rw_mbytes_per_sec": 0, 00:05:35.988 "r_mbytes_per_sec": 0, 00:05:35.988 "w_mbytes_per_sec": 0 00:05:35.988 }, 00:05:35.988 "claimed": false, 00:05:35.988 "zoned": false, 00:05:35.988 "supported_io_types": { 00:05:35.988 "read": true, 00:05:35.988 "write": true, 00:05:35.988 "unmap": true, 00:05:35.988 "write_zeroes": true, 00:05:35.988 "flush": true, 00:05:35.988 "reset": true, 00:05:35.988 "compare": false, 00:05:35.988 "compare_and_write": false, 00:05:35.988 "abort": true, 00:05:35.988 "nvme_admin": false, 00:05:35.988 "nvme_io": false 00:05:35.988 }, 00:05:35.988 "memory_domains": [ 00:05:35.988 { 00:05:35.988 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.988 "dma_device_type": 2 00:05:35.988 } 00:05:35.988 ], 00:05:35.988 "driver_specific": { 00:05:35.988 "passthru": { 00:05:35.988 "name": "Passthru0", 00:05:35.988 "base_bdev_name": "Malloc2" 00:05:35.988 } 00:05:35.988 } 00:05:35.988 } 00:05:35.988 ]' 00:05:35.988 17:25:13 -- rpc/rpc.sh@21 -- # jq length 00:05:35.988 17:25:13 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:35.988 17:25:13 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:35.988 17:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.988 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.988 17:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.988 17:25:13 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:35.988 17:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.988 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.988 17:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.988 17:25:13 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:35.988 17:25:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.988 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.988 17:25:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.988 17:25:13 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:35.988 17:25:13 -- rpc/rpc.sh@26 -- # jq length 00:05:35.988 17:25:13 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:35.988 00:05:35.988 real 0m0.232s 00:05:35.988 user 0m0.157s 00:05:35.988 sys 0m0.018s 00:05:35.988 17:25:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.988 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:35.988 ************************************ 00:05:35.988 END TEST rpc_daemon_integrity 00:05:35.988 ************************************ 00:05:35.988 17:25:13 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:35.988 17:25:13 -- rpc/rpc.sh@84 -- # killprocess 1457077 00:05:35.988 17:25:13 -- common/autotest_common.sh@936 -- # '[' -z 1457077 ']' 00:05:35.988 17:25:13 -- common/autotest_common.sh@940 -- # kill -0 1457077 00:05:35.988 17:25:13 -- common/autotest_common.sh@941 -- # uname 00:05:35.988 17:25:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.988 17:25:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1457077 00:05:35.988 17:25:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.988 17:25:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.988 17:25:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1457077' 00:05:35.988 killing process with pid 1457077 00:05:35.988 17:25:13 -- common/autotest_common.sh@955 -- # kill 1457077 00:05:35.988 17:25:13 -- common/autotest_common.sh@960 -- # wait 1457077 00:05:36.557 00:05:36.557 real 0m2.486s 00:05:36.557 user 0m3.147s 00:05:36.557 sys 0m0.603s 00:05:36.557 17:25:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.557 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:36.557 ************************************ 00:05:36.557 END TEST rpc 00:05:36.557 ************************************ 00:05:36.557 17:25:13 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:36.557 17:25:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.557 17:25:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.557 17:25:13 -- common/autotest_common.sh@10 -- # set +x 00:05:36.557 ************************************ 00:05:36.557 START TEST rpc_client 00:05:36.557 ************************************ 00:05:36.557 17:25:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:36.557 * Looking for test storage... 00:05:36.557 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:36.557 17:25:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.557 17:25:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.557 17:25:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.557 17:25:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.557 17:25:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.557 17:25:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.557 17:25:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.557 17:25:13 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.557 17:25:13 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.557 17:25:13 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.557 17:25:13 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.557 17:25:13 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.557 17:25:13 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.557 17:25:13 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.557 17:25:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.557 17:25:13 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.557 17:25:13 -- scripts/common.sh@344 -- # : 1 00:05:36.557 17:25:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.557 17:25:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.557 17:25:13 -- scripts/common.sh@364 -- # decimal 1 00:05:36.557 17:25:14 -- scripts/common.sh@352 -- # local d=1 00:05:36.557 17:25:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.557 17:25:14 -- scripts/common.sh@354 -- # echo 1 00:05:36.557 17:25:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.557 17:25:14 -- scripts/common.sh@365 -- # decimal 2 00:05:36.557 17:25:14 -- scripts/common.sh@352 -- # local d=2 00:05:36.557 17:25:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.557 17:25:14 -- scripts/common.sh@354 -- # echo 2 00:05:36.557 17:25:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.557 17:25:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.557 17:25:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.557 17:25:14 -- scripts/common.sh@367 -- # return 0 00:05:36.557 17:25:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.557 17:25:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.557 --rc genhtml_branch_coverage=1 00:05:36.557 --rc genhtml_function_coverage=1 00:05:36.557 --rc genhtml_legend=1 00:05:36.557 --rc geninfo_all_blocks=1 00:05:36.557 --rc geninfo_unexecuted_blocks=1 00:05:36.557 00:05:36.557 ' 00:05:36.557 17:25:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.557 --rc genhtml_branch_coverage=1 00:05:36.557 --rc genhtml_function_coverage=1 00:05:36.557 --rc genhtml_legend=1 00:05:36.557 --rc geninfo_all_blocks=1 00:05:36.557 --rc geninfo_unexecuted_blocks=1 00:05:36.557 00:05:36.557 ' 00:05:36.557 17:25:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.557 --rc genhtml_branch_coverage=1 00:05:36.557 --rc genhtml_function_coverage=1 00:05:36.557 --rc genhtml_legend=1 00:05:36.557 --rc geninfo_all_blocks=1 00:05:36.557 --rc geninfo_unexecuted_blocks=1 00:05:36.557 00:05:36.557 ' 00:05:36.557 17:25:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.557 --rc genhtml_branch_coverage=1 00:05:36.557 --rc genhtml_function_coverage=1 00:05:36.557 --rc genhtml_legend=1 00:05:36.557 --rc geninfo_all_blocks=1 00:05:36.557 --rc geninfo_unexecuted_blocks=1 00:05:36.557 00:05:36.557 ' 00:05:36.558 17:25:14 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:36.558 OK 00:05:36.558 17:25:14 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:36.558 00:05:36.558 real 0m0.152s 00:05:36.558 user 0m0.103s 00:05:36.558 sys 0m0.058s 00:05:36.558 17:25:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.558 17:25:14 -- common/autotest_common.sh@10 -- # set +x 00:05:36.558 ************************************ 00:05:36.558 END TEST rpc_client 00:05:36.558 ************************************ 00:05:36.558 17:25:14 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:36.558 17:25:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.558 17:25:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.558 17:25:14 -- common/autotest_common.sh@10 -- # set +x 00:05:36.558 ************************************ 00:05:36.558 START TEST json_config 00:05:36.558 ************************************ 00:05:36.558 17:25:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:36.817 17:25:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.817 17:25:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.817 17:25:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.817 17:25:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.817 17:25:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.817 17:25:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.817 17:25:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.817 17:25:14 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.817 17:25:14 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.817 17:25:14 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.817 17:25:14 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.817 17:25:14 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.817 17:25:14 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.817 17:25:14 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.817 17:25:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.817 17:25:14 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.817 17:25:14 -- scripts/common.sh@344 -- # : 1 00:05:36.817 17:25:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.817 17:25:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.817 17:25:14 -- scripts/common.sh@364 -- # decimal 1 00:05:36.817 17:25:14 -- scripts/common.sh@352 -- # local d=1 00:05:36.817 17:25:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.817 17:25:14 -- scripts/common.sh@354 -- # echo 1 00:05:36.817 17:25:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.817 17:25:14 -- scripts/common.sh@365 -- # decimal 2 00:05:36.817 17:25:14 -- scripts/common.sh@352 -- # local d=2 00:05:36.817 17:25:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.817 17:25:14 -- scripts/common.sh@354 -- # echo 2 00:05:36.817 17:25:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.817 17:25:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.817 17:25:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.817 17:25:14 -- scripts/common.sh@367 -- # return 0 00:05:36.817 17:25:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.817 17:25:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.817 --rc genhtml_branch_coverage=1 00:05:36.817 --rc genhtml_function_coverage=1 00:05:36.817 --rc genhtml_legend=1 00:05:36.817 --rc geninfo_all_blocks=1 00:05:36.817 --rc geninfo_unexecuted_blocks=1 00:05:36.817 00:05:36.817 ' 00:05:36.817 17:25:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.817 --rc genhtml_branch_coverage=1 00:05:36.817 --rc genhtml_function_coverage=1 00:05:36.817 --rc genhtml_legend=1 00:05:36.817 --rc geninfo_all_blocks=1 00:05:36.817 --rc geninfo_unexecuted_blocks=1 00:05:36.817 00:05:36.817 ' 00:05:36.817 17:25:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.817 --rc genhtml_branch_coverage=1 00:05:36.817 --rc genhtml_function_coverage=1 00:05:36.817 --rc genhtml_legend=1 00:05:36.817 --rc geninfo_all_blocks=1 00:05:36.817 --rc geninfo_unexecuted_blocks=1 00:05:36.817 00:05:36.817 ' 00:05:36.817 17:25:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.817 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.817 --rc genhtml_branch_coverage=1 00:05:36.817 --rc genhtml_function_coverage=1 00:05:36.817 --rc genhtml_legend=1 00:05:36.817 --rc geninfo_all_blocks=1 00:05:36.817 --rc geninfo_unexecuted_blocks=1 00:05:36.817 00:05:36.817 ' 00:05:36.817 17:25:14 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:36.817 17:25:14 -- nvmf/common.sh@7 -- # uname -s 00:05:36.817 17:25:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:36.817 17:25:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:36.817 17:25:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:36.817 17:25:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:36.817 17:25:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:36.817 17:25:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:36.817 17:25:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:36.817 17:25:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:36.817 17:25:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:36.817 17:25:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:36.817 17:25:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:36.817 17:25:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:36.817 17:25:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:36.817 17:25:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:36.817 17:25:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:36.817 17:25:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:36.817 17:25:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:36.817 17:25:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:36.817 17:25:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:36.817 17:25:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.817 17:25:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.817 17:25:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.817 17:25:14 -- paths/export.sh@5 -- # export PATH 00:05:36.817 17:25:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.817 17:25:14 -- nvmf/common.sh@46 -- # : 0 00:05:36.817 17:25:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:36.817 17:25:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:36.817 17:25:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:36.817 17:25:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:36.817 17:25:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:36.817 17:25:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:36.817 17:25:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:36.817 17:25:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:36.817 17:25:14 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:36.817 17:25:14 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:36.817 17:25:14 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:36.817 17:25:14 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:36.817 17:25:14 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:36.817 17:25:14 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:36.817 17:25:14 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:36.817 17:25:14 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:36.817 17:25:14 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:36.817 17:25:14 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:36.817 17:25:14 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:36.817 17:25:14 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:36.817 17:25:14 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:36.817 17:25:14 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:36.817 17:25:14 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:36.817 INFO: JSON configuration test init 00:05:36.817 17:25:14 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:36.817 17:25:14 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:36.817 17:25:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:36.817 17:25:14 -- common/autotest_common.sh@10 -- # set +x 00:05:36.817 17:25:14 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:36.818 17:25:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:36.818 17:25:14 -- common/autotest_common.sh@10 -- # set +x 00:05:36.818 17:25:14 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:36.818 17:25:14 -- json_config/json_config.sh@98 -- # local app=target 00:05:36.818 17:25:14 -- json_config/json_config.sh@99 -- # shift 00:05:36.818 17:25:14 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:36.818 17:25:14 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:36.818 17:25:14 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:36.818 17:25:14 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:36.818 17:25:14 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:36.818 17:25:14 -- json_config/json_config.sh@111 -- # app_pid[$app]=1457580 00:05:36.818 17:25:14 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:36.818 17:25:14 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:36.818 Waiting for target to run... 00:05:36.818 17:25:14 -- json_config/json_config.sh@114 -- # waitforlisten 1457580 /var/tmp/spdk_tgt.sock 00:05:36.818 17:25:14 -- common/autotest_common.sh@829 -- # '[' -z 1457580 ']' 00:05:36.818 17:25:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:36.818 17:25:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:36.818 17:25:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:36.818 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:36.818 17:25:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:36.818 17:25:14 -- common/autotest_common.sh@10 -- # set +x 00:05:36.818 [2024-11-16 17:25:14.251957] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.818 [2024-11-16 17:25:14.252036] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1457580 ] 00:05:36.818 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.386 [2024-11-16 17:25:14.776238] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.386 [2024-11-16 17:25:14.855909] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:37.386 [2024-11-16 17:25:14.856127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.954 17:25:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:37.954 17:25:15 -- common/autotest_common.sh@862 -- # return 0 00:05:37.954 17:25:15 -- json_config/json_config.sh@115 -- # echo '' 00:05:37.954 00:05:37.954 17:25:15 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:37.954 17:25:15 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:37.954 17:25:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:37.954 17:25:15 -- common/autotest_common.sh@10 -- # set +x 00:05:37.954 17:25:15 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:37.954 17:25:15 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:37.954 17:25:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:37.954 17:25:15 -- common/autotest_common.sh@10 -- # set +x 00:05:37.954 17:25:15 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:37.954 17:25:15 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:37.954 17:25:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:41.248 17:25:18 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:41.248 17:25:18 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:41.248 17:25:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:41.248 17:25:18 -- common/autotest_common.sh@10 -- # set +x 00:05:41.248 17:25:18 -- json_config/json_config.sh@48 -- # local ret=0 00:05:41.248 17:25:18 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:41.248 17:25:18 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:41.248 17:25:18 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:41.248 17:25:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:41.248 17:25:18 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:41.248 17:25:18 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:41.248 17:25:18 -- json_config/json_config.sh@51 -- # local get_types 00:05:41.248 17:25:18 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:41.248 17:25:18 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:41.248 17:25:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:41.248 17:25:18 -- common/autotest_common.sh@10 -- # set +x 00:05:41.248 17:25:18 -- json_config/json_config.sh@58 -- # return 0 00:05:41.248 17:25:18 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:41.248 17:25:18 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:41.248 17:25:18 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:41.248 17:25:18 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:41.248 17:25:18 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:41.248 17:25:18 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:41.248 17:25:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:41.248 17:25:18 -- common/autotest_common.sh@10 -- # set +x 00:05:41.248 17:25:18 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:41.248 17:25:18 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:41.248 17:25:18 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:41.248 17:25:18 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:41.248 17:25:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:41.506 MallocForNvmf0 00:05:41.506 17:25:18 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:41.506 17:25:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:41.764 MallocForNvmf1 00:05:41.764 17:25:19 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:41.764 17:25:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:42.022 [2024-11-16 17:25:19.399159] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:42.022 17:25:19 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:42.022 17:25:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:42.280 17:25:19 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:42.280 17:25:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:42.537 17:25:19 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:42.537 17:25:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:42.795 17:25:20 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:42.795 17:25:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:43.053 [2024-11-16 17:25:20.406468] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:43.053 17:25:20 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:43.053 17:25:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:43.053 17:25:20 -- common/autotest_common.sh@10 -- # set +x 00:05:43.053 17:25:20 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:43.053 17:25:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:43.053 17:25:20 -- common/autotest_common.sh@10 -- # set +x 00:05:43.053 17:25:20 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:43.054 17:25:20 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:43.054 17:25:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:43.311 MallocBdevForConfigChangeCheck 00:05:43.311 17:25:20 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:43.311 17:25:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:43.311 17:25:20 -- common/autotest_common.sh@10 -- # set +x 00:05:43.312 17:25:20 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:43.312 17:25:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:43.880 17:25:21 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:43.880 INFO: shutting down applications... 00:05:43.880 17:25:21 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:43.880 17:25:21 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:43.880 17:25:21 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:43.880 17:25:21 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:45.783 Calling clear_iscsi_subsystem 00:05:45.783 Calling clear_nvmf_subsystem 00:05:45.783 Calling clear_nbd_subsystem 00:05:45.783 Calling clear_ublk_subsystem 00:05:45.783 Calling clear_vhost_blk_subsystem 00:05:45.783 Calling clear_vhost_scsi_subsystem 00:05:45.783 Calling clear_scheduler_subsystem 00:05:45.783 Calling clear_bdev_subsystem 00:05:45.783 Calling clear_accel_subsystem 00:05:45.783 Calling clear_vmd_subsystem 00:05:45.783 Calling clear_sock_subsystem 00:05:45.783 Calling clear_iobuf_subsystem 00:05:45.783 17:25:22 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:45.783 17:25:22 -- json_config/json_config.sh@396 -- # count=100 00:05:45.784 17:25:22 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:45.784 17:25:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:45.784 17:25:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:45.784 17:25:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:45.784 17:25:23 -- json_config/json_config.sh@398 -- # break 00:05:45.784 17:25:23 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:45.784 17:25:23 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:45.784 17:25:23 -- json_config/json_config.sh@120 -- # local app=target 00:05:45.784 17:25:23 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:45.784 17:25:23 -- json_config/json_config.sh@124 -- # [[ -n 1457580 ]] 00:05:45.784 17:25:23 -- json_config/json_config.sh@127 -- # kill -SIGINT 1457580 00:05:45.784 17:25:23 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:45.784 17:25:23 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:45.784 17:25:23 -- json_config/json_config.sh@130 -- # kill -0 1457580 00:05:45.784 17:25:23 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:46.352 17:25:23 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:46.352 17:25:23 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:46.352 17:25:23 -- json_config/json_config.sh@130 -- # kill -0 1457580 00:05:46.352 17:25:23 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:46.353 17:25:23 -- json_config/json_config.sh@132 -- # break 00:05:46.353 17:25:23 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:46.353 17:25:23 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:46.353 SPDK target shutdown done 00:05:46.353 17:25:23 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:46.353 INFO: relaunching applications... 00:05:46.353 17:25:23 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:46.353 17:25:23 -- json_config/json_config.sh@98 -- # local app=target 00:05:46.353 17:25:23 -- json_config/json_config.sh@99 -- # shift 00:05:46.353 17:25:23 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:46.353 17:25:23 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:46.353 17:25:23 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:46.353 17:25:23 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:46.353 17:25:23 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:46.353 17:25:23 -- json_config/json_config.sh@111 -- # app_pid[$app]=1458924 00:05:46.353 17:25:23 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:46.353 17:25:23 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:46.353 Waiting for target to run... 00:05:46.353 17:25:23 -- json_config/json_config.sh@114 -- # waitforlisten 1458924 /var/tmp/spdk_tgt.sock 00:05:46.353 17:25:23 -- common/autotest_common.sh@829 -- # '[' -z 1458924 ']' 00:05:46.353 17:25:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:46.353 17:25:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:46.353 17:25:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:46.353 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:46.353 17:25:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:46.353 17:25:23 -- common/autotest_common.sh@10 -- # set +x 00:05:46.353 [2024-11-16 17:25:23.695396] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.353 [2024-11-16 17:25:23.695469] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1458924 ] 00:05:46.353 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.922 [2024-11-16 17:25:24.201909] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.922 [2024-11-16 17:25:24.280690] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:46.922 [2024-11-16 17:25:24.280899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.211 [2024-11-16 17:25:27.308485] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:50.211 [2024-11-16 17:25:27.341021] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:50.211 17:25:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:50.211 17:25:27 -- common/autotest_common.sh@862 -- # return 0 00:05:50.211 17:25:27 -- json_config/json_config.sh@115 -- # echo '' 00:05:50.211 00:05:50.211 17:25:27 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:50.211 17:25:27 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:50.211 INFO: Checking if target configuration is the same... 00:05:50.211 17:25:27 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.211 17:25:27 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:50.211 17:25:27 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:50.211 + '[' 2 -ne 2 ']' 00:05:50.211 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:50.211 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:50.211 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:50.211 +++ basename /dev/fd/62 00:05:50.211 ++ mktemp /tmp/62.XXX 00:05:50.211 + tmp_file_1=/tmp/62.ruw 00:05:50.211 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.211 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:50.211 + tmp_file_2=/tmp/spdk_tgt_config.json.OAE 00:05:50.211 + ret=0 00:05:50.211 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.777 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.777 + diff -u /tmp/62.ruw /tmp/spdk_tgt_config.json.OAE 00:05:50.777 + echo 'INFO: JSON config files are the same' 00:05:50.777 INFO: JSON config files are the same 00:05:50.777 + rm /tmp/62.ruw /tmp/spdk_tgt_config.json.OAE 00:05:50.777 + exit 0 00:05:50.777 17:25:28 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:50.777 17:25:28 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:50.777 INFO: changing configuration and checking if this can be detected... 00:05:50.777 17:25:28 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:50.777 17:25:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:51.035 17:25:28 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:51.035 17:25:28 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:51.035 17:25:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:51.035 + '[' 2 -ne 2 ']' 00:05:51.035 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:51.035 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:51.035 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:51.035 +++ basename /dev/fd/62 00:05:51.035 ++ mktemp /tmp/62.XXX 00:05:51.035 + tmp_file_1=/tmp/62.mdD 00:05:51.035 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:51.035 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:51.035 + tmp_file_2=/tmp/spdk_tgt_config.json.0J1 00:05:51.035 + ret=0 00:05:51.035 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:51.293 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:51.293 + diff -u /tmp/62.mdD /tmp/spdk_tgt_config.json.0J1 00:05:51.293 + ret=1 00:05:51.293 + echo '=== Start of file: /tmp/62.mdD ===' 00:05:51.293 + cat /tmp/62.mdD 00:05:51.293 + echo '=== End of file: /tmp/62.mdD ===' 00:05:51.293 + echo '' 00:05:51.293 + echo '=== Start of file: /tmp/spdk_tgt_config.json.0J1 ===' 00:05:51.293 + cat /tmp/spdk_tgt_config.json.0J1 00:05:51.293 + echo '=== End of file: /tmp/spdk_tgt_config.json.0J1 ===' 00:05:51.293 + echo '' 00:05:51.293 + rm /tmp/62.mdD /tmp/spdk_tgt_config.json.0J1 00:05:51.293 + exit 1 00:05:51.293 17:25:28 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:51.293 INFO: configuration change detected. 00:05:51.293 17:25:28 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:51.293 17:25:28 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:51.293 17:25:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:51.293 17:25:28 -- common/autotest_common.sh@10 -- # set +x 00:05:51.293 17:25:28 -- json_config/json_config.sh@360 -- # local ret=0 00:05:51.293 17:25:28 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:51.293 17:25:28 -- json_config/json_config.sh@370 -- # [[ -n 1458924 ]] 00:05:51.293 17:25:28 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:51.293 17:25:28 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:51.293 17:25:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:51.293 17:25:28 -- common/autotest_common.sh@10 -- # set +x 00:05:51.293 17:25:28 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:51.293 17:25:28 -- json_config/json_config.sh@246 -- # uname -s 00:05:51.293 17:25:28 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:51.293 17:25:28 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:51.293 17:25:28 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:51.293 17:25:28 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:51.293 17:25:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:51.293 17:25:28 -- common/autotest_common.sh@10 -- # set +x 00:05:51.552 17:25:28 -- json_config/json_config.sh@376 -- # killprocess 1458924 00:05:51.552 17:25:28 -- common/autotest_common.sh@936 -- # '[' -z 1458924 ']' 00:05:51.552 17:25:28 -- common/autotest_common.sh@940 -- # kill -0 1458924 00:05:51.552 17:25:28 -- common/autotest_common.sh@941 -- # uname 00:05:51.552 17:25:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:51.552 17:25:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1458924 00:05:51.552 17:25:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:51.552 17:25:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:51.552 17:25:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1458924' 00:05:51.552 killing process with pid 1458924 00:05:51.552 17:25:28 -- common/autotest_common.sh@955 -- # kill 1458924 00:05:51.552 17:25:28 -- common/autotest_common.sh@960 -- # wait 1458924 00:05:52.931 17:25:30 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:52.931 17:25:30 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:52.931 17:25:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:52.931 17:25:30 -- common/autotest_common.sh@10 -- # set +x 00:05:53.191 17:25:30 -- json_config/json_config.sh@381 -- # return 0 00:05:53.191 17:25:30 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:53.191 INFO: Success 00:05:53.191 00:05:53.191 real 0m16.399s 00:05:53.191 user 0m18.759s 00:05:53.191 sys 0m2.222s 00:05:53.191 17:25:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:53.191 17:25:30 -- common/autotest_common.sh@10 -- # set +x 00:05:53.191 ************************************ 00:05:53.191 END TEST json_config 00:05:53.191 ************************************ 00:05:53.191 17:25:30 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:53.191 17:25:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:53.191 17:25:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.191 17:25:30 -- common/autotest_common.sh@10 -- # set +x 00:05:53.191 ************************************ 00:05:53.191 START TEST json_config_extra_key 00:05:53.191 ************************************ 00:05:53.191 17:25:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:53.191 17:25:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:53.191 17:25:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:53.191 17:25:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:53.191 17:25:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:53.191 17:25:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:53.191 17:25:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:53.191 17:25:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:53.191 17:25:30 -- scripts/common.sh@335 -- # IFS=.-: 00:05:53.191 17:25:30 -- scripts/common.sh@335 -- # read -ra ver1 00:05:53.191 17:25:30 -- scripts/common.sh@336 -- # IFS=.-: 00:05:53.191 17:25:30 -- scripts/common.sh@336 -- # read -ra ver2 00:05:53.191 17:25:30 -- scripts/common.sh@337 -- # local 'op=<' 00:05:53.191 17:25:30 -- scripts/common.sh@339 -- # ver1_l=2 00:05:53.191 17:25:30 -- scripts/common.sh@340 -- # ver2_l=1 00:05:53.191 17:25:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:53.191 17:25:30 -- scripts/common.sh@343 -- # case "$op" in 00:05:53.191 17:25:30 -- scripts/common.sh@344 -- # : 1 00:05:53.191 17:25:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:53.191 17:25:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:53.191 17:25:30 -- scripts/common.sh@364 -- # decimal 1 00:05:53.191 17:25:30 -- scripts/common.sh@352 -- # local d=1 00:05:53.191 17:25:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:53.191 17:25:30 -- scripts/common.sh@354 -- # echo 1 00:05:53.191 17:25:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:53.191 17:25:30 -- scripts/common.sh@365 -- # decimal 2 00:05:53.191 17:25:30 -- scripts/common.sh@352 -- # local d=2 00:05:53.191 17:25:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:53.191 17:25:30 -- scripts/common.sh@354 -- # echo 2 00:05:53.191 17:25:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:53.191 17:25:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:53.191 17:25:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:53.191 17:25:30 -- scripts/common.sh@367 -- # return 0 00:05:53.191 17:25:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:53.191 17:25:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:53.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.191 --rc genhtml_branch_coverage=1 00:05:53.191 --rc genhtml_function_coverage=1 00:05:53.191 --rc genhtml_legend=1 00:05:53.191 --rc geninfo_all_blocks=1 00:05:53.191 --rc geninfo_unexecuted_blocks=1 00:05:53.191 00:05:53.191 ' 00:05:53.191 17:25:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:53.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.191 --rc genhtml_branch_coverage=1 00:05:53.191 --rc genhtml_function_coverage=1 00:05:53.191 --rc genhtml_legend=1 00:05:53.191 --rc geninfo_all_blocks=1 00:05:53.191 --rc geninfo_unexecuted_blocks=1 00:05:53.191 00:05:53.191 ' 00:05:53.191 17:25:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:53.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.191 --rc genhtml_branch_coverage=1 00:05:53.191 --rc genhtml_function_coverage=1 00:05:53.191 --rc genhtml_legend=1 00:05:53.191 --rc geninfo_all_blocks=1 00:05:53.191 --rc geninfo_unexecuted_blocks=1 00:05:53.191 00:05:53.191 ' 00:05:53.191 17:25:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:53.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:53.191 --rc genhtml_branch_coverage=1 00:05:53.191 --rc genhtml_function_coverage=1 00:05:53.191 --rc genhtml_legend=1 00:05:53.191 --rc geninfo_all_blocks=1 00:05:53.191 --rc geninfo_unexecuted_blocks=1 00:05:53.191 00:05:53.191 ' 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:53.191 17:25:30 -- nvmf/common.sh@7 -- # uname -s 00:05:53.191 17:25:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:53.191 17:25:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:53.191 17:25:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:53.191 17:25:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:53.191 17:25:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:53.191 17:25:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:53.191 17:25:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:53.191 17:25:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:53.191 17:25:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:53.191 17:25:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:53.191 17:25:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:53.191 17:25:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:53.191 17:25:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:53.191 17:25:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:53.191 17:25:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:53.191 17:25:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:53.191 17:25:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:53.191 17:25:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:53.191 17:25:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:53.191 17:25:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.191 17:25:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.191 17:25:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.191 17:25:30 -- paths/export.sh@5 -- # export PATH 00:05:53.191 17:25:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:53.191 17:25:30 -- nvmf/common.sh@46 -- # : 0 00:05:53.191 17:25:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:53.191 17:25:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:53.191 17:25:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:53.191 17:25:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:53.191 17:25:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:53.191 17:25:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:53.191 17:25:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:53.191 17:25:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:53.191 INFO: launching applications... 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1459878 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:53.191 17:25:30 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:53.191 Waiting for target to run... 00:05:53.192 17:25:30 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1459878 /var/tmp/spdk_tgt.sock 00:05:53.192 17:25:30 -- common/autotest_common.sh@829 -- # '[' -z 1459878 ']' 00:05:53.192 17:25:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:53.192 17:25:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:53.192 17:25:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:53.192 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:53.192 17:25:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:53.192 17:25:30 -- common/autotest_common.sh@10 -- # set +x 00:05:53.192 [2024-11-16 17:25:30.647259] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.192 [2024-11-16 17:25:30.647338] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1459878 ] 00:05:53.192 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.761 [2024-11-16 17:25:31.138892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.761 [2024-11-16 17:25:31.218462] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:53.761 [2024-11-16 17:25:31.218687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:54.330 17:25:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:54.330 17:25:31 -- common/autotest_common.sh@862 -- # return 0 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:54.330 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:54.330 INFO: shutting down applications... 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1459878 ]] 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1459878 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1459878 00:05:54.330 17:25:31 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:54.901 17:25:32 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:54.901 17:25:32 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:54.901 17:25:32 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1459878 00:05:54.901 17:25:32 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:54.901 17:25:32 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:54.901 17:25:32 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:54.901 17:25:32 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:54.901 SPDK target shutdown done 00:05:54.901 17:25:32 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:54.901 Success 00:05:54.901 00:05:54.901 real 0m1.688s 00:05:54.901 user 0m1.534s 00:05:54.901 sys 0m0.611s 00:05:54.901 17:25:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.901 17:25:32 -- common/autotest_common.sh@10 -- # set +x 00:05:54.901 ************************************ 00:05:54.901 END TEST json_config_extra_key 00:05:54.901 ************************************ 00:05:54.901 17:25:32 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:54.901 17:25:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:54.901 17:25:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.901 17:25:32 -- common/autotest_common.sh@10 -- # set +x 00:05:54.901 ************************************ 00:05:54.901 START TEST alias_rpc 00:05:54.901 ************************************ 00:05:54.901 17:25:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:54.901 * Looking for test storage... 00:05:54.901 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:54.901 17:25:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:54.901 17:25:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:54.901 17:25:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:54.901 17:25:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:54.901 17:25:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:54.901 17:25:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:54.901 17:25:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:54.901 17:25:32 -- scripts/common.sh@335 -- # IFS=.-: 00:05:54.901 17:25:32 -- scripts/common.sh@335 -- # read -ra ver1 00:05:54.901 17:25:32 -- scripts/common.sh@336 -- # IFS=.-: 00:05:54.901 17:25:32 -- scripts/common.sh@336 -- # read -ra ver2 00:05:54.901 17:25:32 -- scripts/common.sh@337 -- # local 'op=<' 00:05:54.901 17:25:32 -- scripts/common.sh@339 -- # ver1_l=2 00:05:54.901 17:25:32 -- scripts/common.sh@340 -- # ver2_l=1 00:05:54.901 17:25:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:54.901 17:25:32 -- scripts/common.sh@343 -- # case "$op" in 00:05:54.901 17:25:32 -- scripts/common.sh@344 -- # : 1 00:05:54.901 17:25:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:54.901 17:25:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:54.901 17:25:32 -- scripts/common.sh@364 -- # decimal 1 00:05:54.901 17:25:32 -- scripts/common.sh@352 -- # local d=1 00:05:54.901 17:25:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:54.901 17:25:32 -- scripts/common.sh@354 -- # echo 1 00:05:54.901 17:25:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:54.901 17:25:32 -- scripts/common.sh@365 -- # decimal 2 00:05:54.901 17:25:32 -- scripts/common.sh@352 -- # local d=2 00:05:54.901 17:25:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:54.901 17:25:32 -- scripts/common.sh@354 -- # echo 2 00:05:54.901 17:25:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:54.901 17:25:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:54.901 17:25:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:54.901 17:25:32 -- scripts/common.sh@367 -- # return 0 00:05:54.901 17:25:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:54.901 17:25:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:54.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.901 --rc genhtml_branch_coverage=1 00:05:54.901 --rc genhtml_function_coverage=1 00:05:54.901 --rc genhtml_legend=1 00:05:54.901 --rc geninfo_all_blocks=1 00:05:54.901 --rc geninfo_unexecuted_blocks=1 00:05:54.901 00:05:54.901 ' 00:05:54.901 17:25:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:54.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.901 --rc genhtml_branch_coverage=1 00:05:54.901 --rc genhtml_function_coverage=1 00:05:54.901 --rc genhtml_legend=1 00:05:54.901 --rc geninfo_all_blocks=1 00:05:54.901 --rc geninfo_unexecuted_blocks=1 00:05:54.901 00:05:54.901 ' 00:05:54.901 17:25:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:54.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.901 --rc genhtml_branch_coverage=1 00:05:54.901 --rc genhtml_function_coverage=1 00:05:54.901 --rc genhtml_legend=1 00:05:54.901 --rc geninfo_all_blocks=1 00:05:54.901 --rc geninfo_unexecuted_blocks=1 00:05:54.901 00:05:54.901 ' 00:05:54.901 17:25:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:54.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.901 --rc genhtml_branch_coverage=1 00:05:54.901 --rc genhtml_function_coverage=1 00:05:54.901 --rc genhtml_legend=1 00:05:54.901 --rc geninfo_all_blocks=1 00:05:54.901 --rc geninfo_unexecuted_blocks=1 00:05:54.901 00:05:54.901 ' 00:05:54.901 17:25:32 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:54.901 17:25:32 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1460068 00:05:54.901 17:25:32 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.901 17:25:32 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1460068 00:05:54.901 17:25:32 -- common/autotest_common.sh@829 -- # '[' -z 1460068 ']' 00:05:54.901 17:25:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:54.901 17:25:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:54.901 17:25:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:54.901 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:54.901 17:25:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:54.901 17:25:32 -- common/autotest_common.sh@10 -- # set +x 00:05:54.901 [2024-11-16 17:25:32.372252] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.901 [2024-11-16 17:25:32.372326] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1460068 ] 00:05:55.162 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.162 [2024-11-16 17:25:32.451200] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.162 [2024-11-16 17:25:32.540165] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:55.162 [2024-11-16 17:25:32.540364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.101 17:25:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:56.101 17:25:33 -- common/autotest_common.sh@862 -- # return 0 00:05:56.101 17:25:33 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:56.358 17:25:33 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1460068 00:05:56.358 17:25:33 -- common/autotest_common.sh@936 -- # '[' -z 1460068 ']' 00:05:56.358 17:25:33 -- common/autotest_common.sh@940 -- # kill -0 1460068 00:05:56.358 17:25:33 -- common/autotest_common.sh@941 -- # uname 00:05:56.358 17:25:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:56.358 17:25:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1460068 00:05:56.358 17:25:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:56.358 17:25:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:56.358 17:25:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1460068' 00:05:56.358 killing process with pid 1460068 00:05:56.358 17:25:33 -- common/autotest_common.sh@955 -- # kill 1460068 00:05:56.358 17:25:33 -- common/autotest_common.sh@960 -- # wait 1460068 00:05:56.617 00:05:56.617 real 0m1.859s 00:05:56.617 user 0m2.144s 00:05:56.617 sys 0m0.479s 00:05:56.617 17:25:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.617 17:25:34 -- common/autotest_common.sh@10 -- # set +x 00:05:56.617 ************************************ 00:05:56.617 END TEST alias_rpc 00:05:56.617 ************************************ 00:05:56.617 17:25:34 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:56.617 17:25:34 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:56.617 17:25:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:56.617 17:25:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.617 17:25:34 -- common/autotest_common.sh@10 -- # set +x 00:05:56.617 ************************************ 00:05:56.617 START TEST spdkcli_tcp 00:05:56.617 ************************************ 00:05:56.617 17:25:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:56.876 * Looking for test storage... 00:05:56.876 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:56.876 17:25:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:56.876 17:25:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:56.876 17:25:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:56.876 17:25:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:56.876 17:25:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:56.876 17:25:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:56.876 17:25:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:56.876 17:25:34 -- scripts/common.sh@335 -- # IFS=.-: 00:05:56.876 17:25:34 -- scripts/common.sh@335 -- # read -ra ver1 00:05:56.876 17:25:34 -- scripts/common.sh@336 -- # IFS=.-: 00:05:56.876 17:25:34 -- scripts/common.sh@336 -- # read -ra ver2 00:05:56.876 17:25:34 -- scripts/common.sh@337 -- # local 'op=<' 00:05:56.876 17:25:34 -- scripts/common.sh@339 -- # ver1_l=2 00:05:56.876 17:25:34 -- scripts/common.sh@340 -- # ver2_l=1 00:05:56.876 17:25:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:56.876 17:25:34 -- scripts/common.sh@343 -- # case "$op" in 00:05:56.876 17:25:34 -- scripts/common.sh@344 -- # : 1 00:05:56.876 17:25:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:56.876 17:25:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:56.876 17:25:34 -- scripts/common.sh@364 -- # decimal 1 00:05:56.876 17:25:34 -- scripts/common.sh@352 -- # local d=1 00:05:56.876 17:25:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:56.876 17:25:34 -- scripts/common.sh@354 -- # echo 1 00:05:56.876 17:25:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:56.876 17:25:34 -- scripts/common.sh@365 -- # decimal 2 00:05:56.876 17:25:34 -- scripts/common.sh@352 -- # local d=2 00:05:56.876 17:25:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:56.876 17:25:34 -- scripts/common.sh@354 -- # echo 2 00:05:56.876 17:25:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:56.876 17:25:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:56.876 17:25:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:56.876 17:25:34 -- scripts/common.sh@367 -- # return 0 00:05:56.876 17:25:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:56.876 17:25:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:56.876 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.876 --rc genhtml_branch_coverage=1 00:05:56.876 --rc genhtml_function_coverage=1 00:05:56.876 --rc genhtml_legend=1 00:05:56.876 --rc geninfo_all_blocks=1 00:05:56.876 --rc geninfo_unexecuted_blocks=1 00:05:56.876 00:05:56.876 ' 00:05:56.876 17:25:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:56.876 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.876 --rc genhtml_branch_coverage=1 00:05:56.876 --rc genhtml_function_coverage=1 00:05:56.876 --rc genhtml_legend=1 00:05:56.876 --rc geninfo_all_blocks=1 00:05:56.876 --rc geninfo_unexecuted_blocks=1 00:05:56.876 00:05:56.876 ' 00:05:56.876 17:25:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:56.876 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.876 --rc genhtml_branch_coverage=1 00:05:56.876 --rc genhtml_function_coverage=1 00:05:56.876 --rc genhtml_legend=1 00:05:56.876 --rc geninfo_all_blocks=1 00:05:56.876 --rc geninfo_unexecuted_blocks=1 00:05:56.876 00:05:56.876 ' 00:05:56.876 17:25:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:56.876 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.876 --rc genhtml_branch_coverage=1 00:05:56.876 --rc genhtml_function_coverage=1 00:05:56.876 --rc genhtml_legend=1 00:05:56.876 --rc geninfo_all_blocks=1 00:05:56.876 --rc geninfo_unexecuted_blocks=1 00:05:56.876 00:05:56.876 ' 00:05:56.876 17:25:34 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:56.876 17:25:34 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:56.876 17:25:34 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:56.876 17:25:34 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:56.876 17:25:34 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:56.876 17:25:34 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:56.876 17:25:34 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:56.876 17:25:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:56.877 17:25:34 -- common/autotest_common.sh@10 -- # set +x 00:05:56.877 17:25:34 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1460401 00:05:56.877 17:25:34 -- spdkcli/tcp.sh@27 -- # waitforlisten 1460401 00:05:56.877 17:25:34 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:56.877 17:25:34 -- common/autotest_common.sh@829 -- # '[' -z 1460401 ']' 00:05:56.877 17:25:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.877 17:25:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:56.877 17:25:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.877 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.877 17:25:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:56.877 17:25:34 -- common/autotest_common.sh@10 -- # set +x 00:05:56.877 [2024-11-16 17:25:34.258311] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.877 [2024-11-16 17:25:34.258412] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1460401 ] 00:05:56.877 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.877 [2024-11-16 17:25:34.315833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:57.136 [2024-11-16 17:25:34.402699] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:57.136 [2024-11-16 17:25:34.402916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:57.136 [2024-11-16 17:25:34.402921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.074 17:25:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:58.074 17:25:35 -- common/autotest_common.sh@862 -- # return 0 00:05:58.074 17:25:35 -- spdkcli/tcp.sh@31 -- # socat_pid=1460542 00:05:58.074 17:25:35 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:58.074 17:25:35 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:58.074 [ 00:05:58.074 "bdev_malloc_delete", 00:05:58.074 "bdev_malloc_create", 00:05:58.074 "bdev_null_resize", 00:05:58.074 "bdev_null_delete", 00:05:58.074 "bdev_null_create", 00:05:58.074 "bdev_nvme_cuse_unregister", 00:05:58.074 "bdev_nvme_cuse_register", 00:05:58.074 "bdev_opal_new_user", 00:05:58.074 "bdev_opal_set_lock_state", 00:05:58.074 "bdev_opal_delete", 00:05:58.074 "bdev_opal_get_info", 00:05:58.074 "bdev_opal_create", 00:05:58.074 "bdev_nvme_opal_revert", 00:05:58.074 "bdev_nvme_opal_init", 00:05:58.074 "bdev_nvme_send_cmd", 00:05:58.074 "bdev_nvme_get_path_iostat", 00:05:58.074 "bdev_nvme_get_mdns_discovery_info", 00:05:58.074 "bdev_nvme_stop_mdns_discovery", 00:05:58.074 "bdev_nvme_start_mdns_discovery", 00:05:58.074 "bdev_nvme_set_multipath_policy", 00:05:58.074 "bdev_nvme_set_preferred_path", 00:05:58.074 "bdev_nvme_get_io_paths", 00:05:58.074 "bdev_nvme_remove_error_injection", 00:05:58.074 "bdev_nvme_add_error_injection", 00:05:58.074 "bdev_nvme_get_discovery_info", 00:05:58.074 "bdev_nvme_stop_discovery", 00:05:58.074 "bdev_nvme_start_discovery", 00:05:58.074 "bdev_nvme_get_controller_health_info", 00:05:58.074 "bdev_nvme_disable_controller", 00:05:58.074 "bdev_nvme_enable_controller", 00:05:58.074 "bdev_nvme_reset_controller", 00:05:58.074 "bdev_nvme_get_transport_statistics", 00:05:58.074 "bdev_nvme_apply_firmware", 00:05:58.074 "bdev_nvme_detach_controller", 00:05:58.074 "bdev_nvme_get_controllers", 00:05:58.074 "bdev_nvme_attach_controller", 00:05:58.074 "bdev_nvme_set_hotplug", 00:05:58.074 "bdev_nvme_set_options", 00:05:58.074 "bdev_passthru_delete", 00:05:58.074 "bdev_passthru_create", 00:05:58.074 "bdev_lvol_grow_lvstore", 00:05:58.074 "bdev_lvol_get_lvols", 00:05:58.074 "bdev_lvol_get_lvstores", 00:05:58.074 "bdev_lvol_delete", 00:05:58.074 "bdev_lvol_set_read_only", 00:05:58.074 "bdev_lvol_resize", 00:05:58.074 "bdev_lvol_decouple_parent", 00:05:58.074 "bdev_lvol_inflate", 00:05:58.074 "bdev_lvol_rename", 00:05:58.074 "bdev_lvol_clone_bdev", 00:05:58.074 "bdev_lvol_clone", 00:05:58.074 "bdev_lvol_snapshot", 00:05:58.074 "bdev_lvol_create", 00:05:58.074 "bdev_lvol_delete_lvstore", 00:05:58.074 "bdev_lvol_rename_lvstore", 00:05:58.074 "bdev_lvol_create_lvstore", 00:05:58.074 "bdev_raid_set_options", 00:05:58.074 "bdev_raid_remove_base_bdev", 00:05:58.074 "bdev_raid_add_base_bdev", 00:05:58.074 "bdev_raid_delete", 00:05:58.074 "bdev_raid_create", 00:05:58.074 "bdev_raid_get_bdevs", 00:05:58.074 "bdev_error_inject_error", 00:05:58.074 "bdev_error_delete", 00:05:58.074 "bdev_error_create", 00:05:58.074 "bdev_split_delete", 00:05:58.074 "bdev_split_create", 00:05:58.074 "bdev_delay_delete", 00:05:58.074 "bdev_delay_create", 00:05:58.074 "bdev_delay_update_latency", 00:05:58.074 "bdev_zone_block_delete", 00:05:58.074 "bdev_zone_block_create", 00:05:58.074 "blobfs_create", 00:05:58.074 "blobfs_detect", 00:05:58.074 "blobfs_set_cache_size", 00:05:58.074 "bdev_aio_delete", 00:05:58.074 "bdev_aio_rescan", 00:05:58.074 "bdev_aio_create", 00:05:58.074 "bdev_ftl_set_property", 00:05:58.074 "bdev_ftl_get_properties", 00:05:58.074 "bdev_ftl_get_stats", 00:05:58.074 "bdev_ftl_unmap", 00:05:58.074 "bdev_ftl_unload", 00:05:58.074 "bdev_ftl_delete", 00:05:58.074 "bdev_ftl_load", 00:05:58.074 "bdev_ftl_create", 00:05:58.074 "bdev_virtio_attach_controller", 00:05:58.074 "bdev_virtio_scsi_get_devices", 00:05:58.074 "bdev_virtio_detach_controller", 00:05:58.074 "bdev_virtio_blk_set_hotplug", 00:05:58.074 "bdev_iscsi_delete", 00:05:58.074 "bdev_iscsi_create", 00:05:58.074 "bdev_iscsi_set_options", 00:05:58.074 "accel_error_inject_error", 00:05:58.074 "ioat_scan_accel_module", 00:05:58.074 "dsa_scan_accel_module", 00:05:58.074 "iaa_scan_accel_module", 00:05:58.074 "vfu_virtio_create_scsi_endpoint", 00:05:58.074 "vfu_virtio_scsi_remove_target", 00:05:58.074 "vfu_virtio_scsi_add_target", 00:05:58.074 "vfu_virtio_create_blk_endpoint", 00:05:58.074 "vfu_virtio_delete_endpoint", 00:05:58.074 "iscsi_set_options", 00:05:58.074 "iscsi_get_auth_groups", 00:05:58.074 "iscsi_auth_group_remove_secret", 00:05:58.074 "iscsi_auth_group_add_secret", 00:05:58.074 "iscsi_delete_auth_group", 00:05:58.074 "iscsi_create_auth_group", 00:05:58.074 "iscsi_set_discovery_auth", 00:05:58.074 "iscsi_get_options", 00:05:58.074 "iscsi_target_node_request_logout", 00:05:58.074 "iscsi_target_node_set_redirect", 00:05:58.074 "iscsi_target_node_set_auth", 00:05:58.074 "iscsi_target_node_add_lun", 00:05:58.074 "iscsi_get_connections", 00:05:58.074 "iscsi_portal_group_set_auth", 00:05:58.074 "iscsi_start_portal_group", 00:05:58.074 "iscsi_delete_portal_group", 00:05:58.074 "iscsi_create_portal_group", 00:05:58.074 "iscsi_get_portal_groups", 00:05:58.074 "iscsi_delete_target_node", 00:05:58.074 "iscsi_target_node_remove_pg_ig_maps", 00:05:58.074 "iscsi_target_node_add_pg_ig_maps", 00:05:58.074 "iscsi_create_target_node", 00:05:58.074 "iscsi_get_target_nodes", 00:05:58.074 "iscsi_delete_initiator_group", 00:05:58.074 "iscsi_initiator_group_remove_initiators", 00:05:58.074 "iscsi_initiator_group_add_initiators", 00:05:58.074 "iscsi_create_initiator_group", 00:05:58.074 "iscsi_get_initiator_groups", 00:05:58.074 "nvmf_set_crdt", 00:05:58.074 "nvmf_set_config", 00:05:58.074 "nvmf_set_max_subsystems", 00:05:58.074 "nvmf_subsystem_get_listeners", 00:05:58.074 "nvmf_subsystem_get_qpairs", 00:05:58.074 "nvmf_subsystem_get_controllers", 00:05:58.074 "nvmf_get_stats", 00:05:58.074 "nvmf_get_transports", 00:05:58.074 "nvmf_create_transport", 00:05:58.074 "nvmf_get_targets", 00:05:58.074 "nvmf_delete_target", 00:05:58.074 "nvmf_create_target", 00:05:58.074 "nvmf_subsystem_allow_any_host", 00:05:58.074 "nvmf_subsystem_remove_host", 00:05:58.074 "nvmf_subsystem_add_host", 00:05:58.074 "nvmf_subsystem_remove_ns", 00:05:58.074 "nvmf_subsystem_add_ns", 00:05:58.074 "nvmf_subsystem_listener_set_ana_state", 00:05:58.074 "nvmf_discovery_get_referrals", 00:05:58.074 "nvmf_discovery_remove_referral", 00:05:58.074 "nvmf_discovery_add_referral", 00:05:58.074 "nvmf_subsystem_remove_listener", 00:05:58.074 "nvmf_subsystem_add_listener", 00:05:58.074 "nvmf_delete_subsystem", 00:05:58.074 "nvmf_create_subsystem", 00:05:58.074 "nvmf_get_subsystems", 00:05:58.074 "env_dpdk_get_mem_stats", 00:05:58.074 "nbd_get_disks", 00:05:58.074 "nbd_stop_disk", 00:05:58.074 "nbd_start_disk", 00:05:58.074 "ublk_recover_disk", 00:05:58.074 "ublk_get_disks", 00:05:58.074 "ublk_stop_disk", 00:05:58.074 "ublk_start_disk", 00:05:58.074 "ublk_destroy_target", 00:05:58.074 "ublk_create_target", 00:05:58.074 "virtio_blk_create_transport", 00:05:58.074 "virtio_blk_get_transports", 00:05:58.074 "vhost_controller_set_coalescing", 00:05:58.074 "vhost_get_controllers", 00:05:58.074 "vhost_delete_controller", 00:05:58.074 "vhost_create_blk_controller", 00:05:58.074 "vhost_scsi_controller_remove_target", 00:05:58.074 "vhost_scsi_controller_add_target", 00:05:58.074 "vhost_start_scsi_controller", 00:05:58.074 "vhost_create_scsi_controller", 00:05:58.074 "thread_set_cpumask", 00:05:58.074 "framework_get_scheduler", 00:05:58.074 "framework_set_scheduler", 00:05:58.074 "framework_get_reactors", 00:05:58.074 "thread_get_io_channels", 00:05:58.074 "thread_get_pollers", 00:05:58.074 "thread_get_stats", 00:05:58.074 "framework_monitor_context_switch", 00:05:58.074 "spdk_kill_instance", 00:05:58.074 "log_enable_timestamps", 00:05:58.074 "log_get_flags", 00:05:58.074 "log_clear_flag", 00:05:58.074 "log_set_flag", 00:05:58.074 "log_get_level", 00:05:58.074 "log_set_level", 00:05:58.074 "log_get_print_level", 00:05:58.074 "log_set_print_level", 00:05:58.074 "framework_enable_cpumask_locks", 00:05:58.074 "framework_disable_cpumask_locks", 00:05:58.074 "framework_wait_init", 00:05:58.074 "framework_start_init", 00:05:58.074 "scsi_get_devices", 00:05:58.074 "bdev_get_histogram", 00:05:58.074 "bdev_enable_histogram", 00:05:58.074 "bdev_set_qos_limit", 00:05:58.074 "bdev_set_qd_sampling_period", 00:05:58.074 "bdev_get_bdevs", 00:05:58.074 "bdev_reset_iostat", 00:05:58.074 "bdev_get_iostat", 00:05:58.074 "bdev_examine", 00:05:58.074 "bdev_wait_for_examine", 00:05:58.074 "bdev_set_options", 00:05:58.074 "notify_get_notifications", 00:05:58.074 "notify_get_types", 00:05:58.074 "accel_get_stats", 00:05:58.074 "accel_set_options", 00:05:58.074 "accel_set_driver", 00:05:58.074 "accel_crypto_key_destroy", 00:05:58.074 "accel_crypto_keys_get", 00:05:58.074 "accel_crypto_key_create", 00:05:58.074 "accel_assign_opc", 00:05:58.074 "accel_get_module_info", 00:05:58.074 "accel_get_opc_assignments", 00:05:58.074 "vmd_rescan", 00:05:58.074 "vmd_remove_device", 00:05:58.074 "vmd_enable", 00:05:58.074 "sock_set_default_impl", 00:05:58.074 "sock_impl_set_options", 00:05:58.074 "sock_impl_get_options", 00:05:58.074 "iobuf_get_stats", 00:05:58.074 "iobuf_set_options", 00:05:58.074 "framework_get_pci_devices", 00:05:58.074 "framework_get_config", 00:05:58.074 "framework_get_subsystems", 00:05:58.074 "vfu_tgt_set_base_path", 00:05:58.074 "trace_get_info", 00:05:58.074 "trace_get_tpoint_group_mask", 00:05:58.074 "trace_disable_tpoint_group", 00:05:58.074 "trace_enable_tpoint_group", 00:05:58.074 "trace_clear_tpoint_mask", 00:05:58.074 "trace_set_tpoint_mask", 00:05:58.074 "spdk_get_version", 00:05:58.074 "rpc_get_methods" 00:05:58.074 ] 00:05:58.074 17:25:35 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:58.074 17:25:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:58.074 17:25:35 -- common/autotest_common.sh@10 -- # set +x 00:05:58.074 17:25:35 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:58.074 17:25:35 -- spdkcli/tcp.sh@38 -- # killprocess 1460401 00:05:58.074 17:25:35 -- common/autotest_common.sh@936 -- # '[' -z 1460401 ']' 00:05:58.074 17:25:35 -- common/autotest_common.sh@940 -- # kill -0 1460401 00:05:58.074 17:25:35 -- common/autotest_common.sh@941 -- # uname 00:05:58.074 17:25:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:58.074 17:25:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1460401 00:05:58.074 17:25:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:58.074 17:25:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:58.074 17:25:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1460401' 00:05:58.074 killing process with pid 1460401 00:05:58.074 17:25:35 -- common/autotest_common.sh@955 -- # kill 1460401 00:05:58.074 17:25:35 -- common/autotest_common.sh@960 -- # wait 1460401 00:05:58.640 00:05:58.641 real 0m1.867s 00:05:58.641 user 0m3.603s 00:05:58.641 sys 0m0.508s 00:05:58.641 17:25:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.641 17:25:35 -- common/autotest_common.sh@10 -- # set +x 00:05:58.641 ************************************ 00:05:58.641 END TEST spdkcli_tcp 00:05:58.641 ************************************ 00:05:58.641 17:25:35 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:58.641 17:25:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.641 17:25:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.641 17:25:35 -- common/autotest_common.sh@10 -- # set +x 00:05:58.641 ************************************ 00:05:58.641 START TEST dpdk_mem_utility 00:05:58.641 ************************************ 00:05:58.641 17:25:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:58.641 * Looking for test storage... 00:05:58.641 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:58.641 17:25:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:58.641 17:25:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:58.641 17:25:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:58.641 17:25:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:58.641 17:25:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:58.641 17:25:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:58.641 17:25:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:58.641 17:25:36 -- scripts/common.sh@335 -- # IFS=.-: 00:05:58.641 17:25:36 -- scripts/common.sh@335 -- # read -ra ver1 00:05:58.641 17:25:36 -- scripts/common.sh@336 -- # IFS=.-: 00:05:58.641 17:25:36 -- scripts/common.sh@336 -- # read -ra ver2 00:05:58.641 17:25:36 -- scripts/common.sh@337 -- # local 'op=<' 00:05:58.641 17:25:36 -- scripts/common.sh@339 -- # ver1_l=2 00:05:58.641 17:25:36 -- scripts/common.sh@340 -- # ver2_l=1 00:05:58.641 17:25:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:58.641 17:25:36 -- scripts/common.sh@343 -- # case "$op" in 00:05:58.641 17:25:36 -- scripts/common.sh@344 -- # : 1 00:05:58.641 17:25:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:58.641 17:25:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:58.641 17:25:36 -- scripts/common.sh@364 -- # decimal 1 00:05:58.641 17:25:36 -- scripts/common.sh@352 -- # local d=1 00:05:58.641 17:25:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:58.641 17:25:36 -- scripts/common.sh@354 -- # echo 1 00:05:58.641 17:25:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:58.641 17:25:36 -- scripts/common.sh@365 -- # decimal 2 00:05:58.641 17:25:36 -- scripts/common.sh@352 -- # local d=2 00:05:58.641 17:25:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:58.641 17:25:36 -- scripts/common.sh@354 -- # echo 2 00:05:58.641 17:25:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:58.641 17:25:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:58.641 17:25:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:58.641 17:25:36 -- scripts/common.sh@367 -- # return 0 00:05:58.641 17:25:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:58.641 17:25:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:58.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.641 --rc genhtml_branch_coverage=1 00:05:58.641 --rc genhtml_function_coverage=1 00:05:58.641 --rc genhtml_legend=1 00:05:58.641 --rc geninfo_all_blocks=1 00:05:58.641 --rc geninfo_unexecuted_blocks=1 00:05:58.641 00:05:58.641 ' 00:05:58.641 17:25:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:58.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.641 --rc genhtml_branch_coverage=1 00:05:58.641 --rc genhtml_function_coverage=1 00:05:58.641 --rc genhtml_legend=1 00:05:58.641 --rc geninfo_all_blocks=1 00:05:58.641 --rc geninfo_unexecuted_blocks=1 00:05:58.641 00:05:58.641 ' 00:05:58.641 17:25:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:58.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.641 --rc genhtml_branch_coverage=1 00:05:58.641 --rc genhtml_function_coverage=1 00:05:58.641 --rc genhtml_legend=1 00:05:58.641 --rc geninfo_all_blocks=1 00:05:58.641 --rc geninfo_unexecuted_blocks=1 00:05:58.641 00:05:58.641 ' 00:05:58.641 17:25:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:58.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.641 --rc genhtml_branch_coverage=1 00:05:58.641 --rc genhtml_function_coverage=1 00:05:58.641 --rc genhtml_legend=1 00:05:58.641 --rc geninfo_all_blocks=1 00:05:58.641 --rc geninfo_unexecuted_blocks=1 00:05:58.641 00:05:58.641 ' 00:05:58.641 17:25:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:58.641 17:25:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1460743 00:05:58.641 17:25:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:58.641 17:25:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1460743 00:05:58.641 17:25:36 -- common/autotest_common.sh@829 -- # '[' -z 1460743 ']' 00:05:58.641 17:25:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:58.641 17:25:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:58.641 17:25:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:58.641 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:58.641 17:25:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:58.641 17:25:36 -- common/autotest_common.sh@10 -- # set +x 00:05:58.900 [2024-11-16 17:25:36.153002] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.900 [2024-11-16 17:25:36.153082] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1460743 ] 00:05:58.900 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.900 [2024-11-16 17:25:36.211854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.900 [2024-11-16 17:25:36.299573] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:58.900 [2024-11-16 17:25:36.299777] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.839 17:25:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:59.839 17:25:37 -- common/autotest_common.sh@862 -- # return 0 00:05:59.839 17:25:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:59.839 17:25:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:59.839 17:25:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:59.839 17:25:37 -- common/autotest_common.sh@10 -- # set +x 00:05:59.839 { 00:05:59.839 "filename": "/tmp/spdk_mem_dump.txt" 00:05:59.839 } 00:05:59.839 17:25:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:59.839 17:25:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:59.839 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:59.839 1 heaps totaling size 814.000000 MiB 00:05:59.839 size: 814.000000 MiB heap id: 0 00:05:59.839 end heaps---------- 00:05:59.839 8 mempools totaling size 598.116089 MiB 00:05:59.839 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:59.839 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:59.839 size: 84.521057 MiB name: bdev_io_1460743 00:05:59.839 size: 51.011292 MiB name: evtpool_1460743 00:05:59.839 size: 50.003479 MiB name: msgpool_1460743 00:05:59.839 size: 21.763794 MiB name: PDU_Pool 00:05:59.839 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:59.839 size: 0.026123 MiB name: Session_Pool 00:05:59.839 end mempools------- 00:05:59.839 6 memzones totaling size 4.142822 MiB 00:05:59.839 size: 1.000366 MiB name: RG_ring_0_1460743 00:05:59.839 size: 1.000366 MiB name: RG_ring_1_1460743 00:05:59.839 size: 1.000366 MiB name: RG_ring_4_1460743 00:05:59.839 size: 1.000366 MiB name: RG_ring_5_1460743 00:05:59.839 size: 0.125366 MiB name: RG_ring_2_1460743 00:05:59.839 size: 0.015991 MiB name: RG_ring_3_1460743 00:05:59.839 end memzones------- 00:05:59.839 17:25:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:59.839 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:59.839 list of free elements. size: 12.519348 MiB 00:05:59.839 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:59.839 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:59.839 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:59.840 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:59.840 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:59.840 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:59.840 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:59.840 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:59.840 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:59.840 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:59.840 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:59.840 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:59.840 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:59.840 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:59.840 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:59.840 list of standard malloc elements. size: 199.218079 MiB 00:05:59.840 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:59.840 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:59.840 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:59.840 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:59.840 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:59.840 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:59.840 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:59.840 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:59.840 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:59.840 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:59.840 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:59.840 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:59.840 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:59.840 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:59.840 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:59.840 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:59.840 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:59.840 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:59.840 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:59.840 list of memzone associated elements. size: 602.262573 MiB 00:05:59.840 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:59.840 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:59.840 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:59.840 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:59.840 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:59.840 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1460743_0 00:05:59.840 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:59.840 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1460743_0 00:05:59.840 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:59.840 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1460743_0 00:05:59.840 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:59.840 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:59.840 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:59.840 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:59.840 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:59.840 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1460743 00:05:59.840 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:59.840 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1460743 00:05:59.840 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:59.840 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1460743 00:05:59.840 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:59.840 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:59.840 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:59.840 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:59.840 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:59.840 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:59.840 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:59.840 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:59.840 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:59.840 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1460743 00:05:59.840 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:59.840 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1460743 00:05:59.840 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:59.840 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1460743 00:05:59.840 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:59.840 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1460743 00:05:59.840 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:59.840 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1460743 00:05:59.840 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:59.840 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:59.840 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:59.840 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:59.840 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:59.840 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:59.840 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:59.840 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1460743 00:05:59.840 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:59.840 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:59.840 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:59.840 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:59.840 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:59.840 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1460743 00:05:59.840 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:59.840 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:59.840 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:59.840 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1460743 00:05:59.840 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:59.840 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1460743 00:05:59.840 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:59.840 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:59.840 17:25:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:59.840 17:25:37 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1460743 00:05:59.840 17:25:37 -- common/autotest_common.sh@936 -- # '[' -z 1460743 ']' 00:05:59.840 17:25:37 -- common/autotest_common.sh@940 -- # kill -0 1460743 00:05:59.840 17:25:37 -- common/autotest_common.sh@941 -- # uname 00:05:59.840 17:25:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:59.840 17:25:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1460743 00:05:59.840 17:25:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:59.840 17:25:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:59.840 17:25:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1460743' 00:05:59.840 killing process with pid 1460743 00:05:59.840 17:25:37 -- common/autotest_common.sh@955 -- # kill 1460743 00:05:59.840 17:25:37 -- common/autotest_common.sh@960 -- # wait 1460743 00:06:00.410 00:06:00.410 real 0m1.717s 00:06:00.410 user 0m1.895s 00:06:00.410 sys 0m0.469s 00:06:00.410 17:25:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.410 17:25:37 -- common/autotest_common.sh@10 -- # set +x 00:06:00.410 ************************************ 00:06:00.410 END TEST dpdk_mem_utility 00:06:00.410 ************************************ 00:06:00.410 17:25:37 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:00.410 17:25:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:00.410 17:25:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.410 17:25:37 -- common/autotest_common.sh@10 -- # set +x 00:06:00.410 ************************************ 00:06:00.410 START TEST event 00:06:00.410 ************************************ 00:06:00.410 17:25:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:00.410 * Looking for test storage... 00:06:00.410 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:00.410 17:25:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:00.410 17:25:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:00.410 17:25:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:00.410 17:25:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:00.410 17:25:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:00.410 17:25:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:00.410 17:25:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:00.410 17:25:37 -- scripts/common.sh@335 -- # IFS=.-: 00:06:00.410 17:25:37 -- scripts/common.sh@335 -- # read -ra ver1 00:06:00.410 17:25:37 -- scripts/common.sh@336 -- # IFS=.-: 00:06:00.410 17:25:37 -- scripts/common.sh@336 -- # read -ra ver2 00:06:00.410 17:25:37 -- scripts/common.sh@337 -- # local 'op=<' 00:06:00.410 17:25:37 -- scripts/common.sh@339 -- # ver1_l=2 00:06:00.410 17:25:37 -- scripts/common.sh@340 -- # ver2_l=1 00:06:00.410 17:25:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:00.410 17:25:37 -- scripts/common.sh@343 -- # case "$op" in 00:06:00.410 17:25:37 -- scripts/common.sh@344 -- # : 1 00:06:00.410 17:25:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:00.410 17:25:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:00.410 17:25:37 -- scripts/common.sh@364 -- # decimal 1 00:06:00.410 17:25:37 -- scripts/common.sh@352 -- # local d=1 00:06:00.410 17:25:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:00.410 17:25:37 -- scripts/common.sh@354 -- # echo 1 00:06:00.410 17:25:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:00.410 17:25:37 -- scripts/common.sh@365 -- # decimal 2 00:06:00.410 17:25:37 -- scripts/common.sh@352 -- # local d=2 00:06:00.410 17:25:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:00.410 17:25:37 -- scripts/common.sh@354 -- # echo 2 00:06:00.410 17:25:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:00.410 17:25:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:00.410 17:25:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:00.410 17:25:37 -- scripts/common.sh@367 -- # return 0 00:06:00.410 17:25:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:00.410 17:25:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:00.410 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.410 --rc genhtml_branch_coverage=1 00:06:00.410 --rc genhtml_function_coverage=1 00:06:00.410 --rc genhtml_legend=1 00:06:00.410 --rc geninfo_all_blocks=1 00:06:00.410 --rc geninfo_unexecuted_blocks=1 00:06:00.410 00:06:00.410 ' 00:06:00.410 17:25:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:00.410 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.410 --rc genhtml_branch_coverage=1 00:06:00.410 --rc genhtml_function_coverage=1 00:06:00.410 --rc genhtml_legend=1 00:06:00.410 --rc geninfo_all_blocks=1 00:06:00.410 --rc geninfo_unexecuted_blocks=1 00:06:00.410 00:06:00.410 ' 00:06:00.410 17:25:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:00.410 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.410 --rc genhtml_branch_coverage=1 00:06:00.410 --rc genhtml_function_coverage=1 00:06:00.410 --rc genhtml_legend=1 00:06:00.410 --rc geninfo_all_blocks=1 00:06:00.410 --rc geninfo_unexecuted_blocks=1 00:06:00.410 00:06:00.410 ' 00:06:00.410 17:25:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:00.410 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.410 --rc genhtml_branch_coverage=1 00:06:00.410 --rc genhtml_function_coverage=1 00:06:00.410 --rc genhtml_legend=1 00:06:00.410 --rc geninfo_all_blocks=1 00:06:00.410 --rc geninfo_unexecuted_blocks=1 00:06:00.410 00:06:00.410 ' 00:06:00.410 17:25:37 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:00.410 17:25:37 -- bdev/nbd_common.sh@6 -- # set -e 00:06:00.410 17:25:37 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:00.410 17:25:37 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:00.410 17:25:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.410 17:25:37 -- common/autotest_common.sh@10 -- # set +x 00:06:00.410 ************************************ 00:06:00.410 START TEST event_perf 00:06:00.410 ************************************ 00:06:00.410 17:25:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:00.410 Running I/O for 1 seconds...[2024-11-16 17:25:37.862445] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.410 [2024-11-16 17:25:37.862532] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1460952 ] 00:06:00.410 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.669 [2024-11-16 17:25:37.924289] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:00.669 [2024-11-16 17:25:38.016000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:00.669 [2024-11-16 17:25:38.016049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:00.669 [2024-11-16 17:25:38.016166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:00.669 [2024-11-16 17:25:38.016168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.607 Running I/O for 1 seconds... 00:06:01.607 lcore 0: 227613 00:06:01.607 lcore 1: 227614 00:06:01.607 lcore 2: 227613 00:06:01.607 lcore 3: 227612 00:06:01.607 done. 00:06:01.868 00:06:01.868 real 0m1.252s 00:06:01.868 user 0m4.154s 00:06:01.868 sys 0m0.093s 00:06:01.868 17:25:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.868 17:25:39 -- common/autotest_common.sh@10 -- # set +x 00:06:01.868 ************************************ 00:06:01.868 END TEST event_perf 00:06:01.868 ************************************ 00:06:01.868 17:25:39 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:01.868 17:25:39 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:01.868 17:25:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.868 17:25:39 -- common/autotest_common.sh@10 -- # set +x 00:06:01.868 ************************************ 00:06:01.868 START TEST event_reactor 00:06:01.868 ************************************ 00:06:01.868 17:25:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:01.868 [2024-11-16 17:25:39.144445] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.868 [2024-11-16 17:25:39.144526] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1461111 ] 00:06:01.868 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.868 [2024-11-16 17:25:39.209130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.868 [2024-11-16 17:25:39.297257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.245 test_start 00:06:03.245 oneshot 00:06:03.245 tick 100 00:06:03.245 tick 100 00:06:03.245 tick 250 00:06:03.245 tick 100 00:06:03.245 tick 100 00:06:03.245 tick 100 00:06:03.245 tick 250 00:06:03.245 tick 500 00:06:03.245 tick 100 00:06:03.245 tick 100 00:06:03.245 tick 250 00:06:03.245 tick 100 00:06:03.245 tick 100 00:06:03.245 test_end 00:06:03.245 00:06:03.245 real 0m1.247s 00:06:03.245 user 0m1.156s 00:06:03.245 sys 0m0.085s 00:06:03.245 17:25:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.245 17:25:40 -- common/autotest_common.sh@10 -- # set +x 00:06:03.245 ************************************ 00:06:03.245 END TEST event_reactor 00:06:03.245 ************************************ 00:06:03.245 17:25:40 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:03.245 17:25:40 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:03.245 17:25:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.245 17:25:40 -- common/autotest_common.sh@10 -- # set +x 00:06:03.245 ************************************ 00:06:03.245 START TEST event_reactor_perf 00:06:03.245 ************************************ 00:06:03.245 17:25:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:03.245 [2024-11-16 17:25:40.418236] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.245 [2024-11-16 17:25:40.418319] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1461371 ] 00:06:03.245 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.245 [2024-11-16 17:25:40.483871] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.245 [2024-11-16 17:25:40.571464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.183 test_start 00:06:04.183 test_end 00:06:04.183 Performance: 351056 events per second 00:06:04.184 00:06:04.184 real 0m1.246s 00:06:04.184 user 0m1.155s 00:06:04.184 sys 0m0.086s 00:06:04.184 17:25:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.184 17:25:41 -- common/autotest_common.sh@10 -- # set +x 00:06:04.184 ************************************ 00:06:04.184 END TEST event_reactor_perf 00:06:04.184 ************************************ 00:06:04.184 17:25:41 -- event/event.sh@49 -- # uname -s 00:06:04.184 17:25:41 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:04.184 17:25:41 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:04.184 17:25:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.184 17:25:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.184 17:25:41 -- common/autotest_common.sh@10 -- # set +x 00:06:04.442 ************************************ 00:06:04.442 START TEST event_scheduler 00:06:04.442 ************************************ 00:06:04.442 17:25:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:04.442 * Looking for test storage... 00:06:04.442 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:04.442 17:25:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:04.442 17:25:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:04.442 17:25:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:04.442 17:25:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:04.442 17:25:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:04.442 17:25:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:04.442 17:25:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:04.442 17:25:41 -- scripts/common.sh@335 -- # IFS=.-: 00:06:04.442 17:25:41 -- scripts/common.sh@335 -- # read -ra ver1 00:06:04.442 17:25:41 -- scripts/common.sh@336 -- # IFS=.-: 00:06:04.442 17:25:41 -- scripts/common.sh@336 -- # read -ra ver2 00:06:04.442 17:25:41 -- scripts/common.sh@337 -- # local 'op=<' 00:06:04.442 17:25:41 -- scripts/common.sh@339 -- # ver1_l=2 00:06:04.442 17:25:41 -- scripts/common.sh@340 -- # ver2_l=1 00:06:04.442 17:25:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:04.442 17:25:41 -- scripts/common.sh@343 -- # case "$op" in 00:06:04.442 17:25:41 -- scripts/common.sh@344 -- # : 1 00:06:04.442 17:25:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:04.442 17:25:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:04.442 17:25:41 -- scripts/common.sh@364 -- # decimal 1 00:06:04.442 17:25:41 -- scripts/common.sh@352 -- # local d=1 00:06:04.442 17:25:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:04.442 17:25:41 -- scripts/common.sh@354 -- # echo 1 00:06:04.442 17:25:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:04.442 17:25:41 -- scripts/common.sh@365 -- # decimal 2 00:06:04.442 17:25:41 -- scripts/common.sh@352 -- # local d=2 00:06:04.442 17:25:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:04.442 17:25:41 -- scripts/common.sh@354 -- # echo 2 00:06:04.442 17:25:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:04.442 17:25:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:04.442 17:25:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:04.442 17:25:41 -- scripts/common.sh@367 -- # return 0 00:06:04.442 17:25:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:04.442 17:25:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:04.442 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.442 --rc genhtml_branch_coverage=1 00:06:04.442 --rc genhtml_function_coverage=1 00:06:04.442 --rc genhtml_legend=1 00:06:04.442 --rc geninfo_all_blocks=1 00:06:04.442 --rc geninfo_unexecuted_blocks=1 00:06:04.442 00:06:04.442 ' 00:06:04.442 17:25:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:04.442 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.442 --rc genhtml_branch_coverage=1 00:06:04.442 --rc genhtml_function_coverage=1 00:06:04.442 --rc genhtml_legend=1 00:06:04.442 --rc geninfo_all_blocks=1 00:06:04.442 --rc geninfo_unexecuted_blocks=1 00:06:04.442 00:06:04.442 ' 00:06:04.442 17:25:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:04.442 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.442 --rc genhtml_branch_coverage=1 00:06:04.443 --rc genhtml_function_coverage=1 00:06:04.443 --rc genhtml_legend=1 00:06:04.443 --rc geninfo_all_blocks=1 00:06:04.443 --rc geninfo_unexecuted_blocks=1 00:06:04.443 00:06:04.443 ' 00:06:04.443 17:25:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:04.443 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.443 --rc genhtml_branch_coverage=1 00:06:04.443 --rc genhtml_function_coverage=1 00:06:04.443 --rc genhtml_legend=1 00:06:04.443 --rc geninfo_all_blocks=1 00:06:04.443 --rc geninfo_unexecuted_blocks=1 00:06:04.443 00:06:04.443 ' 00:06:04.443 17:25:41 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:04.443 17:25:41 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1461584 00:06:04.443 17:25:41 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:04.443 17:25:41 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:04.443 17:25:41 -- scheduler/scheduler.sh@37 -- # waitforlisten 1461584 00:06:04.443 17:25:41 -- common/autotest_common.sh@829 -- # '[' -z 1461584 ']' 00:06:04.443 17:25:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:04.443 17:25:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:04.443 17:25:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:04.443 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:04.443 17:25:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:04.443 17:25:41 -- common/autotest_common.sh@10 -- # set +x 00:06:04.443 [2024-11-16 17:25:41.855303] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.443 [2024-11-16 17:25:41.855378] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1461584 ] 00:06:04.443 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.443 [2024-11-16 17:25:41.916178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:04.702 [2024-11-16 17:25:42.000942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.702 [2024-11-16 17:25:42.001019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:04.702 [2024-11-16 17:25:42.001078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:04.702 [2024-11-16 17:25:42.001080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:04.702 17:25:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.702 17:25:42 -- common/autotest_common.sh@862 -- # return 0 00:06:04.702 17:25:42 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:04.702 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.702 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.702 POWER: Env isn't set yet! 00:06:04.702 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:04.702 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:04.702 POWER: Cannot get available frequencies of lcore 0 00:06:04.702 POWER: Attempting to initialise PSTAT power management... 00:06:04.702 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:04.702 POWER: Initialized successfully for lcore 0 power management 00:06:04.702 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:04.702 POWER: Initialized successfully for lcore 1 power management 00:06:04.702 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:04.702 POWER: Initialized successfully for lcore 2 power management 00:06:04.702 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:04.702 POWER: Initialized successfully for lcore 3 power management 00:06:04.702 [2024-11-16 17:25:42.100830] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:04.702 [2024-11-16 17:25:42.100848] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:04.702 [2024-11-16 17:25:42.100858] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:04.702 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.702 17:25:42 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:04.702 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.702 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.981 [2024-11-16 17:25:42.202912] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:04.981 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.981 17:25:42 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:04.981 17:25:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.981 17:25:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.981 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 ************************************ 00:06:04.982 START TEST scheduler_create_thread 00:06:04.982 ************************************ 00:06:04.982 17:25:42 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 2 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 3 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 4 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 5 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 6 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 7 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 8 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 9 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 10 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:04.982 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.982 17:25:42 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:04.982 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.982 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:05.586 17:25:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:05.586 17:25:42 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:05.586 17:25:42 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:05.586 17:25:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:05.586 17:25:42 -- common/autotest_common.sh@10 -- # set +x 00:06:06.524 17:25:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.524 00:06:06.524 real 0m1.753s 00:06:06.524 user 0m0.009s 00:06:06.524 sys 0m0.004s 00:06:06.524 17:25:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.524 17:25:43 -- common/autotest_common.sh@10 -- # set +x 00:06:06.524 ************************************ 00:06:06.524 END TEST scheduler_create_thread 00:06:06.524 ************************************ 00:06:06.524 17:25:43 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:06.524 17:25:43 -- scheduler/scheduler.sh@46 -- # killprocess 1461584 00:06:06.524 17:25:43 -- common/autotest_common.sh@936 -- # '[' -z 1461584 ']' 00:06:06.524 17:25:43 -- common/autotest_common.sh@940 -- # kill -0 1461584 00:06:06.524 17:25:43 -- common/autotest_common.sh@941 -- # uname 00:06:06.524 17:25:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.524 17:25:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1461584 00:06:06.784 17:25:44 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:06.784 17:25:44 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:06.784 17:25:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1461584' 00:06:06.784 killing process with pid 1461584 00:06:06.784 17:25:44 -- common/autotest_common.sh@955 -- # kill 1461584 00:06:06.784 17:25:44 -- common/autotest_common.sh@960 -- # wait 1461584 00:06:07.044 [2024-11-16 17:25:44.442772] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:07.303 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:07.303 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:07.303 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:07.303 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:07.303 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:07.303 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:07.303 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:07.303 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:07.303 00:06:07.303 real 0m2.985s 00:06:07.303 user 0m3.887s 00:06:07.303 sys 0m0.354s 00:06:07.303 17:25:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.303 17:25:44 -- common/autotest_common.sh@10 -- # set +x 00:06:07.303 ************************************ 00:06:07.303 END TEST event_scheduler 00:06:07.303 ************************************ 00:06:07.303 17:25:44 -- event/event.sh@51 -- # modprobe -n nbd 00:06:07.303 17:25:44 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:07.303 17:25:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:07.303 17:25:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.303 17:25:44 -- common/autotest_common.sh@10 -- # set +x 00:06:07.303 ************************************ 00:06:07.303 START TEST app_repeat 00:06:07.303 ************************************ 00:06:07.303 17:25:44 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:07.303 17:25:44 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.303 17:25:44 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.303 17:25:44 -- event/event.sh@13 -- # local nbd_list 00:06:07.303 17:25:44 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.303 17:25:44 -- event/event.sh@14 -- # local bdev_list 00:06:07.303 17:25:44 -- event/event.sh@15 -- # local repeat_times=4 00:06:07.303 17:25:44 -- event/event.sh@17 -- # modprobe nbd 00:06:07.303 17:25:44 -- event/event.sh@19 -- # repeat_pid=1461920 00:06:07.303 17:25:44 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:07.303 17:25:44 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:07.303 17:25:44 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1461920' 00:06:07.303 Process app_repeat pid: 1461920 00:06:07.303 17:25:44 -- event/event.sh@23 -- # for i in {0..2} 00:06:07.303 17:25:44 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:07.303 spdk_app_start Round 0 00:06:07.303 17:25:44 -- event/event.sh@25 -- # waitforlisten 1461920 /var/tmp/spdk-nbd.sock 00:06:07.303 17:25:44 -- common/autotest_common.sh@829 -- # '[' -z 1461920 ']' 00:06:07.303 17:25:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:07.303 17:25:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:07.303 17:25:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:07.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:07.303 17:25:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:07.303 17:25:44 -- common/autotest_common.sh@10 -- # set +x 00:06:07.303 [2024-11-16 17:25:44.722202] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.303 [2024-11-16 17:25:44.722279] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1461920 ] 00:06:07.303 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.303 [2024-11-16 17:25:44.785643] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:07.563 [2024-11-16 17:25:44.876258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:07.563 [2024-11-16 17:25:44.876263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.500 17:25:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:08.500 17:25:45 -- common/autotest_common.sh@862 -- # return 0 00:06:08.500 17:25:45 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.500 Malloc0 00:06:08.500 17:25:45 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.760 Malloc1 00:06:09.019 17:25:46 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:09.019 17:25:46 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.019 17:25:46 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:09.019 17:25:46 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:09.019 17:25:46 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.019 17:25:46 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:09.019 17:25:46 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:09.019 17:25:46 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.019 17:25:46 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:09.020 17:25:46 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:09.020 17:25:46 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.020 17:25:46 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:09.020 17:25:46 -- bdev/nbd_common.sh@12 -- # local i 00:06:09.020 17:25:46 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:09.020 17:25:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:09.020 17:25:46 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:09.278 /dev/nbd0 00:06:09.278 17:25:46 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:09.278 17:25:46 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:09.278 17:25:46 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:09.278 17:25:46 -- common/autotest_common.sh@867 -- # local i 00:06:09.278 17:25:46 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:09.278 17:25:46 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:09.278 17:25:46 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:09.278 17:25:46 -- common/autotest_common.sh@871 -- # break 00:06:09.278 17:25:46 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:09.278 17:25:46 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:09.278 17:25:46 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:09.278 1+0 records in 00:06:09.278 1+0 records out 00:06:09.278 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000141879 s, 28.9 MB/s 00:06:09.278 17:25:46 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.278 17:25:46 -- common/autotest_common.sh@884 -- # size=4096 00:06:09.278 17:25:46 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.278 17:25:46 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:09.278 17:25:46 -- common/autotest_common.sh@887 -- # return 0 00:06:09.278 17:25:46 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:09.278 17:25:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:09.278 17:25:46 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:09.536 /dev/nbd1 00:06:09.536 17:25:46 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:09.536 17:25:46 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:09.537 17:25:46 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:09.537 17:25:46 -- common/autotest_common.sh@867 -- # local i 00:06:09.537 17:25:46 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:09.537 17:25:46 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:09.537 17:25:46 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:09.537 17:25:46 -- common/autotest_common.sh@871 -- # break 00:06:09.537 17:25:46 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:09.537 17:25:46 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:09.537 17:25:46 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:09.537 1+0 records in 00:06:09.537 1+0 records out 00:06:09.537 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00018741 s, 21.9 MB/s 00:06:09.537 17:25:46 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.537 17:25:46 -- common/autotest_common.sh@884 -- # size=4096 00:06:09.537 17:25:46 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.537 17:25:46 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:09.537 17:25:46 -- common/autotest_common.sh@887 -- # return 0 00:06:09.537 17:25:46 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:09.537 17:25:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:09.537 17:25:46 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:09.537 17:25:46 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.537 17:25:46 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:09.795 { 00:06:09.795 "nbd_device": "/dev/nbd0", 00:06:09.795 "bdev_name": "Malloc0" 00:06:09.795 }, 00:06:09.795 { 00:06:09.795 "nbd_device": "/dev/nbd1", 00:06:09.795 "bdev_name": "Malloc1" 00:06:09.795 } 00:06:09.795 ]' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:09.795 { 00:06:09.795 "nbd_device": "/dev/nbd0", 00:06:09.795 "bdev_name": "Malloc0" 00:06:09.795 }, 00:06:09.795 { 00:06:09.795 "nbd_device": "/dev/nbd1", 00:06:09.795 "bdev_name": "Malloc1" 00:06:09.795 } 00:06:09.795 ]' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:09.795 /dev/nbd1' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:09.795 /dev/nbd1' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@65 -- # count=2 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@95 -- # count=2 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:09.795 256+0 records in 00:06:09.795 256+0 records out 00:06:09.795 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00497322 s, 211 MB/s 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:09.795 256+0 records in 00:06:09.795 256+0 records out 00:06:09.795 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201489 s, 52.0 MB/s 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:09.795 256+0 records in 00:06:09.795 256+0 records out 00:06:09.795 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022666 s, 46.3 MB/s 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@51 -- # local i 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.795 17:25:47 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:10.053 17:25:47 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:10.053 17:25:47 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:10.053 17:25:47 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:10.053 17:25:47 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:10.053 17:25:47 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:10.053 17:25:47 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:10.054 17:25:47 -- bdev/nbd_common.sh@41 -- # break 00:06:10.054 17:25:47 -- bdev/nbd_common.sh@45 -- # return 0 00:06:10.054 17:25:47 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:10.054 17:25:47 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@41 -- # break 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@45 -- # return 0 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:10.312 17:25:47 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:10.569 17:25:47 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:10.569 17:25:47 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:10.569 17:25:47 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:10.569 17:25:48 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:10.570 17:25:48 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:10.570 17:25:48 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:10.570 17:25:48 -- bdev/nbd_common.sh@65 -- # true 00:06:10.570 17:25:48 -- bdev/nbd_common.sh@65 -- # count=0 00:06:10.570 17:25:48 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:10.570 17:25:48 -- bdev/nbd_common.sh@104 -- # count=0 00:06:10.570 17:25:48 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:10.570 17:25:48 -- bdev/nbd_common.sh@109 -- # return 0 00:06:10.570 17:25:48 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:11.137 17:25:48 -- event/event.sh@35 -- # sleep 3 00:06:11.137 [2024-11-16 17:25:48.536612] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:11.137 [2024-11-16 17:25:48.625290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:11.137 [2024-11-16 17:25:48.625301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.398 [2024-11-16 17:25:48.686094] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:11.398 [2024-11-16 17:25:48.686168] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:13.933 17:25:51 -- event/event.sh@23 -- # for i in {0..2} 00:06:13.933 17:25:51 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:13.933 spdk_app_start Round 1 00:06:13.933 17:25:51 -- event/event.sh@25 -- # waitforlisten 1461920 /var/tmp/spdk-nbd.sock 00:06:13.933 17:25:51 -- common/autotest_common.sh@829 -- # '[' -z 1461920 ']' 00:06:13.933 17:25:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:13.933 17:25:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.933 17:25:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:13.933 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:13.933 17:25:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.933 17:25:51 -- common/autotest_common.sh@10 -- # set +x 00:06:14.191 17:25:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:14.191 17:25:51 -- common/autotest_common.sh@862 -- # return 0 00:06:14.191 17:25:51 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:14.448 Malloc0 00:06:14.448 17:25:51 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:14.705 Malloc1 00:06:14.705 17:25:52 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@12 -- # local i 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.705 17:25:52 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:14.963 /dev/nbd0 00:06:14.963 17:25:52 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:14.963 17:25:52 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:14.963 17:25:52 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:14.963 17:25:52 -- common/autotest_common.sh@867 -- # local i 00:06:14.963 17:25:52 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.963 17:25:52 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.963 17:25:52 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:14.963 17:25:52 -- common/autotest_common.sh@871 -- # break 00:06:14.963 17:25:52 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.963 17:25:52 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.963 17:25:52 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.963 1+0 records in 00:06:14.963 1+0 records out 00:06:14.963 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000207722 s, 19.7 MB/s 00:06:14.963 17:25:52 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.963 17:25:52 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.963 17:25:52 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.963 17:25:52 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.963 17:25:52 -- common/autotest_common.sh@887 -- # return 0 00:06:14.963 17:25:52 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.963 17:25:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.963 17:25:52 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:15.220 /dev/nbd1 00:06:15.220 17:25:52 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:15.220 17:25:52 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:15.220 17:25:52 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:15.220 17:25:52 -- common/autotest_common.sh@867 -- # local i 00:06:15.220 17:25:52 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:15.220 17:25:52 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:15.220 17:25:52 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:15.220 17:25:52 -- common/autotest_common.sh@871 -- # break 00:06:15.220 17:25:52 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:15.220 17:25:52 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:15.220 17:25:52 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:15.220 1+0 records in 00:06:15.220 1+0 records out 00:06:15.220 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000194154 s, 21.1 MB/s 00:06:15.220 17:25:52 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:15.220 17:25:52 -- common/autotest_common.sh@884 -- # size=4096 00:06:15.220 17:25:52 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:15.220 17:25:52 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:15.220 17:25:52 -- common/autotest_common.sh@887 -- # return 0 00:06:15.220 17:25:52 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:15.220 17:25:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:15.220 17:25:52 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:15.220 17:25:52 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.220 17:25:52 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:15.477 17:25:52 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:15.477 { 00:06:15.477 "nbd_device": "/dev/nbd0", 00:06:15.477 "bdev_name": "Malloc0" 00:06:15.477 }, 00:06:15.477 { 00:06:15.477 "nbd_device": "/dev/nbd1", 00:06:15.477 "bdev_name": "Malloc1" 00:06:15.477 } 00:06:15.477 ]' 00:06:15.477 17:25:52 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:15.477 { 00:06:15.477 "nbd_device": "/dev/nbd0", 00:06:15.477 "bdev_name": "Malloc0" 00:06:15.477 }, 00:06:15.477 { 00:06:15.477 "nbd_device": "/dev/nbd1", 00:06:15.477 "bdev_name": "Malloc1" 00:06:15.477 } 00:06:15.477 ]' 00:06:15.477 17:25:52 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:15.734 /dev/nbd1' 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:15.734 /dev/nbd1' 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@65 -- # count=2 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@95 -- # count=2 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.734 17:25:52 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:15.735 17:25:52 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.735 17:25:52 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:15.735 17:25:52 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:15.735 256+0 records in 00:06:15.735 256+0 records out 00:06:15.735 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00492791 s, 213 MB/s 00:06:15.735 17:25:52 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.735 17:25:52 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:15.735 256+0 records in 00:06:15.735 256+0 records out 00:06:15.735 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196497 s, 53.4 MB/s 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:15.735 256+0 records in 00:06:15.735 256+0 records out 00:06:15.735 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232613 s, 45.1 MB/s 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@51 -- # local i 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.735 17:25:53 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@41 -- # break 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.992 17:25:53 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@41 -- # break 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@45 -- # return 0 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:16.251 17:25:53 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@65 -- # true 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@65 -- # count=0 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@104 -- # count=0 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:16.509 17:25:53 -- bdev/nbd_common.sh@109 -- # return 0 00:06:16.509 17:25:53 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:16.769 17:25:54 -- event/event.sh@35 -- # sleep 3 00:06:17.028 [2024-11-16 17:25:54.390063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:17.028 [2024-11-16 17:25:54.476687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:17.028 [2024-11-16 17:25:54.476691] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.287 [2024-11-16 17:25:54.534389] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:17.288 [2024-11-16 17:25:54.534476] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:19.821 17:25:57 -- event/event.sh@23 -- # for i in {0..2} 00:06:19.821 17:25:57 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:19.821 spdk_app_start Round 2 00:06:19.821 17:25:57 -- event/event.sh@25 -- # waitforlisten 1461920 /var/tmp/spdk-nbd.sock 00:06:19.821 17:25:57 -- common/autotest_common.sh@829 -- # '[' -z 1461920 ']' 00:06:19.821 17:25:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:19.821 17:25:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.821 17:25:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:19.821 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:19.821 17:25:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.821 17:25:57 -- common/autotest_common.sh@10 -- # set +x 00:06:20.079 17:25:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.079 17:25:57 -- common/autotest_common.sh@862 -- # return 0 00:06:20.079 17:25:57 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.337 Malloc0 00:06:20.337 17:25:57 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.595 Malloc1 00:06:20.595 17:25:57 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@12 -- # local i 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:20.595 17:25:57 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.596 17:25:57 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:20.854 /dev/nbd0 00:06:20.854 17:25:58 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:20.854 17:25:58 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:20.854 17:25:58 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:20.854 17:25:58 -- common/autotest_common.sh@867 -- # local i 00:06:20.854 17:25:58 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.854 17:25:58 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.854 17:25:58 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:20.854 17:25:58 -- common/autotest_common.sh@871 -- # break 00:06:20.854 17:25:58 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.854 17:25:58 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.854 17:25:58 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.854 1+0 records in 00:06:20.854 1+0 records out 00:06:20.854 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203135 s, 20.2 MB/s 00:06:20.854 17:25:58 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.854 17:25:58 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.854 17:25:58 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.854 17:25:58 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.854 17:25:58 -- common/autotest_common.sh@887 -- # return 0 00:06:20.854 17:25:58 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.854 17:25:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.854 17:25:58 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:21.112 /dev/nbd1 00:06:21.112 17:25:58 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:21.112 17:25:58 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:21.112 17:25:58 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:21.112 17:25:58 -- common/autotest_common.sh@867 -- # local i 00:06:21.112 17:25:58 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:21.112 17:25:58 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:21.112 17:25:58 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:21.112 17:25:58 -- common/autotest_common.sh@871 -- # break 00:06:21.112 17:25:58 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:21.112 17:25:58 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:21.112 17:25:58 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:21.112 1+0 records in 00:06:21.112 1+0 records out 00:06:21.112 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000224491 s, 18.2 MB/s 00:06:21.112 17:25:58 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:21.112 17:25:58 -- common/autotest_common.sh@884 -- # size=4096 00:06:21.112 17:25:58 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:21.112 17:25:58 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:21.112 17:25:58 -- common/autotest_common.sh@887 -- # return 0 00:06:21.112 17:25:58 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:21.112 17:25:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:21.112 17:25:58 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:21.112 17:25:58 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.112 17:25:58 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:21.370 { 00:06:21.370 "nbd_device": "/dev/nbd0", 00:06:21.370 "bdev_name": "Malloc0" 00:06:21.370 }, 00:06:21.370 { 00:06:21.370 "nbd_device": "/dev/nbd1", 00:06:21.370 "bdev_name": "Malloc1" 00:06:21.370 } 00:06:21.370 ]' 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:21.370 { 00:06:21.370 "nbd_device": "/dev/nbd0", 00:06:21.370 "bdev_name": "Malloc0" 00:06:21.370 }, 00:06:21.370 { 00:06:21.370 "nbd_device": "/dev/nbd1", 00:06:21.370 "bdev_name": "Malloc1" 00:06:21.370 } 00:06:21.370 ]' 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:21.370 /dev/nbd1' 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:21.370 /dev/nbd1' 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@65 -- # count=2 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@95 -- # count=2 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.370 17:25:58 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:21.371 17:25:58 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.371 17:25:58 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:21.371 17:25:58 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:21.371 256+0 records in 00:06:21.371 256+0 records out 00:06:21.371 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00503086 s, 208 MB/s 00:06:21.371 17:25:58 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:21.371 17:25:58 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:21.371 256+0 records in 00:06:21.371 256+0 records out 00:06:21.371 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225746 s, 46.4 MB/s 00:06:21.371 17:25:58 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:21.371 17:25:58 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:21.629 256+0 records in 00:06:21.629 256+0 records out 00:06:21.629 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217829 s, 48.1 MB/s 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@51 -- # local i 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.629 17:25:58 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@41 -- # break 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.886 17:25:59 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@41 -- # break 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@45 -- # return 0 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:22.143 17:25:59 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@65 -- # true 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@65 -- # count=0 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@104 -- # count=0 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:22.402 17:25:59 -- bdev/nbd_common.sh@109 -- # return 0 00:06:22.402 17:25:59 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:22.660 17:26:00 -- event/event.sh@35 -- # sleep 3 00:06:22.920 [2024-11-16 17:26:00.272000] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:22.920 [2024-11-16 17:26:00.360717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.920 [2024-11-16 17:26:00.360734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.179 [2024-11-16 17:26:00.423165] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:23.179 [2024-11-16 17:26:00.423251] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:25.722 17:26:03 -- event/event.sh@38 -- # waitforlisten 1461920 /var/tmp/spdk-nbd.sock 00:06:25.722 17:26:03 -- common/autotest_common.sh@829 -- # '[' -z 1461920 ']' 00:06:25.722 17:26:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:25.722 17:26:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.722 17:26:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:25.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:25.722 17:26:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.722 17:26:03 -- common/autotest_common.sh@10 -- # set +x 00:06:25.982 17:26:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.982 17:26:03 -- common/autotest_common.sh@862 -- # return 0 00:06:25.982 17:26:03 -- event/event.sh@39 -- # killprocess 1461920 00:06:25.982 17:26:03 -- common/autotest_common.sh@936 -- # '[' -z 1461920 ']' 00:06:25.982 17:26:03 -- common/autotest_common.sh@940 -- # kill -0 1461920 00:06:25.982 17:26:03 -- common/autotest_common.sh@941 -- # uname 00:06:25.982 17:26:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.982 17:26:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1461920 00:06:25.982 17:26:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:25.982 17:26:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:25.982 17:26:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1461920' 00:06:25.982 killing process with pid 1461920 00:06:25.982 17:26:03 -- common/autotest_common.sh@955 -- # kill 1461920 00:06:25.982 17:26:03 -- common/autotest_common.sh@960 -- # wait 1461920 00:06:26.241 spdk_app_start is called in Round 0. 00:06:26.241 Shutdown signal received, stop current app iteration 00:06:26.241 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:26.241 spdk_app_start is called in Round 1. 00:06:26.241 Shutdown signal received, stop current app iteration 00:06:26.241 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:26.241 spdk_app_start is called in Round 2. 00:06:26.241 Shutdown signal received, stop current app iteration 00:06:26.241 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:26.241 spdk_app_start is called in Round 3. 00:06:26.241 Shutdown signal received, stop current app iteration 00:06:26.241 17:26:03 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:26.241 17:26:03 -- event/event.sh@42 -- # return 0 00:06:26.241 00:06:26.241 real 0m18.852s 00:06:26.241 user 0m41.427s 00:06:26.241 sys 0m3.157s 00:06:26.241 17:26:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.241 17:26:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.241 ************************************ 00:06:26.241 END TEST app_repeat 00:06:26.241 ************************************ 00:06:26.241 17:26:03 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:26.241 17:26:03 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:26.241 17:26:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.241 17:26:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.241 17:26:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.241 ************************************ 00:06:26.241 START TEST cpu_locks 00:06:26.241 ************************************ 00:06:26.241 17:26:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:26.241 * Looking for test storage... 00:06:26.241 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:26.241 17:26:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:26.241 17:26:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:26.241 17:26:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:26.241 17:26:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:26.241 17:26:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:26.241 17:26:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:26.241 17:26:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:26.241 17:26:03 -- scripts/common.sh@335 -- # IFS=.-: 00:06:26.241 17:26:03 -- scripts/common.sh@335 -- # read -ra ver1 00:06:26.241 17:26:03 -- scripts/common.sh@336 -- # IFS=.-: 00:06:26.241 17:26:03 -- scripts/common.sh@336 -- # read -ra ver2 00:06:26.241 17:26:03 -- scripts/common.sh@337 -- # local 'op=<' 00:06:26.241 17:26:03 -- scripts/common.sh@339 -- # ver1_l=2 00:06:26.241 17:26:03 -- scripts/common.sh@340 -- # ver2_l=1 00:06:26.241 17:26:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:26.241 17:26:03 -- scripts/common.sh@343 -- # case "$op" in 00:06:26.241 17:26:03 -- scripts/common.sh@344 -- # : 1 00:06:26.241 17:26:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:26.241 17:26:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:26.241 17:26:03 -- scripts/common.sh@364 -- # decimal 1 00:06:26.241 17:26:03 -- scripts/common.sh@352 -- # local d=1 00:06:26.241 17:26:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:26.241 17:26:03 -- scripts/common.sh@354 -- # echo 1 00:06:26.241 17:26:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:26.241 17:26:03 -- scripts/common.sh@365 -- # decimal 2 00:06:26.241 17:26:03 -- scripts/common.sh@352 -- # local d=2 00:06:26.241 17:26:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:26.241 17:26:03 -- scripts/common.sh@354 -- # echo 2 00:06:26.241 17:26:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:26.241 17:26:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:26.241 17:26:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:26.241 17:26:03 -- scripts/common.sh@367 -- # return 0 00:06:26.241 17:26:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:26.241 17:26:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:26.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.241 --rc genhtml_branch_coverage=1 00:06:26.241 --rc genhtml_function_coverage=1 00:06:26.241 --rc genhtml_legend=1 00:06:26.241 --rc geninfo_all_blocks=1 00:06:26.241 --rc geninfo_unexecuted_blocks=1 00:06:26.241 00:06:26.241 ' 00:06:26.241 17:26:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:26.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.241 --rc genhtml_branch_coverage=1 00:06:26.241 --rc genhtml_function_coverage=1 00:06:26.241 --rc genhtml_legend=1 00:06:26.241 --rc geninfo_all_blocks=1 00:06:26.241 --rc geninfo_unexecuted_blocks=1 00:06:26.241 00:06:26.241 ' 00:06:26.241 17:26:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:26.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.241 --rc genhtml_branch_coverage=1 00:06:26.241 --rc genhtml_function_coverage=1 00:06:26.241 --rc genhtml_legend=1 00:06:26.241 --rc geninfo_all_blocks=1 00:06:26.241 --rc geninfo_unexecuted_blocks=1 00:06:26.241 00:06:26.241 ' 00:06:26.241 17:26:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:26.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:26.241 --rc genhtml_branch_coverage=1 00:06:26.241 --rc genhtml_function_coverage=1 00:06:26.241 --rc genhtml_legend=1 00:06:26.241 --rc geninfo_all_blocks=1 00:06:26.241 --rc geninfo_unexecuted_blocks=1 00:06:26.241 00:06:26.241 ' 00:06:26.241 17:26:03 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:26.241 17:26:03 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:26.241 17:26:03 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:26.241 17:26:03 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:26.241 17:26:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:26.241 17:26:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.241 17:26:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.241 ************************************ 00:06:26.241 START TEST default_locks 00:06:26.241 ************************************ 00:06:26.241 17:26:03 -- common/autotest_common.sh@1114 -- # default_locks 00:06:26.241 17:26:03 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1464468 00:06:26.241 17:26:03 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:26.241 17:26:03 -- event/cpu_locks.sh@47 -- # waitforlisten 1464468 00:06:26.241 17:26:03 -- common/autotest_common.sh@829 -- # '[' -z 1464468 ']' 00:06:26.241 17:26:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.242 17:26:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:26.242 17:26:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.242 17:26:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:26.242 17:26:03 -- common/autotest_common.sh@10 -- # set +x 00:06:26.500 [2024-11-16 17:26:03.771304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.500 [2024-11-16 17:26:03.771381] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1464468 ] 00:06:26.500 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.500 [2024-11-16 17:26:03.828265] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.500 [2024-11-16 17:26:03.914712] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:26.500 [2024-11-16 17:26:03.914895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.437 17:26:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.437 17:26:04 -- common/autotest_common.sh@862 -- # return 0 00:06:27.437 17:26:04 -- event/cpu_locks.sh@49 -- # locks_exist 1464468 00:06:27.437 17:26:04 -- event/cpu_locks.sh@22 -- # lslocks -p 1464468 00:06:27.437 17:26:04 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:27.437 lslocks: write error 00:06:27.437 17:26:04 -- event/cpu_locks.sh@50 -- # killprocess 1464468 00:06:27.437 17:26:04 -- common/autotest_common.sh@936 -- # '[' -z 1464468 ']' 00:06:27.437 17:26:04 -- common/autotest_common.sh@940 -- # kill -0 1464468 00:06:27.437 17:26:04 -- common/autotest_common.sh@941 -- # uname 00:06:27.437 17:26:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:27.437 17:26:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1464468 00:06:27.695 17:26:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:27.695 17:26:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:27.695 17:26:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1464468' 00:06:27.695 killing process with pid 1464468 00:06:27.695 17:26:04 -- common/autotest_common.sh@955 -- # kill 1464468 00:06:27.695 17:26:04 -- common/autotest_common.sh@960 -- # wait 1464468 00:06:27.955 17:26:05 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1464468 00:06:27.955 17:26:05 -- common/autotest_common.sh@650 -- # local es=0 00:06:27.955 17:26:05 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1464468 00:06:27.955 17:26:05 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:27.955 17:26:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.955 17:26:05 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:27.955 17:26:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.955 17:26:05 -- common/autotest_common.sh@653 -- # waitforlisten 1464468 00:06:27.955 17:26:05 -- common/autotest_common.sh@829 -- # '[' -z 1464468 ']' 00:06:27.955 17:26:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.955 17:26:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.955 17:26:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.955 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.955 17:26:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.955 17:26:05 -- common/autotest_common.sh@10 -- # set +x 00:06:27.955 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1464468) - No such process 00:06:27.955 ERROR: process (pid: 1464468) is no longer running 00:06:27.955 17:26:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.955 17:26:05 -- common/autotest_common.sh@862 -- # return 1 00:06:27.955 17:26:05 -- common/autotest_common.sh@653 -- # es=1 00:06:27.955 17:26:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:27.955 17:26:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:27.955 17:26:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:27.955 17:26:05 -- event/cpu_locks.sh@54 -- # no_locks 00:06:27.955 17:26:05 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:27.955 17:26:05 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:27.955 17:26:05 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:27.955 00:06:27.955 real 0m1.643s 00:06:27.955 user 0m1.772s 00:06:27.955 sys 0m0.536s 00:06:27.955 17:26:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.955 17:26:05 -- common/autotest_common.sh@10 -- # set +x 00:06:27.955 ************************************ 00:06:27.955 END TEST default_locks 00:06:27.955 ************************************ 00:06:27.955 17:26:05 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:27.955 17:26:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.955 17:26:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.955 17:26:05 -- common/autotest_common.sh@10 -- # set +x 00:06:27.955 ************************************ 00:06:27.955 START TEST default_locks_via_rpc 00:06:27.955 ************************************ 00:06:27.955 17:26:05 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:27.955 17:26:05 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1464763 00:06:27.955 17:26:05 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:27.955 17:26:05 -- event/cpu_locks.sh@63 -- # waitforlisten 1464763 00:06:27.955 17:26:05 -- common/autotest_common.sh@829 -- # '[' -z 1464763 ']' 00:06:27.955 17:26:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.955 17:26:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.955 17:26:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.955 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.955 17:26:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.955 17:26:05 -- common/autotest_common.sh@10 -- # set +x 00:06:27.955 [2024-11-16 17:26:05.445710] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.955 [2024-11-16 17:26:05.445816] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1464763 ] 00:06:28.216 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.216 [2024-11-16 17:26:05.503442] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:28.216 [2024-11-16 17:26:05.591167] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:28.216 [2024-11-16 17:26:05.591354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.159 17:26:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:29.159 17:26:06 -- common/autotest_common.sh@862 -- # return 0 00:06:29.159 17:26:06 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:29.159 17:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.159 17:26:06 -- common/autotest_common.sh@10 -- # set +x 00:06:29.159 17:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.159 17:26:06 -- event/cpu_locks.sh@67 -- # no_locks 00:06:29.159 17:26:06 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:29.159 17:26:06 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:29.159 17:26:06 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:29.159 17:26:06 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:29.159 17:26:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:29.159 17:26:06 -- common/autotest_common.sh@10 -- # set +x 00:06:29.159 17:26:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:29.159 17:26:06 -- event/cpu_locks.sh@71 -- # locks_exist 1464763 00:06:29.159 17:26:06 -- event/cpu_locks.sh@22 -- # lslocks -p 1464763 00:06:29.159 17:26:06 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:29.159 17:26:06 -- event/cpu_locks.sh@73 -- # killprocess 1464763 00:06:29.159 17:26:06 -- common/autotest_common.sh@936 -- # '[' -z 1464763 ']' 00:06:29.159 17:26:06 -- common/autotest_common.sh@940 -- # kill -0 1464763 00:06:29.159 17:26:06 -- common/autotest_common.sh@941 -- # uname 00:06:29.159 17:26:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:29.159 17:26:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1464763 00:06:29.419 17:26:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:29.419 17:26:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:29.419 17:26:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1464763' 00:06:29.419 killing process with pid 1464763 00:06:29.419 17:26:06 -- common/autotest_common.sh@955 -- # kill 1464763 00:06:29.419 17:26:06 -- common/autotest_common.sh@960 -- # wait 1464763 00:06:29.680 00:06:29.680 real 0m1.688s 00:06:29.680 user 0m1.835s 00:06:29.680 sys 0m0.541s 00:06:29.680 17:26:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.680 17:26:07 -- common/autotest_common.sh@10 -- # set +x 00:06:29.680 ************************************ 00:06:29.680 END TEST default_locks_via_rpc 00:06:29.680 ************************************ 00:06:29.680 17:26:07 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:29.680 17:26:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.680 17:26:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.680 17:26:07 -- common/autotest_common.sh@10 -- # set +x 00:06:29.680 ************************************ 00:06:29.680 START TEST non_locking_app_on_locked_coremask 00:06:29.680 ************************************ 00:06:29.680 17:26:07 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:29.680 17:26:07 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1464939 00:06:29.680 17:26:07 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:29.680 17:26:07 -- event/cpu_locks.sh@81 -- # waitforlisten 1464939 /var/tmp/spdk.sock 00:06:29.680 17:26:07 -- common/autotest_common.sh@829 -- # '[' -z 1464939 ']' 00:06:29.680 17:26:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.680 17:26:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.680 17:26:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.680 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.680 17:26:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.680 17:26:07 -- common/autotest_common.sh@10 -- # set +x 00:06:29.680 [2024-11-16 17:26:07.158544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.680 [2024-11-16 17:26:07.158678] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1464939 ] 00:06:29.938 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.938 [2024-11-16 17:26:07.217551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.938 [2024-11-16 17:26:07.304882] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.938 [2024-11-16 17:26:07.305068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.877 17:26:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.877 17:26:08 -- common/autotest_common.sh@862 -- # return 0 00:06:30.877 17:26:08 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1465075 00:06:30.877 17:26:08 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:30.877 17:26:08 -- event/cpu_locks.sh@85 -- # waitforlisten 1465075 /var/tmp/spdk2.sock 00:06:30.877 17:26:08 -- common/autotest_common.sh@829 -- # '[' -z 1465075 ']' 00:06:30.877 17:26:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:30.877 17:26:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:30.877 17:26:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:30.877 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:30.877 17:26:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:30.877 17:26:08 -- common/autotest_common.sh@10 -- # set +x 00:06:30.877 [2024-11-16 17:26:08.167394] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.877 [2024-11-16 17:26:08.167486] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1465075 ] 00:06:30.877 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.877 [2024-11-16 17:26:08.259414] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:30.877 [2024-11-16 17:26:08.259447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.137 [2024-11-16 17:26:08.439919] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:31.137 [2024-11-16 17:26:08.440088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.703 17:26:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:31.703 17:26:09 -- common/autotest_common.sh@862 -- # return 0 00:06:31.703 17:26:09 -- event/cpu_locks.sh@87 -- # locks_exist 1464939 00:06:31.703 17:26:09 -- event/cpu_locks.sh@22 -- # lslocks -p 1464939 00:06:31.703 17:26:09 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:31.962 lslocks: write error 00:06:31.962 17:26:09 -- event/cpu_locks.sh@89 -- # killprocess 1464939 00:06:31.962 17:26:09 -- common/autotest_common.sh@936 -- # '[' -z 1464939 ']' 00:06:31.962 17:26:09 -- common/autotest_common.sh@940 -- # kill -0 1464939 00:06:31.962 17:26:09 -- common/autotest_common.sh@941 -- # uname 00:06:32.219 17:26:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:32.219 17:26:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1464939 00:06:32.219 17:26:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:32.219 17:26:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:32.219 17:26:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1464939' 00:06:32.219 killing process with pid 1464939 00:06:32.219 17:26:09 -- common/autotest_common.sh@955 -- # kill 1464939 00:06:32.219 17:26:09 -- common/autotest_common.sh@960 -- # wait 1464939 00:06:33.160 17:26:10 -- event/cpu_locks.sh@90 -- # killprocess 1465075 00:06:33.160 17:26:10 -- common/autotest_common.sh@936 -- # '[' -z 1465075 ']' 00:06:33.160 17:26:10 -- common/autotest_common.sh@940 -- # kill -0 1465075 00:06:33.160 17:26:10 -- common/autotest_common.sh@941 -- # uname 00:06:33.160 17:26:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:33.160 17:26:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1465075 00:06:33.160 17:26:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:33.160 17:26:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:33.160 17:26:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1465075' 00:06:33.160 killing process with pid 1465075 00:06:33.160 17:26:10 -- common/autotest_common.sh@955 -- # kill 1465075 00:06:33.160 17:26:10 -- common/autotest_common.sh@960 -- # wait 1465075 00:06:33.419 00:06:33.419 real 0m3.628s 00:06:33.419 user 0m4.000s 00:06:33.419 sys 0m1.055s 00:06:33.419 17:26:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.419 17:26:10 -- common/autotest_common.sh@10 -- # set +x 00:06:33.419 ************************************ 00:06:33.419 END TEST non_locking_app_on_locked_coremask 00:06:33.419 ************************************ 00:06:33.419 17:26:10 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:33.419 17:26:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:33.419 17:26:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.419 17:26:10 -- common/autotest_common.sh@10 -- # set +x 00:06:33.419 ************************************ 00:06:33.419 START TEST locking_app_on_unlocked_coremask 00:06:33.419 ************************************ 00:06:33.419 17:26:10 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:33.419 17:26:10 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1465457 00:06:33.419 17:26:10 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:33.419 17:26:10 -- event/cpu_locks.sh@99 -- # waitforlisten 1465457 /var/tmp/spdk.sock 00:06:33.419 17:26:10 -- common/autotest_common.sh@829 -- # '[' -z 1465457 ']' 00:06:33.419 17:26:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:33.419 17:26:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:33.419 17:26:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:33.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:33.419 17:26:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:33.419 17:26:10 -- common/autotest_common.sh@10 -- # set +x 00:06:33.419 [2024-11-16 17:26:10.814340] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.419 [2024-11-16 17:26:10.814420] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1465457 ] 00:06:33.419 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.419 [2024-11-16 17:26:10.873979] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:33.419 [2024-11-16 17:26:10.874017] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.679 [2024-11-16 17:26:10.961164] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:33.679 [2024-11-16 17:26:10.961348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.617 17:26:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:34.617 17:26:11 -- common/autotest_common.sh@862 -- # return 0 00:06:34.617 17:26:11 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1465528 00:06:34.617 17:26:11 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:34.617 17:26:11 -- event/cpu_locks.sh@103 -- # waitforlisten 1465528 /var/tmp/spdk2.sock 00:06:34.617 17:26:11 -- common/autotest_common.sh@829 -- # '[' -z 1465528 ']' 00:06:34.617 17:26:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:34.617 17:26:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.617 17:26:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:34.617 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:34.617 17:26:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.617 17:26:11 -- common/autotest_common.sh@10 -- # set +x 00:06:34.617 [2024-11-16 17:26:11.818887] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.617 [2024-11-16 17:26:11.818966] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1465528 ] 00:06:34.617 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.617 [2024-11-16 17:26:11.915930] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.617 [2024-11-16 17:26:12.093108] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:34.617 [2024-11-16 17:26:12.093317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.554 17:26:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.554 17:26:12 -- common/autotest_common.sh@862 -- # return 0 00:06:35.554 17:26:12 -- event/cpu_locks.sh@105 -- # locks_exist 1465528 00:06:35.554 17:26:12 -- event/cpu_locks.sh@22 -- # lslocks -p 1465528 00:06:35.554 17:26:12 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:35.814 lslocks: write error 00:06:35.814 17:26:13 -- event/cpu_locks.sh@107 -- # killprocess 1465457 00:06:35.814 17:26:13 -- common/autotest_common.sh@936 -- # '[' -z 1465457 ']' 00:06:35.814 17:26:13 -- common/autotest_common.sh@940 -- # kill -0 1465457 00:06:35.814 17:26:13 -- common/autotest_common.sh@941 -- # uname 00:06:35.814 17:26:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.814 17:26:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1465457 00:06:35.814 17:26:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.814 17:26:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.814 17:26:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1465457' 00:06:35.814 killing process with pid 1465457 00:06:35.814 17:26:13 -- common/autotest_common.sh@955 -- # kill 1465457 00:06:35.814 17:26:13 -- common/autotest_common.sh@960 -- # wait 1465457 00:06:36.753 17:26:14 -- event/cpu_locks.sh@108 -- # killprocess 1465528 00:06:36.753 17:26:14 -- common/autotest_common.sh@936 -- # '[' -z 1465528 ']' 00:06:36.753 17:26:14 -- common/autotest_common.sh@940 -- # kill -0 1465528 00:06:36.753 17:26:14 -- common/autotest_common.sh@941 -- # uname 00:06:36.753 17:26:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:36.753 17:26:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1465528 00:06:36.753 17:26:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:36.753 17:26:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:36.753 17:26:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1465528' 00:06:36.753 killing process with pid 1465528 00:06:36.753 17:26:14 -- common/autotest_common.sh@955 -- # kill 1465528 00:06:36.753 17:26:14 -- common/autotest_common.sh@960 -- # wait 1465528 00:06:37.049 00:06:37.049 real 0m3.666s 00:06:37.049 user 0m4.050s 00:06:37.049 sys 0m1.072s 00:06:37.049 17:26:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.049 17:26:14 -- common/autotest_common.sh@10 -- # set +x 00:06:37.049 ************************************ 00:06:37.049 END TEST locking_app_on_unlocked_coremask 00:06:37.049 ************************************ 00:06:37.049 17:26:14 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:37.049 17:26:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.049 17:26:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.049 17:26:14 -- common/autotest_common.sh@10 -- # set +x 00:06:37.049 ************************************ 00:06:37.049 START TEST locking_app_on_locked_coremask 00:06:37.049 ************************************ 00:06:37.049 17:26:14 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:37.049 17:26:14 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1465962 00:06:37.049 17:26:14 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:37.049 17:26:14 -- event/cpu_locks.sh@116 -- # waitforlisten 1465962 /var/tmp/spdk.sock 00:06:37.049 17:26:14 -- common/autotest_common.sh@829 -- # '[' -z 1465962 ']' 00:06:37.049 17:26:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.049 17:26:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.049 17:26:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.049 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.049 17:26:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.049 17:26:14 -- common/autotest_common.sh@10 -- # set +x 00:06:37.049 [2024-11-16 17:26:14.509863] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:37.049 [2024-11-16 17:26:14.509950] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1465962 ] 00:06:37.334 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.334 [2024-11-16 17:26:14.574602] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.334 [2024-11-16 17:26:14.659489] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:37.334 [2024-11-16 17:26:14.659700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.270 17:26:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.270 17:26:15 -- common/autotest_common.sh@862 -- # return 0 00:06:38.270 17:26:15 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1466108 00:06:38.270 17:26:15 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:38.270 17:26:15 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1466108 /var/tmp/spdk2.sock 00:06:38.270 17:26:15 -- common/autotest_common.sh@650 -- # local es=0 00:06:38.271 17:26:15 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1466108 /var/tmp/spdk2.sock 00:06:38.271 17:26:15 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:38.271 17:26:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.271 17:26:15 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:38.271 17:26:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.271 17:26:15 -- common/autotest_common.sh@653 -- # waitforlisten 1466108 /var/tmp/spdk2.sock 00:06:38.271 17:26:15 -- common/autotest_common.sh@829 -- # '[' -z 1466108 ']' 00:06:38.271 17:26:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:38.271 17:26:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.271 17:26:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:38.271 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:38.271 17:26:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.271 17:26:15 -- common/autotest_common.sh@10 -- # set +x 00:06:38.271 [2024-11-16 17:26:15.545049] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:38.271 [2024-11-16 17:26:15.545124] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466108 ] 00:06:38.271 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.271 [2024-11-16 17:26:15.639198] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1465962 has claimed it. 00:06:38.271 [2024-11-16 17:26:15.639256] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:38.840 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1466108) - No such process 00:06:38.840 ERROR: process (pid: 1466108) is no longer running 00:06:38.840 17:26:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.840 17:26:16 -- common/autotest_common.sh@862 -- # return 1 00:06:38.840 17:26:16 -- common/autotest_common.sh@653 -- # es=1 00:06:38.840 17:26:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:38.840 17:26:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:38.841 17:26:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:38.841 17:26:16 -- event/cpu_locks.sh@122 -- # locks_exist 1465962 00:06:38.841 17:26:16 -- event/cpu_locks.sh@22 -- # lslocks -p 1465962 00:06:38.841 17:26:16 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:39.099 lslocks: write error 00:06:39.099 17:26:16 -- event/cpu_locks.sh@124 -- # killprocess 1465962 00:06:39.099 17:26:16 -- common/autotest_common.sh@936 -- # '[' -z 1465962 ']' 00:06:39.099 17:26:16 -- common/autotest_common.sh@940 -- # kill -0 1465962 00:06:39.099 17:26:16 -- common/autotest_common.sh@941 -- # uname 00:06:39.099 17:26:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.099 17:26:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1465962 00:06:39.099 17:26:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.099 17:26:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.099 17:26:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1465962' 00:06:39.099 killing process with pid 1465962 00:06:39.099 17:26:16 -- common/autotest_common.sh@955 -- # kill 1465962 00:06:39.099 17:26:16 -- common/autotest_common.sh@960 -- # wait 1465962 00:06:39.667 00:06:39.667 real 0m2.516s 00:06:39.667 user 0m2.924s 00:06:39.667 sys 0m0.648s 00:06:39.667 17:26:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.667 17:26:16 -- common/autotest_common.sh@10 -- # set +x 00:06:39.667 ************************************ 00:06:39.667 END TEST locking_app_on_locked_coremask 00:06:39.667 ************************************ 00:06:39.667 17:26:16 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:39.667 17:26:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.667 17:26:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.667 17:26:16 -- common/autotest_common.sh@10 -- # set +x 00:06:39.667 ************************************ 00:06:39.667 START TEST locking_overlapped_coremask 00:06:39.667 ************************************ 00:06:39.667 17:26:17 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:39.667 17:26:17 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1466278 00:06:39.667 17:26:17 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:39.667 17:26:17 -- event/cpu_locks.sh@133 -- # waitforlisten 1466278 /var/tmp/spdk.sock 00:06:39.667 17:26:17 -- common/autotest_common.sh@829 -- # '[' -z 1466278 ']' 00:06:39.667 17:26:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.667 17:26:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.667 17:26:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.667 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.667 17:26:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.667 17:26:17 -- common/autotest_common.sh@10 -- # set +x 00:06:39.667 [2024-11-16 17:26:17.053146] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.667 [2024-11-16 17:26:17.053256] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466278 ] 00:06:39.667 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.668 [2024-11-16 17:26:17.111426] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:39.925 [2024-11-16 17:26:17.201416] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.925 [2024-11-16 17:26:17.201665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:39.925 [2024-11-16 17:26:17.201732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:39.925 [2024-11-16 17:26:17.201735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.862 17:26:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.862 17:26:18 -- common/autotest_common.sh@862 -- # return 0 00:06:40.862 17:26:18 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1466422 00:06:40.862 17:26:18 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1466422 /var/tmp/spdk2.sock 00:06:40.862 17:26:18 -- common/autotest_common.sh@650 -- # local es=0 00:06:40.862 17:26:18 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 1466422 /var/tmp/spdk2.sock 00:06:40.862 17:26:18 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:40.862 17:26:18 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:40.862 17:26:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.862 17:26:18 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:40.862 17:26:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.862 17:26:18 -- common/autotest_common.sh@653 -- # waitforlisten 1466422 /var/tmp/spdk2.sock 00:06:40.862 17:26:18 -- common/autotest_common.sh@829 -- # '[' -z 1466422 ']' 00:06:40.862 17:26:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:40.862 17:26:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:40.862 17:26:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:40.862 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:40.862 17:26:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:40.862 17:26:18 -- common/autotest_common.sh@10 -- # set +x 00:06:40.862 [2024-11-16 17:26:18.060855] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:40.862 [2024-11-16 17:26:18.060942] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466422 ] 00:06:40.862 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.862 [2024-11-16 17:26:18.149122] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1466278 has claimed it. 00:06:40.862 [2024-11-16 17:26:18.149191] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:41.431 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (1466422) - No such process 00:06:41.431 ERROR: process (pid: 1466422) is no longer running 00:06:41.431 17:26:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:41.431 17:26:18 -- common/autotest_common.sh@862 -- # return 1 00:06:41.431 17:26:18 -- common/autotest_common.sh@653 -- # es=1 00:06:41.431 17:26:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:41.431 17:26:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:41.431 17:26:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:41.431 17:26:18 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:41.431 17:26:18 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:41.431 17:26:18 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:41.431 17:26:18 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:41.431 17:26:18 -- event/cpu_locks.sh@141 -- # killprocess 1466278 00:06:41.431 17:26:18 -- common/autotest_common.sh@936 -- # '[' -z 1466278 ']' 00:06:41.431 17:26:18 -- common/autotest_common.sh@940 -- # kill -0 1466278 00:06:41.431 17:26:18 -- common/autotest_common.sh@941 -- # uname 00:06:41.431 17:26:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.431 17:26:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466278 00:06:41.431 17:26:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.431 17:26:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.431 17:26:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466278' 00:06:41.431 killing process with pid 1466278 00:06:41.431 17:26:18 -- common/autotest_common.sh@955 -- # kill 1466278 00:06:41.431 17:26:18 -- common/autotest_common.sh@960 -- # wait 1466278 00:06:41.691 00:06:41.691 real 0m2.177s 00:06:41.691 user 0m6.280s 00:06:41.691 sys 0m0.467s 00:06:41.691 17:26:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.691 17:26:19 -- common/autotest_common.sh@10 -- # set +x 00:06:41.691 ************************************ 00:06:41.691 END TEST locking_overlapped_coremask 00:06:41.691 ************************************ 00:06:41.952 17:26:19 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:41.952 17:26:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.952 17:26:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.952 17:26:19 -- common/autotest_common.sh@10 -- # set +x 00:06:41.952 ************************************ 00:06:41.952 START TEST locking_overlapped_coremask_via_rpc 00:06:41.952 ************************************ 00:06:41.952 17:26:19 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:41.952 17:26:19 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1466586 00:06:41.952 17:26:19 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:41.952 17:26:19 -- event/cpu_locks.sh@149 -- # waitforlisten 1466586 /var/tmp/spdk.sock 00:06:41.952 17:26:19 -- common/autotest_common.sh@829 -- # '[' -z 1466586 ']' 00:06:41.952 17:26:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.952 17:26:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:41.952 17:26:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.952 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.952 17:26:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:41.952 17:26:19 -- common/autotest_common.sh@10 -- # set +x 00:06:41.952 [2024-11-16 17:26:19.258217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:41.952 [2024-11-16 17:26:19.258297] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466586 ] 00:06:41.952 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.952 [2024-11-16 17:26:19.319730] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:41.952 [2024-11-16 17:26:19.319776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:41.952 [2024-11-16 17:26:19.406457] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.952 [2024-11-16 17:26:19.406688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:41.952 [2024-11-16 17:26:19.406736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:41.952 [2024-11-16 17:26:19.406740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.888 17:26:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.888 17:26:20 -- common/autotest_common.sh@862 -- # return 0 00:06:42.888 17:26:20 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1466728 00:06:42.888 17:26:20 -- event/cpu_locks.sh@153 -- # waitforlisten 1466728 /var/tmp/spdk2.sock 00:06:42.888 17:26:20 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:42.888 17:26:20 -- common/autotest_common.sh@829 -- # '[' -z 1466728 ']' 00:06:42.888 17:26:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:42.888 17:26:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.888 17:26:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:42.888 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:42.888 17:26:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.888 17:26:20 -- common/autotest_common.sh@10 -- # set +x 00:06:42.888 [2024-11-16 17:26:20.254478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:42.888 [2024-11-16 17:26:20.254555] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1466728 ] 00:06:42.888 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.888 [2024-11-16 17:26:20.344756] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:42.888 [2024-11-16 17:26:20.344800] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:43.147 [2024-11-16 17:26:20.515506] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:43.147 [2024-11-16 17:26:20.519741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:43.147 [2024-11-16 17:26:20.519797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:43.148 [2024-11-16 17:26:20.519798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:44.084 17:26:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.084 17:26:21 -- common/autotest_common.sh@862 -- # return 0 00:06:44.084 17:26:21 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:44.084 17:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.084 17:26:21 -- common/autotest_common.sh@10 -- # set +x 00:06:44.084 17:26:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:44.084 17:26:21 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:44.084 17:26:21 -- common/autotest_common.sh@650 -- # local es=0 00:06:44.084 17:26:21 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:44.084 17:26:21 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:44.084 17:26:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.084 17:26:21 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:44.084 17:26:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.084 17:26:21 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:44.084 17:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:44.084 17:26:21 -- common/autotest_common.sh@10 -- # set +x 00:06:44.084 [2024-11-16 17:26:21.257731] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1466586 has claimed it. 00:06:44.084 request: 00:06:44.084 { 00:06:44.084 "method": "framework_enable_cpumask_locks", 00:06:44.084 "req_id": 1 00:06:44.084 } 00:06:44.084 Got JSON-RPC error response 00:06:44.084 response: 00:06:44.084 { 00:06:44.084 "code": -32603, 00:06:44.084 "message": "Failed to claim CPU core: 2" 00:06:44.084 } 00:06:44.084 17:26:21 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:44.084 17:26:21 -- common/autotest_common.sh@653 -- # es=1 00:06:44.084 17:26:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:44.084 17:26:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:44.084 17:26:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:44.084 17:26:21 -- event/cpu_locks.sh@158 -- # waitforlisten 1466586 /var/tmp/spdk.sock 00:06:44.084 17:26:21 -- common/autotest_common.sh@829 -- # '[' -z 1466586 ']' 00:06:44.084 17:26:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:44.084 17:26:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:44.084 17:26:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:44.084 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:44.084 17:26:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:44.084 17:26:21 -- common/autotest_common.sh@10 -- # set +x 00:06:44.084 17:26:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.084 17:26:21 -- common/autotest_common.sh@862 -- # return 0 00:06:44.084 17:26:21 -- event/cpu_locks.sh@159 -- # waitforlisten 1466728 /var/tmp/spdk2.sock 00:06:44.084 17:26:21 -- common/autotest_common.sh@829 -- # '[' -z 1466728 ']' 00:06:44.084 17:26:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:44.084 17:26:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:44.084 17:26:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:44.084 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:44.084 17:26:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:44.084 17:26:21 -- common/autotest_common.sh@10 -- # set +x 00:06:44.343 17:26:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.343 17:26:21 -- common/autotest_common.sh@862 -- # return 0 00:06:44.343 17:26:21 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:44.343 17:26:21 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:44.343 17:26:21 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:44.343 17:26:21 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:44.343 00:06:44.343 real 0m2.558s 00:06:44.343 user 0m1.283s 00:06:44.343 sys 0m0.207s 00:06:44.343 17:26:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.343 17:26:21 -- common/autotest_common.sh@10 -- # set +x 00:06:44.343 ************************************ 00:06:44.343 END TEST locking_overlapped_coremask_via_rpc 00:06:44.343 ************************************ 00:06:44.343 17:26:21 -- event/cpu_locks.sh@174 -- # cleanup 00:06:44.343 17:26:21 -- event/cpu_locks.sh@15 -- # [[ -z 1466586 ]] 00:06:44.343 17:26:21 -- event/cpu_locks.sh@15 -- # killprocess 1466586 00:06:44.344 17:26:21 -- common/autotest_common.sh@936 -- # '[' -z 1466586 ']' 00:06:44.344 17:26:21 -- common/autotest_common.sh@940 -- # kill -0 1466586 00:06:44.344 17:26:21 -- common/autotest_common.sh@941 -- # uname 00:06:44.344 17:26:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.344 17:26:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466586 00:06:44.344 17:26:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.344 17:26:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.344 17:26:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466586' 00:06:44.344 killing process with pid 1466586 00:06:44.344 17:26:21 -- common/autotest_common.sh@955 -- # kill 1466586 00:06:44.344 17:26:21 -- common/autotest_common.sh@960 -- # wait 1466586 00:06:44.914 17:26:22 -- event/cpu_locks.sh@16 -- # [[ -z 1466728 ]] 00:06:44.914 17:26:22 -- event/cpu_locks.sh@16 -- # killprocess 1466728 00:06:44.914 17:26:22 -- common/autotest_common.sh@936 -- # '[' -z 1466728 ']' 00:06:44.914 17:26:22 -- common/autotest_common.sh@940 -- # kill -0 1466728 00:06:44.914 17:26:22 -- common/autotest_common.sh@941 -- # uname 00:06:44.914 17:26:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.914 17:26:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1466728 00:06:44.914 17:26:22 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:44.914 17:26:22 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:44.914 17:26:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1466728' 00:06:44.914 killing process with pid 1466728 00:06:44.914 17:26:22 -- common/autotest_common.sh@955 -- # kill 1466728 00:06:44.914 17:26:22 -- common/autotest_common.sh@960 -- # wait 1466728 00:06:45.174 17:26:22 -- event/cpu_locks.sh@18 -- # rm -f 00:06:45.174 17:26:22 -- event/cpu_locks.sh@1 -- # cleanup 00:06:45.174 17:26:22 -- event/cpu_locks.sh@15 -- # [[ -z 1466586 ]] 00:06:45.174 17:26:22 -- event/cpu_locks.sh@15 -- # killprocess 1466586 00:06:45.174 17:26:22 -- common/autotest_common.sh@936 -- # '[' -z 1466586 ']' 00:06:45.174 17:26:22 -- common/autotest_common.sh@940 -- # kill -0 1466586 00:06:45.174 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1466586) - No such process 00:06:45.174 17:26:22 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1466586 is not found' 00:06:45.174 Process with pid 1466586 is not found 00:06:45.174 17:26:22 -- event/cpu_locks.sh@16 -- # [[ -z 1466728 ]] 00:06:45.174 17:26:22 -- event/cpu_locks.sh@16 -- # killprocess 1466728 00:06:45.174 17:26:22 -- common/autotest_common.sh@936 -- # '[' -z 1466728 ']' 00:06:45.174 17:26:22 -- common/autotest_common.sh@940 -- # kill -0 1466728 00:06:45.174 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1466728) - No such process 00:06:45.174 17:26:22 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1466728 is not found' 00:06:45.174 Process with pid 1466728 is not found 00:06:45.174 17:26:22 -- event/cpu_locks.sh@18 -- # rm -f 00:06:45.174 00:06:45.174 real 0m19.086s 00:06:45.174 user 0m34.861s 00:06:45.174 sys 0m5.351s 00:06:45.174 17:26:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.174 17:26:22 -- common/autotest_common.sh@10 -- # set +x 00:06:45.435 ************************************ 00:06:45.435 END TEST cpu_locks 00:06:45.435 ************************************ 00:06:45.435 00:06:45.435 real 0m44.984s 00:06:45.435 user 1m26.791s 00:06:45.435 sys 0m9.326s 00:06:45.435 17:26:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.435 17:26:22 -- common/autotest_common.sh@10 -- # set +x 00:06:45.435 ************************************ 00:06:45.435 END TEST event 00:06:45.435 ************************************ 00:06:45.435 17:26:22 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:45.435 17:26:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.435 17:26:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.435 17:26:22 -- common/autotest_common.sh@10 -- # set +x 00:06:45.435 ************************************ 00:06:45.435 START TEST thread 00:06:45.435 ************************************ 00:06:45.435 17:26:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:45.435 * Looking for test storage... 00:06:45.435 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:45.435 17:26:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:45.435 17:26:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:45.435 17:26:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:45.435 17:26:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:45.435 17:26:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:45.435 17:26:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:45.435 17:26:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:45.435 17:26:22 -- scripts/common.sh@335 -- # IFS=.-: 00:06:45.435 17:26:22 -- scripts/common.sh@335 -- # read -ra ver1 00:06:45.435 17:26:22 -- scripts/common.sh@336 -- # IFS=.-: 00:06:45.435 17:26:22 -- scripts/common.sh@336 -- # read -ra ver2 00:06:45.435 17:26:22 -- scripts/common.sh@337 -- # local 'op=<' 00:06:45.435 17:26:22 -- scripts/common.sh@339 -- # ver1_l=2 00:06:45.435 17:26:22 -- scripts/common.sh@340 -- # ver2_l=1 00:06:45.435 17:26:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:45.435 17:26:22 -- scripts/common.sh@343 -- # case "$op" in 00:06:45.435 17:26:22 -- scripts/common.sh@344 -- # : 1 00:06:45.435 17:26:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:45.435 17:26:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:45.435 17:26:22 -- scripts/common.sh@364 -- # decimal 1 00:06:45.435 17:26:22 -- scripts/common.sh@352 -- # local d=1 00:06:45.435 17:26:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:45.435 17:26:22 -- scripts/common.sh@354 -- # echo 1 00:06:45.435 17:26:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:45.435 17:26:22 -- scripts/common.sh@365 -- # decimal 2 00:06:45.435 17:26:22 -- scripts/common.sh@352 -- # local d=2 00:06:45.435 17:26:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:45.435 17:26:22 -- scripts/common.sh@354 -- # echo 2 00:06:45.435 17:26:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:45.435 17:26:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:45.435 17:26:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:45.435 17:26:22 -- scripts/common.sh@367 -- # return 0 00:06:45.435 17:26:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:45.435 17:26:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:45.435 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.435 --rc genhtml_branch_coverage=1 00:06:45.435 --rc genhtml_function_coverage=1 00:06:45.435 --rc genhtml_legend=1 00:06:45.435 --rc geninfo_all_blocks=1 00:06:45.435 --rc geninfo_unexecuted_blocks=1 00:06:45.435 00:06:45.435 ' 00:06:45.435 17:26:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:45.435 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.435 --rc genhtml_branch_coverage=1 00:06:45.435 --rc genhtml_function_coverage=1 00:06:45.435 --rc genhtml_legend=1 00:06:45.435 --rc geninfo_all_blocks=1 00:06:45.435 --rc geninfo_unexecuted_blocks=1 00:06:45.435 00:06:45.435 ' 00:06:45.435 17:26:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:45.435 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.435 --rc genhtml_branch_coverage=1 00:06:45.435 --rc genhtml_function_coverage=1 00:06:45.435 --rc genhtml_legend=1 00:06:45.435 --rc geninfo_all_blocks=1 00:06:45.435 --rc geninfo_unexecuted_blocks=1 00:06:45.435 00:06:45.435 ' 00:06:45.435 17:26:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:45.435 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.435 --rc genhtml_branch_coverage=1 00:06:45.435 --rc genhtml_function_coverage=1 00:06:45.435 --rc genhtml_legend=1 00:06:45.435 --rc geninfo_all_blocks=1 00:06:45.435 --rc geninfo_unexecuted_blocks=1 00:06:45.435 00:06:45.435 ' 00:06:45.435 17:26:22 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:45.435 17:26:22 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:45.435 17:26:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.435 17:26:22 -- common/autotest_common.sh@10 -- # set +x 00:06:45.435 ************************************ 00:06:45.435 START TEST thread_poller_perf 00:06:45.435 ************************************ 00:06:45.435 17:26:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:45.436 [2024-11-16 17:26:22.869374] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.436 [2024-11-16 17:26:22.869453] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467102 ] 00:06:45.436 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.695 [2024-11-16 17:26:22.929997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.695 [2024-11-16 17:26:23.017491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.695 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:46.634 [2024-11-16T16:26:24.126Z] ====================================== 00:06:46.634 [2024-11-16T16:26:24.126Z] busy:2712962193 (cyc) 00:06:46.634 [2024-11-16T16:26:24.126Z] total_run_count: 280000 00:06:46.634 [2024-11-16T16:26:24.126Z] tsc_hz: 2700000000 (cyc) 00:06:46.634 [2024-11-16T16:26:24.126Z] ====================================== 00:06:46.634 [2024-11-16T16:26:24.126Z] poller_cost: 9689 (cyc), 3588 (nsec) 00:06:46.634 00:06:46.634 real 0m1.254s 00:06:46.634 user 0m1.164s 00:06:46.634 sys 0m0.083s 00:06:46.634 17:26:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.634 17:26:24 -- common/autotest_common.sh@10 -- # set +x 00:06:46.634 ************************************ 00:06:46.634 END TEST thread_poller_perf 00:06:46.634 ************************************ 00:06:46.894 17:26:24 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:46.894 17:26:24 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:46.894 17:26:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.894 17:26:24 -- common/autotest_common.sh@10 -- # set +x 00:06:46.894 ************************************ 00:06:46.894 START TEST thread_poller_perf 00:06:46.894 ************************************ 00:06:46.894 17:26:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:46.894 [2024-11-16 17:26:24.151830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:46.894 [2024-11-16 17:26:24.151907] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467264 ] 00:06:46.894 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.894 [2024-11-16 17:26:24.215120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.894 [2024-11-16 17:26:24.307350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.894 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:48.274 [2024-11-16T16:26:25.766Z] ====================================== 00:06:48.274 [2024-11-16T16:26:25.766Z] busy:2703553829 (cyc) 00:06:48.274 [2024-11-16T16:26:25.766Z] total_run_count: 3825000 00:06:48.274 [2024-11-16T16:26:25.766Z] tsc_hz: 2700000000 (cyc) 00:06:48.274 [2024-11-16T16:26:25.766Z] ====================================== 00:06:48.274 [2024-11-16T16:26:25.766Z] poller_cost: 706 (cyc), 261 (nsec) 00:06:48.274 00:06:48.274 real 0m1.248s 00:06:48.274 user 0m1.153s 00:06:48.274 sys 0m0.088s 00:06:48.274 17:26:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.274 17:26:25 -- common/autotest_common.sh@10 -- # set +x 00:06:48.274 ************************************ 00:06:48.274 END TEST thread_poller_perf 00:06:48.274 ************************************ 00:06:48.274 17:26:25 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:48.274 00:06:48.274 real 0m2.695s 00:06:48.274 user 0m2.429s 00:06:48.274 sys 0m0.270s 00:06:48.274 17:26:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.274 17:26:25 -- common/autotest_common.sh@10 -- # set +x 00:06:48.274 ************************************ 00:06:48.274 END TEST thread 00:06:48.274 ************************************ 00:06:48.274 17:26:25 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:48.274 17:26:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:48.274 17:26:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.274 17:26:25 -- common/autotest_common.sh@10 -- # set +x 00:06:48.274 ************************************ 00:06:48.274 START TEST accel 00:06:48.274 ************************************ 00:06:48.274 17:26:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:48.274 * Looking for test storage... 00:06:48.274 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:48.274 17:26:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:48.274 17:26:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:48.274 17:26:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:48.274 17:26:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:48.274 17:26:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:48.274 17:26:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:48.274 17:26:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:48.274 17:26:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:48.274 17:26:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:48.274 17:26:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:48.274 17:26:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:48.274 17:26:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:48.274 17:26:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:48.274 17:26:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:48.274 17:26:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:48.274 17:26:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:48.274 17:26:25 -- scripts/common.sh@344 -- # : 1 00:06:48.274 17:26:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:48.274 17:26:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:48.274 17:26:25 -- scripts/common.sh@364 -- # decimal 1 00:06:48.274 17:26:25 -- scripts/common.sh@352 -- # local d=1 00:06:48.274 17:26:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:48.274 17:26:25 -- scripts/common.sh@354 -- # echo 1 00:06:48.274 17:26:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:48.274 17:26:25 -- scripts/common.sh@365 -- # decimal 2 00:06:48.274 17:26:25 -- scripts/common.sh@352 -- # local d=2 00:06:48.274 17:26:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:48.274 17:26:25 -- scripts/common.sh@354 -- # echo 2 00:06:48.274 17:26:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:48.275 17:26:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:48.275 17:26:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:48.275 17:26:25 -- scripts/common.sh@367 -- # return 0 00:06:48.275 17:26:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:48.275 17:26:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:48.275 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.275 --rc genhtml_branch_coverage=1 00:06:48.275 --rc genhtml_function_coverage=1 00:06:48.275 --rc genhtml_legend=1 00:06:48.275 --rc geninfo_all_blocks=1 00:06:48.275 --rc geninfo_unexecuted_blocks=1 00:06:48.275 00:06:48.275 ' 00:06:48.275 17:26:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:48.275 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.275 --rc genhtml_branch_coverage=1 00:06:48.275 --rc genhtml_function_coverage=1 00:06:48.275 --rc genhtml_legend=1 00:06:48.275 --rc geninfo_all_blocks=1 00:06:48.275 --rc geninfo_unexecuted_blocks=1 00:06:48.275 00:06:48.275 ' 00:06:48.275 17:26:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:48.275 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.275 --rc genhtml_branch_coverage=1 00:06:48.275 --rc genhtml_function_coverage=1 00:06:48.275 --rc genhtml_legend=1 00:06:48.275 --rc geninfo_all_blocks=1 00:06:48.275 --rc geninfo_unexecuted_blocks=1 00:06:48.275 00:06:48.275 ' 00:06:48.275 17:26:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:48.275 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.275 --rc genhtml_branch_coverage=1 00:06:48.275 --rc genhtml_function_coverage=1 00:06:48.275 --rc genhtml_legend=1 00:06:48.275 --rc geninfo_all_blocks=1 00:06:48.275 --rc geninfo_unexecuted_blocks=1 00:06:48.275 00:06:48.275 ' 00:06:48.275 17:26:25 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:48.275 17:26:25 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:48.275 17:26:25 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:48.275 17:26:25 -- accel/accel.sh@59 -- # spdk_tgt_pid=1467592 00:06:48.275 17:26:25 -- accel/accel.sh@60 -- # waitforlisten 1467592 00:06:48.275 17:26:25 -- common/autotest_common.sh@829 -- # '[' -z 1467592 ']' 00:06:48.275 17:26:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:48.275 17:26:25 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:48.275 17:26:25 -- accel/accel.sh@58 -- # build_accel_config 00:06:48.275 17:26:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:48.275 17:26:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.275 17:26:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:48.275 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:48.275 17:26:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.275 17:26:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:48.275 17:26:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.275 17:26:25 -- common/autotest_common.sh@10 -- # set +x 00:06:48.275 17:26:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.275 17:26:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.275 17:26:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.275 17:26:25 -- accel/accel.sh@42 -- # jq -r . 00:06:48.275 [2024-11-16 17:26:25.621803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:48.275 [2024-11-16 17:26:25.621888] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467592 ] 00:06:48.275 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.275 [2024-11-16 17:26:25.679941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.534 [2024-11-16 17:26:25.766782] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:48.534 [2024-11-16 17:26:25.766978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.102 17:26:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.102 17:26:26 -- common/autotest_common.sh@862 -- # return 0 00:06:49.102 17:26:26 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:49.102 17:26:26 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:49.102 17:26:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.102 17:26:26 -- common/autotest_common.sh@10 -- # set +x 00:06:49.102 17:26:26 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:49.102 17:26:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # IFS== 00:06:49.361 17:26:26 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.361 17:26:26 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.361 17:26:26 -- accel/accel.sh@67 -- # killprocess 1467592 00:06:49.361 17:26:26 -- common/autotest_common.sh@936 -- # '[' -z 1467592 ']' 00:06:49.361 17:26:26 -- common/autotest_common.sh@940 -- # kill -0 1467592 00:06:49.361 17:26:26 -- common/autotest_common.sh@941 -- # uname 00:06:49.361 17:26:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:49.361 17:26:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1467592 00:06:49.361 17:26:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:49.361 17:26:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:49.361 17:26:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1467592' 00:06:49.361 killing process with pid 1467592 00:06:49.361 17:26:26 -- common/autotest_common.sh@955 -- # kill 1467592 00:06:49.361 17:26:26 -- common/autotest_common.sh@960 -- # wait 1467592 00:06:49.620 17:26:27 -- accel/accel.sh@68 -- # trap - ERR 00:06:49.620 17:26:27 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:49.620 17:26:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:49.620 17:26:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.620 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:49.620 17:26:27 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:49.620 17:26:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:49.620 17:26:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.620 17:26:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.620 17:26:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.620 17:26:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.620 17:26:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.620 17:26:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.620 17:26:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.620 17:26:27 -- accel/accel.sh@42 -- # jq -r . 00:06:49.620 17:26:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:49.620 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:49.620 17:26:27 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:49.620 17:26:27 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:49.620 17:26:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.620 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:49.620 ************************************ 00:06:49.620 START TEST accel_missing_filename 00:06:49.620 ************************************ 00:06:49.620 17:26:27 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:49.620 17:26:27 -- common/autotest_common.sh@650 -- # local es=0 00:06:49.620 17:26:27 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:49.620 17:26:27 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:49.620 17:26:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.620 17:26:27 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:49.621 17:26:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.621 17:26:27 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:49.621 17:26:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:49.621 17:26:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.621 17:26:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.621 17:26:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.621 17:26:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.621 17:26:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.621 17:26:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.621 17:26:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.621 17:26:27 -- accel/accel.sh@42 -- # jq -r . 00:06:49.621 [2024-11-16 17:26:27.109653] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:49.621 [2024-11-16 17:26:27.109748] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467771 ] 00:06:49.881 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.881 [2024-11-16 17:26:27.171826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.881 [2024-11-16 17:26:27.262767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.881 [2024-11-16 17:26:27.324248] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:50.140 [2024-11-16 17:26:27.409924] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:50.140 A filename is required. 00:06:50.140 17:26:27 -- common/autotest_common.sh@653 -- # es=234 00:06:50.140 17:26:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.140 17:26:27 -- common/autotest_common.sh@662 -- # es=106 00:06:50.140 17:26:27 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:50.140 17:26:27 -- common/autotest_common.sh@670 -- # es=1 00:06:50.140 17:26:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.140 00:06:50.140 real 0m0.400s 00:06:50.140 user 0m0.297s 00:06:50.140 sys 0m0.137s 00:06:50.140 17:26:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.140 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.140 ************************************ 00:06:50.140 END TEST accel_missing_filename 00:06:50.140 ************************************ 00:06:50.140 17:26:27 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.140 17:26:27 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:50.140 17:26:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.140 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.140 ************************************ 00:06:50.140 START TEST accel_compress_verify 00:06:50.140 ************************************ 00:06:50.140 17:26:27 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.140 17:26:27 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.140 17:26:27 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.140 17:26:27 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.140 17:26:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.140 17:26:27 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.140 17:26:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.140 17:26:27 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.140 17:26:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.140 17:26:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.140 17:26:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.140 17:26:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.140 17:26:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.140 17:26:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.140 17:26:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.141 17:26:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.141 17:26:27 -- accel/accel.sh@42 -- # jq -r . 00:06:50.141 [2024-11-16 17:26:27.538668] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.141 [2024-11-16 17:26:27.538752] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467790 ] 00:06:50.141 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.141 [2024-11-16 17:26:27.603561] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.399 [2024-11-16 17:26:27.696072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.399 [2024-11-16 17:26:27.757305] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:50.399 [2024-11-16 17:26:27.841480] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:50.660 00:06:50.660 Compression does not support the verify option, aborting. 00:06:50.660 17:26:27 -- common/autotest_common.sh@653 -- # es=161 00:06:50.660 17:26:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.660 17:26:27 -- common/autotest_common.sh@662 -- # es=33 00:06:50.660 17:26:27 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:50.660 17:26:27 -- common/autotest_common.sh@670 -- # es=1 00:06:50.660 17:26:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.660 00:06:50.660 real 0m0.400s 00:06:50.660 user 0m0.291s 00:06:50.660 sys 0m0.144s 00:06:50.660 17:26:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.660 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.660 ************************************ 00:06:50.660 END TEST accel_compress_verify 00:06:50.660 ************************************ 00:06:50.660 17:26:27 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:50.660 17:26:27 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:50.660 17:26:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.660 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.660 ************************************ 00:06:50.660 START TEST accel_wrong_workload 00:06:50.660 ************************************ 00:06:50.660 17:26:27 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:50.660 17:26:27 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.660 17:26:27 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:50.660 17:26:27 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.660 17:26:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.660 17:26:27 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.660 17:26:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.660 17:26:27 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:50.660 17:26:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:50.660 17:26:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.660 17:26:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.660 17:26:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.660 17:26:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.660 17:26:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.660 17:26:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.660 17:26:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.660 17:26:27 -- accel/accel.sh@42 -- # jq -r . 00:06:50.660 Unsupported workload type: foobar 00:06:50.660 [2024-11-16 17:26:27.962830] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:50.660 accel_perf options: 00:06:50.660 [-h help message] 00:06:50.660 [-q queue depth per core] 00:06:50.660 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:50.660 [-T number of threads per core 00:06:50.660 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:50.660 [-t time in seconds] 00:06:50.660 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:50.660 [ dif_verify, , dif_generate, dif_generate_copy 00:06:50.660 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:50.660 [-l for compress/decompress workloads, name of uncompressed input file 00:06:50.660 [-S for crc32c workload, use this seed value (default 0) 00:06:50.660 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:50.660 [-f for fill workload, use this BYTE value (default 255) 00:06:50.660 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:50.660 [-y verify result if this switch is on] 00:06:50.660 [-a tasks to allocate per core (default: same value as -q)] 00:06:50.660 Can be used to spread operations across a wider range of memory. 00:06:50.660 17:26:27 -- common/autotest_common.sh@653 -- # es=1 00:06:50.660 17:26:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.660 17:26:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:50.660 17:26:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.660 00:06:50.660 real 0m0.022s 00:06:50.660 user 0m0.010s 00:06:50.660 sys 0m0.012s 00:06:50.660 17:26:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.660 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.660 ************************************ 00:06:50.660 END TEST accel_wrong_workload 00:06:50.660 ************************************ 00:06:50.660 Error: writing output failed: Broken pipe 00:06:50.660 17:26:27 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:50.660 17:26:27 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:50.660 17:26:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.660 17:26:27 -- common/autotest_common.sh@10 -- # set +x 00:06:50.660 ************************************ 00:06:50.660 START TEST accel_negative_buffers 00:06:50.660 ************************************ 00:06:50.660 17:26:27 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:50.660 17:26:27 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.660 17:26:27 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:50.660 17:26:27 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.660 17:26:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.660 17:26:27 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.660 17:26:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.660 17:26:27 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:50.660 17:26:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:50.660 17:26:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.660 17:26:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.660 17:26:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.660 17:26:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.660 17:26:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.660 17:26:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.660 17:26:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.660 17:26:27 -- accel/accel.sh@42 -- # jq -r . 00:06:50.660 -x option must be non-negative. 00:06:50.660 [2024-11-16 17:26:28.005099] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:50.660 accel_perf options: 00:06:50.660 [-h help message] 00:06:50.660 [-q queue depth per core] 00:06:50.660 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:50.660 [-T number of threads per core 00:06:50.660 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:50.660 [-t time in seconds] 00:06:50.660 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:50.660 [ dif_verify, , dif_generate, dif_generate_copy 00:06:50.660 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:50.660 [-l for compress/decompress workloads, name of uncompressed input file 00:06:50.660 [-S for crc32c workload, use this seed value (default 0) 00:06:50.660 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:50.660 [-f for fill workload, use this BYTE value (default 255) 00:06:50.660 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:50.660 [-y verify result if this switch is on] 00:06:50.660 [-a tasks to allocate per core (default: same value as -q)] 00:06:50.660 Can be used to spread operations across a wider range of memory. 00:06:50.660 17:26:28 -- common/autotest_common.sh@653 -- # es=1 00:06:50.660 17:26:28 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.660 17:26:28 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:50.660 17:26:28 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.660 00:06:50.660 real 0m0.021s 00:06:50.660 user 0m0.010s 00:06:50.660 sys 0m0.011s 00:06:50.660 17:26:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.660 17:26:28 -- common/autotest_common.sh@10 -- # set +x 00:06:50.660 ************************************ 00:06:50.660 END TEST accel_negative_buffers 00:06:50.660 ************************************ 00:06:50.660 Error: writing output failed: Broken pipe 00:06:50.660 17:26:28 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:50.660 17:26:28 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:50.660 17:26:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.660 17:26:28 -- common/autotest_common.sh@10 -- # set +x 00:06:50.661 ************************************ 00:06:50.661 START TEST accel_crc32c 00:06:50.661 ************************************ 00:06:50.661 17:26:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:50.661 17:26:28 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.661 17:26:28 -- accel/accel.sh@17 -- # local accel_module 00:06:50.661 17:26:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:50.661 17:26:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:50.661 17:26:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.661 17:26:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.661 17:26:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.661 17:26:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.661 17:26:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.661 17:26:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.661 17:26:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.661 17:26:28 -- accel/accel.sh@42 -- # jq -r . 00:06:50.661 [2024-11-16 17:26:28.054756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.661 [2024-11-16 17:26:28.054833] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1467972 ] 00:06:50.661 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.661 [2024-11-16 17:26:28.118237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.921 [2024-11-16 17:26:28.209229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.305 17:26:29 -- accel/accel.sh@18 -- # out=' 00:06:52.305 SPDK Configuration: 00:06:52.305 Core mask: 0x1 00:06:52.305 00:06:52.305 Accel Perf Configuration: 00:06:52.305 Workload Type: crc32c 00:06:52.305 CRC-32C seed: 32 00:06:52.305 Transfer size: 4096 bytes 00:06:52.305 Vector count 1 00:06:52.305 Module: software 00:06:52.305 Queue depth: 32 00:06:52.305 Allocate depth: 32 00:06:52.305 # threads/core: 1 00:06:52.305 Run time: 1 seconds 00:06:52.305 Verify: Yes 00:06:52.305 00:06:52.305 Running for 1 seconds... 00:06:52.305 00:06:52.305 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:52.305 ------------------------------------------------------------------------------------ 00:06:52.305 0,0 405568/s 1584 MiB/s 0 0 00:06:52.305 ==================================================================================== 00:06:52.305 Total 405568/s 1584 MiB/s 0 0' 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:52.305 17:26:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.305 17:26:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.305 17:26:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.305 17:26:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.305 17:26:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.305 17:26:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.305 17:26:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:52.305 17:26:29 -- accel/accel.sh@42 -- # jq -r . 00:06:52.305 [2024-11-16 17:26:29.465386] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:52.305 [2024-11-16 17:26:29.465475] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468116 ] 00:06:52.305 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.305 [2024-11-16 17:26:29.528016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.305 [2024-11-16 17:26:29.618031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val= 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val= 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val=0x1 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val= 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val= 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val=crc32c 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val=32 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val= 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.305 17:26:29 -- accel/accel.sh@21 -- # val=software 00:06:52.305 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.305 17:26:29 -- accel/accel.sh@23 -- # accel_module=software 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.305 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.306 17:26:29 -- accel/accel.sh@21 -- # val=32 00:06:52.306 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.306 17:26:29 -- accel/accel.sh@21 -- # val=32 00:06:52.306 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.306 17:26:29 -- accel/accel.sh@21 -- # val=1 00:06:52.306 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.306 17:26:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:52.306 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.306 17:26:29 -- accel/accel.sh@21 -- # val=Yes 00:06:52.306 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.306 17:26:29 -- accel/accel.sh@21 -- # val= 00:06:52.306 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:52.306 17:26:29 -- accel/accel.sh@21 -- # val= 00:06:52.306 17:26:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # IFS=: 00:06:52.306 17:26:29 -- accel/accel.sh@20 -- # read -r var val 00:06:53.688 17:26:30 -- accel/accel.sh@21 -- # val= 00:06:53.688 17:26:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # IFS=: 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # read -r var val 00:06:53.688 17:26:30 -- accel/accel.sh@21 -- # val= 00:06:53.688 17:26:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # IFS=: 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # read -r var val 00:06:53.688 17:26:30 -- accel/accel.sh@21 -- # val= 00:06:53.688 17:26:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # IFS=: 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # read -r var val 00:06:53.688 17:26:30 -- accel/accel.sh@21 -- # val= 00:06:53.688 17:26:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # IFS=: 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # read -r var val 00:06:53.688 17:26:30 -- accel/accel.sh@21 -- # val= 00:06:53.688 17:26:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # IFS=: 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # read -r var val 00:06:53.688 17:26:30 -- accel/accel.sh@21 -- # val= 00:06:53.688 17:26:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # IFS=: 00:06:53.688 17:26:30 -- accel/accel.sh@20 -- # read -r var val 00:06:53.688 17:26:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:53.688 17:26:30 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:53.688 17:26:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.688 00:06:53.688 real 0m2.820s 00:06:53.688 user 0m2.513s 00:06:53.688 sys 0m0.300s 00:06:53.688 17:26:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.688 17:26:30 -- common/autotest_common.sh@10 -- # set +x 00:06:53.688 ************************************ 00:06:53.688 END TEST accel_crc32c 00:06:53.688 ************************************ 00:06:53.688 17:26:30 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:53.689 17:26:30 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:53.689 17:26:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.689 17:26:30 -- common/autotest_common.sh@10 -- # set +x 00:06:53.689 ************************************ 00:06:53.689 START TEST accel_crc32c_C2 00:06:53.689 ************************************ 00:06:53.689 17:26:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:53.689 17:26:30 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.689 17:26:30 -- accel/accel.sh@17 -- # local accel_module 00:06:53.689 17:26:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:53.689 17:26:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:53.689 17:26:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.689 17:26:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.689 17:26:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.689 17:26:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.689 17:26:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.689 17:26:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.689 17:26:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.689 17:26:30 -- accel/accel.sh@42 -- # jq -r . 00:06:53.689 [2024-11-16 17:26:30.900342] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:53.689 [2024-11-16 17:26:30.900431] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468271 ] 00:06:53.689 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.689 [2024-11-16 17:26:30.962048] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.689 [2024-11-16 17:26:31.053415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.067 17:26:32 -- accel/accel.sh@18 -- # out=' 00:06:55.067 SPDK Configuration: 00:06:55.067 Core mask: 0x1 00:06:55.067 00:06:55.067 Accel Perf Configuration: 00:06:55.067 Workload Type: crc32c 00:06:55.067 CRC-32C seed: 0 00:06:55.067 Transfer size: 4096 bytes 00:06:55.067 Vector count 2 00:06:55.067 Module: software 00:06:55.067 Queue depth: 32 00:06:55.067 Allocate depth: 32 00:06:55.067 # threads/core: 1 00:06:55.067 Run time: 1 seconds 00:06:55.067 Verify: Yes 00:06:55.067 00:06:55.067 Running for 1 seconds... 00:06:55.067 00:06:55.067 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:55.067 ------------------------------------------------------------------------------------ 00:06:55.067 0,0 320512/s 2504 MiB/s 0 0 00:06:55.068 ==================================================================================== 00:06:55.068 Total 320512/s 1252 MiB/s 0 0' 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:55.068 17:26:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.068 17:26:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.068 17:26:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.068 17:26:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.068 17:26:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.068 17:26:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.068 17:26:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.068 17:26:32 -- accel/accel.sh@42 -- # jq -r . 00:06:55.068 [2024-11-16 17:26:32.295163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:55.068 [2024-11-16 17:26:32.295245] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468538 ] 00:06:55.068 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.068 [2024-11-16 17:26:32.356770] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.068 [2024-11-16 17:26:32.449145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val= 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val= 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val=0x1 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val= 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val= 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val=crc32c 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val=0 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val= 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val=software 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@23 -- # accel_module=software 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val=32 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val=32 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val=1 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val=Yes 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val= 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:55.068 17:26:32 -- accel/accel.sh@21 -- # val= 00:06:55.068 17:26:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # IFS=: 00:06:55.068 17:26:32 -- accel/accel.sh@20 -- # read -r var val 00:06:56.450 17:26:33 -- accel/accel.sh@21 -- # val= 00:06:56.450 17:26:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # IFS=: 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # read -r var val 00:06:56.450 17:26:33 -- accel/accel.sh@21 -- # val= 00:06:56.450 17:26:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # IFS=: 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # read -r var val 00:06:56.450 17:26:33 -- accel/accel.sh@21 -- # val= 00:06:56.450 17:26:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # IFS=: 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # read -r var val 00:06:56.450 17:26:33 -- accel/accel.sh@21 -- # val= 00:06:56.450 17:26:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # IFS=: 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # read -r var val 00:06:56.450 17:26:33 -- accel/accel.sh@21 -- # val= 00:06:56.450 17:26:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # IFS=: 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # read -r var val 00:06:56.450 17:26:33 -- accel/accel.sh@21 -- # val= 00:06:56.450 17:26:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # IFS=: 00:06:56.450 17:26:33 -- accel/accel.sh@20 -- # read -r var val 00:06:56.450 17:26:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:56.450 17:26:33 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:56.450 17:26:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:56.450 00:06:56.450 real 0m2.790s 00:06:56.450 user 0m2.507s 00:06:56.450 sys 0m0.275s 00:06:56.450 17:26:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.450 17:26:33 -- common/autotest_common.sh@10 -- # set +x 00:06:56.450 ************************************ 00:06:56.450 END TEST accel_crc32c_C2 00:06:56.450 ************************************ 00:06:56.450 17:26:33 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:56.450 17:26:33 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:56.450 17:26:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.450 17:26:33 -- common/autotest_common.sh@10 -- # set +x 00:06:56.450 ************************************ 00:06:56.450 START TEST accel_copy 00:06:56.450 ************************************ 00:06:56.450 17:26:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:56.450 17:26:33 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.450 17:26:33 -- accel/accel.sh@17 -- # local accel_module 00:06:56.450 17:26:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:56.450 17:26:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:56.450 17:26:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.450 17:26:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.450 17:26:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.450 17:26:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.450 17:26:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.450 17:26:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.450 17:26:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.450 17:26:33 -- accel/accel.sh@42 -- # jq -r . 00:06:56.450 [2024-11-16 17:26:33.718012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:56.450 [2024-11-16 17:26:33.718102] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468699 ] 00:06:56.450 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.451 [2024-11-16 17:26:33.778395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.451 [2024-11-16 17:26:33.868762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.831 17:26:35 -- accel/accel.sh@18 -- # out=' 00:06:57.831 SPDK Configuration: 00:06:57.831 Core mask: 0x1 00:06:57.831 00:06:57.831 Accel Perf Configuration: 00:06:57.831 Workload Type: copy 00:06:57.831 Transfer size: 4096 bytes 00:06:57.831 Vector count 1 00:06:57.831 Module: software 00:06:57.831 Queue depth: 32 00:06:57.831 Allocate depth: 32 00:06:57.831 # threads/core: 1 00:06:57.831 Run time: 1 seconds 00:06:57.831 Verify: Yes 00:06:57.831 00:06:57.831 Running for 1 seconds... 00:06:57.831 00:06:57.831 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.831 ------------------------------------------------------------------------------------ 00:06:57.831 0,0 278560/s 1088 MiB/s 0 0 00:06:57.831 ==================================================================================== 00:06:57.831 Total 278560/s 1088 MiB/s 0 0' 00:06:57.831 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:57.831 17:26:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:57.831 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:57.831 17:26:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:57.831 17:26:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.831 17:26:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.831 17:26:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.831 17:26:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.831 17:26:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.831 17:26:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.831 17:26:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.832 17:26:35 -- accel/accel.sh@42 -- # jq -r . 00:06:57.832 [2024-11-16 17:26:35.119346] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.832 [2024-11-16 17:26:35.119435] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468837 ] 00:06:57.832 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.832 [2024-11-16 17:26:35.180754] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.832 [2024-11-16 17:26:35.271104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val= 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val= 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val=0x1 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val= 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val= 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val=copy 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val= 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val=software 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@23 -- # accel_module=software 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val=32 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val=32 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val=1 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val=Yes 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val= 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:58.090 17:26:35 -- accel/accel.sh@21 -- # val= 00:06:58.090 17:26:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # IFS=: 00:06:58.090 17:26:35 -- accel/accel.sh@20 -- # read -r var val 00:06:59.028 17:26:36 -- accel/accel.sh@21 -- # val= 00:06:59.028 17:26:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # IFS=: 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # read -r var val 00:06:59.028 17:26:36 -- accel/accel.sh@21 -- # val= 00:06:59.028 17:26:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # IFS=: 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # read -r var val 00:06:59.028 17:26:36 -- accel/accel.sh@21 -- # val= 00:06:59.028 17:26:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # IFS=: 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # read -r var val 00:06:59.028 17:26:36 -- accel/accel.sh@21 -- # val= 00:06:59.028 17:26:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # IFS=: 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # read -r var val 00:06:59.028 17:26:36 -- accel/accel.sh@21 -- # val= 00:06:59.028 17:26:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # IFS=: 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # read -r var val 00:06:59.028 17:26:36 -- accel/accel.sh@21 -- # val= 00:06:59.028 17:26:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # IFS=: 00:06:59.028 17:26:36 -- accel/accel.sh@20 -- # read -r var val 00:06:59.028 17:26:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:59.028 17:26:36 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:59.028 17:26:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:59.028 00:06:59.028 real 0m2.806s 00:06:59.028 user 0m2.493s 00:06:59.028 sys 0m0.305s 00:06:59.028 17:26:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.028 17:26:36 -- common/autotest_common.sh@10 -- # set +x 00:06:59.028 ************************************ 00:06:59.028 END TEST accel_copy 00:06:59.028 ************************************ 00:06:59.288 17:26:36 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.288 17:26:36 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:59.288 17:26:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.288 17:26:36 -- common/autotest_common.sh@10 -- # set +x 00:06:59.288 ************************************ 00:06:59.288 START TEST accel_fill 00:06:59.288 ************************************ 00:06:59.288 17:26:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.288 17:26:36 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.288 17:26:36 -- accel/accel.sh@17 -- # local accel_module 00:06:59.288 17:26:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.288 17:26:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.288 17:26:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.288 17:26:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.288 17:26:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.288 17:26:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.288 17:26:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.288 17:26:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.288 17:26:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.288 17:26:36 -- accel/accel.sh@42 -- # jq -r . 00:06:59.288 [2024-11-16 17:26:36.548523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:59.288 [2024-11-16 17:26:36.548628] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1468998 ] 00:06:59.288 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.288 [2024-11-16 17:26:36.610199] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.288 [2024-11-16 17:26:36.704239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.668 17:26:37 -- accel/accel.sh@18 -- # out=' 00:07:00.668 SPDK Configuration: 00:07:00.668 Core mask: 0x1 00:07:00.668 00:07:00.668 Accel Perf Configuration: 00:07:00.668 Workload Type: fill 00:07:00.668 Fill pattern: 0x80 00:07:00.668 Transfer size: 4096 bytes 00:07:00.668 Vector count 1 00:07:00.668 Module: software 00:07:00.668 Queue depth: 64 00:07:00.668 Allocate depth: 64 00:07:00.668 # threads/core: 1 00:07:00.668 Run time: 1 seconds 00:07:00.668 Verify: Yes 00:07:00.668 00:07:00.668 Running for 1 seconds... 00:07:00.668 00:07:00.668 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.668 ------------------------------------------------------------------------------------ 00:07:00.668 0,0 402112/s 1570 MiB/s 0 0 00:07:00.668 ==================================================================================== 00:07:00.668 Total 402112/s 1570 MiB/s 0 0' 00:07:00.668 17:26:37 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:00.668 17:26:37 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:00.668 17:26:37 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.668 17:26:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.668 17:26:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.668 17:26:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.668 17:26:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.668 17:26:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.668 17:26:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.668 17:26:37 -- accel/accel.sh@42 -- # jq -r . 00:07:00.668 [2024-11-16 17:26:37.943192] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:00.668 [2024-11-16 17:26:37.943282] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469255 ] 00:07:00.668 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.668 [2024-11-16 17:26:38.004335] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.668 [2024-11-16 17:26:38.093633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val= 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val= 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val=0x1 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val= 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val= 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val=fill 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val=0x80 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val= 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val=software 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val=64 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val=64 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val=1 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val=Yes 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val= 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:00.668 17:26:38 -- accel/accel.sh@21 -- # val= 00:07:00.668 17:26:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # IFS=: 00:07:00.668 17:26:38 -- accel/accel.sh@20 -- # read -r var val 00:07:02.048 17:26:39 -- accel/accel.sh@21 -- # val= 00:07:02.048 17:26:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # IFS=: 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # read -r var val 00:07:02.048 17:26:39 -- accel/accel.sh@21 -- # val= 00:07:02.048 17:26:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # IFS=: 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # read -r var val 00:07:02.048 17:26:39 -- accel/accel.sh@21 -- # val= 00:07:02.048 17:26:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # IFS=: 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # read -r var val 00:07:02.048 17:26:39 -- accel/accel.sh@21 -- # val= 00:07:02.048 17:26:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # IFS=: 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # read -r var val 00:07:02.048 17:26:39 -- accel/accel.sh@21 -- # val= 00:07:02.048 17:26:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # IFS=: 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # read -r var val 00:07:02.048 17:26:39 -- accel/accel.sh@21 -- # val= 00:07:02.048 17:26:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # IFS=: 00:07:02.048 17:26:39 -- accel/accel.sh@20 -- # read -r var val 00:07:02.048 17:26:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:02.048 17:26:39 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:02.048 17:26:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:02.048 00:07:02.048 real 0m2.780s 00:07:02.048 user 0m2.489s 00:07:02.048 sys 0m0.283s 00:07:02.048 17:26:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.048 17:26:39 -- common/autotest_common.sh@10 -- # set +x 00:07:02.048 ************************************ 00:07:02.048 END TEST accel_fill 00:07:02.048 ************************************ 00:07:02.048 17:26:39 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:02.048 17:26:39 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:02.048 17:26:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.048 17:26:39 -- common/autotest_common.sh@10 -- # set +x 00:07:02.048 ************************************ 00:07:02.048 START TEST accel_copy_crc32c 00:07:02.048 ************************************ 00:07:02.048 17:26:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:02.048 17:26:39 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.048 17:26:39 -- accel/accel.sh@17 -- # local accel_module 00:07:02.048 17:26:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:02.048 17:26:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:02.049 17:26:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.049 17:26:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.049 17:26:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.049 17:26:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.049 17:26:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.049 17:26:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.049 17:26:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.049 17:26:39 -- accel/accel.sh@42 -- # jq -r . 00:07:02.049 [2024-11-16 17:26:39.357482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:02.049 [2024-11-16 17:26:39.357571] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469425 ] 00:07:02.049 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.049 [2024-11-16 17:26:39.418644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.049 [2024-11-16 17:26:39.509217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.424 17:26:40 -- accel/accel.sh@18 -- # out=' 00:07:03.425 SPDK Configuration: 00:07:03.425 Core mask: 0x1 00:07:03.425 00:07:03.425 Accel Perf Configuration: 00:07:03.425 Workload Type: copy_crc32c 00:07:03.425 CRC-32C seed: 0 00:07:03.425 Vector size: 4096 bytes 00:07:03.425 Transfer size: 4096 bytes 00:07:03.425 Vector count 1 00:07:03.425 Module: software 00:07:03.425 Queue depth: 32 00:07:03.425 Allocate depth: 32 00:07:03.425 # threads/core: 1 00:07:03.425 Run time: 1 seconds 00:07:03.425 Verify: Yes 00:07:03.425 00:07:03.425 Running for 1 seconds... 00:07:03.425 00:07:03.425 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.425 ------------------------------------------------------------------------------------ 00:07:03.425 0,0 217344/s 849 MiB/s 0 0 00:07:03.425 ==================================================================================== 00:07:03.425 Total 217344/s 849 MiB/s 0 0' 00:07:03.425 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.425 17:26:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:03.425 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.425 17:26:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:03.425 17:26:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.425 17:26:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.425 17:26:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.425 17:26:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.425 17:26:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.425 17:26:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.425 17:26:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.425 17:26:40 -- accel/accel.sh@42 -- # jq -r . 00:07:03.425 [2024-11-16 17:26:40.764430] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.425 [2024-11-16 17:26:40.764519] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469564 ] 00:07:03.425 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.425 [2024-11-16 17:26:40.825349] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.425 [2024-11-16 17:26:40.915660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val= 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val= 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val=0x1 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val= 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val= 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val=0 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val= 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val=software 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val=32 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val=32 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val=1 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val=Yes 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val= 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:03.683 17:26:40 -- accel/accel.sh@21 -- # val= 00:07:03.683 17:26:40 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # IFS=: 00:07:03.683 17:26:40 -- accel/accel.sh@20 -- # read -r var val 00:07:05.062 17:26:42 -- accel/accel.sh@21 -- # val= 00:07:05.062 17:26:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # IFS=: 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # read -r var val 00:07:05.062 17:26:42 -- accel/accel.sh@21 -- # val= 00:07:05.062 17:26:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # IFS=: 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # read -r var val 00:07:05.062 17:26:42 -- accel/accel.sh@21 -- # val= 00:07:05.062 17:26:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # IFS=: 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # read -r var val 00:07:05.062 17:26:42 -- accel/accel.sh@21 -- # val= 00:07:05.062 17:26:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # IFS=: 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # read -r var val 00:07:05.062 17:26:42 -- accel/accel.sh@21 -- # val= 00:07:05.062 17:26:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # IFS=: 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # read -r var val 00:07:05.062 17:26:42 -- accel/accel.sh@21 -- # val= 00:07:05.062 17:26:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # IFS=: 00:07:05.062 17:26:42 -- accel/accel.sh@20 -- # read -r var val 00:07:05.062 17:26:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:05.062 17:26:42 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:05.062 17:26:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.062 00:07:05.062 real 0m2.815s 00:07:05.062 user 0m2.516s 00:07:05.062 sys 0m0.292s 00:07:05.062 17:26:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.062 17:26:42 -- common/autotest_common.sh@10 -- # set +x 00:07:05.062 ************************************ 00:07:05.062 END TEST accel_copy_crc32c 00:07:05.062 ************************************ 00:07:05.062 17:26:42 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:05.062 17:26:42 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:05.062 17:26:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.062 17:26:42 -- common/autotest_common.sh@10 -- # set +x 00:07:05.062 ************************************ 00:07:05.062 START TEST accel_copy_crc32c_C2 00:07:05.062 ************************************ 00:07:05.063 17:26:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:05.063 17:26:42 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.063 17:26:42 -- accel/accel.sh@17 -- # local accel_module 00:07:05.063 17:26:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:05.063 17:26:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:05.063 17:26:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.063 17:26:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.063 17:26:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.063 17:26:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.063 17:26:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.063 17:26:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.063 17:26:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.063 17:26:42 -- accel/accel.sh@42 -- # jq -r . 00:07:05.063 [2024-11-16 17:26:42.202118] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.063 [2024-11-16 17:26:42.202194] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469719 ] 00:07:05.063 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.063 [2024-11-16 17:26:42.263147] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.063 [2024-11-16 17:26:42.353336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.443 17:26:43 -- accel/accel.sh@18 -- # out=' 00:07:06.443 SPDK Configuration: 00:07:06.443 Core mask: 0x1 00:07:06.443 00:07:06.443 Accel Perf Configuration: 00:07:06.443 Workload Type: copy_crc32c 00:07:06.443 CRC-32C seed: 0 00:07:06.443 Vector size: 4096 bytes 00:07:06.443 Transfer size: 8192 bytes 00:07:06.443 Vector count 2 00:07:06.443 Module: software 00:07:06.443 Queue depth: 32 00:07:06.443 Allocate depth: 32 00:07:06.443 # threads/core: 1 00:07:06.443 Run time: 1 seconds 00:07:06.443 Verify: Yes 00:07:06.443 00:07:06.443 Running for 1 seconds... 00:07:06.443 00:07:06.443 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:06.443 ------------------------------------------------------------------------------------ 00:07:06.443 0,0 153888/s 1202 MiB/s 0 0 00:07:06.443 ==================================================================================== 00:07:06.444 Total 153888/s 601 MiB/s 0 0' 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:06.444 17:26:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.444 17:26:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.444 17:26:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.444 17:26:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.444 17:26:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.444 17:26:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.444 17:26:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.444 17:26:43 -- accel/accel.sh@42 -- # jq -r . 00:07:06.444 [2024-11-16 17:26:43.592269] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:06.444 [2024-11-16 17:26:43.592360] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1469978 ] 00:07:06.444 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.444 [2024-11-16 17:26:43.653376] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.444 [2024-11-16 17:26:43.742375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val= 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val= 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val=0x1 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val= 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val= 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val=0 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val= 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val=software 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@23 -- # accel_module=software 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val=32 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val=32 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val=1 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val=Yes 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val= 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:06.444 17:26:43 -- accel/accel.sh@21 -- # val= 00:07:06.444 17:26:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # IFS=: 00:07:06.444 17:26:43 -- accel/accel.sh@20 -- # read -r var val 00:07:07.824 17:26:44 -- accel/accel.sh@21 -- # val= 00:07:07.824 17:26:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # IFS=: 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # read -r var val 00:07:07.824 17:26:44 -- accel/accel.sh@21 -- # val= 00:07:07.824 17:26:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # IFS=: 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # read -r var val 00:07:07.824 17:26:44 -- accel/accel.sh@21 -- # val= 00:07:07.824 17:26:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # IFS=: 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # read -r var val 00:07:07.824 17:26:44 -- accel/accel.sh@21 -- # val= 00:07:07.824 17:26:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # IFS=: 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # read -r var val 00:07:07.824 17:26:44 -- accel/accel.sh@21 -- # val= 00:07:07.824 17:26:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # IFS=: 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # read -r var val 00:07:07.824 17:26:44 -- accel/accel.sh@21 -- # val= 00:07:07.824 17:26:44 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # IFS=: 00:07:07.824 17:26:44 -- accel/accel.sh@20 -- # read -r var val 00:07:07.824 17:26:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.824 17:26:44 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:07.824 17:26:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.824 00:07:07.824 real 0m2.785s 00:07:07.824 user 0m2.504s 00:07:07.824 sys 0m0.273s 00:07:07.824 17:26:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.824 17:26:44 -- common/autotest_common.sh@10 -- # set +x 00:07:07.824 ************************************ 00:07:07.824 END TEST accel_copy_crc32c_C2 00:07:07.824 ************************************ 00:07:07.824 17:26:44 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:07.824 17:26:44 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:07.824 17:26:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.824 17:26:44 -- common/autotest_common.sh@10 -- # set +x 00:07:07.824 ************************************ 00:07:07.824 START TEST accel_dualcast 00:07:07.825 ************************************ 00:07:07.825 17:26:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:07.825 17:26:44 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.825 17:26:44 -- accel/accel.sh@17 -- # local accel_module 00:07:07.825 17:26:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:07.825 17:26:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:07.825 17:26:44 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.825 17:26:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.825 17:26:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.825 17:26:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.825 17:26:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.825 17:26:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.825 17:26:44 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.825 17:26:44 -- accel/accel.sh@42 -- # jq -r . 00:07:07.825 [2024-11-16 17:26:45.011427] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.825 [2024-11-16 17:26:45.011512] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470145 ] 00:07:07.825 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.825 [2024-11-16 17:26:45.072763] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.825 [2024-11-16 17:26:45.162930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.206 17:26:46 -- accel/accel.sh@18 -- # out=' 00:07:09.206 SPDK Configuration: 00:07:09.206 Core mask: 0x1 00:07:09.206 00:07:09.206 Accel Perf Configuration: 00:07:09.206 Workload Type: dualcast 00:07:09.206 Transfer size: 4096 bytes 00:07:09.206 Vector count 1 00:07:09.206 Module: software 00:07:09.206 Queue depth: 32 00:07:09.206 Allocate depth: 32 00:07:09.206 # threads/core: 1 00:07:09.206 Run time: 1 seconds 00:07:09.206 Verify: Yes 00:07:09.206 00:07:09.206 Running for 1 seconds... 00:07:09.206 00:07:09.206 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:09.206 ------------------------------------------------------------------------------------ 00:07:09.206 0,0 299328/s 1169 MiB/s 0 0 00:07:09.206 ==================================================================================== 00:07:09.206 Total 299328/s 1169 MiB/s 0 0' 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:09.206 17:26:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.206 17:26:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.206 17:26:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.206 17:26:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.206 17:26:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.206 17:26:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.206 17:26:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.206 17:26:46 -- accel/accel.sh@42 -- # jq -r . 00:07:09.206 [2024-11-16 17:26:46.414157] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.206 [2024-11-16 17:26:46.414247] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470291 ] 00:07:09.206 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.206 [2024-11-16 17:26:46.475828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.206 [2024-11-16 17:26:46.565769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val= 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val= 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val=0x1 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val= 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val= 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val=dualcast 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val= 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val=software 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@23 -- # accel_module=software 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val=32 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val=32 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val=1 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val=Yes 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val= 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:09.206 17:26:46 -- accel/accel.sh@21 -- # val= 00:07:09.206 17:26:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # IFS=: 00:07:09.206 17:26:46 -- accel/accel.sh@20 -- # read -r var val 00:07:10.664 17:26:47 -- accel/accel.sh@21 -- # val= 00:07:10.664 17:26:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # IFS=: 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # read -r var val 00:07:10.664 17:26:47 -- accel/accel.sh@21 -- # val= 00:07:10.664 17:26:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # IFS=: 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # read -r var val 00:07:10.664 17:26:47 -- accel/accel.sh@21 -- # val= 00:07:10.664 17:26:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # IFS=: 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # read -r var val 00:07:10.664 17:26:47 -- accel/accel.sh@21 -- # val= 00:07:10.664 17:26:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # IFS=: 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # read -r var val 00:07:10.664 17:26:47 -- accel/accel.sh@21 -- # val= 00:07:10.664 17:26:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # IFS=: 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # read -r var val 00:07:10.664 17:26:47 -- accel/accel.sh@21 -- # val= 00:07:10.664 17:26:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # IFS=: 00:07:10.664 17:26:47 -- accel/accel.sh@20 -- # read -r var val 00:07:10.664 17:26:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.664 17:26:47 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:10.664 17:26:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.664 00:07:10.664 real 0m2.806s 00:07:10.664 user 0m2.508s 00:07:10.664 sys 0m0.290s 00:07:10.664 17:26:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.664 17:26:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.664 ************************************ 00:07:10.664 END TEST accel_dualcast 00:07:10.664 ************************************ 00:07:10.664 17:26:47 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:10.664 17:26:47 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:10.664 17:26:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.664 17:26:47 -- common/autotest_common.sh@10 -- # set +x 00:07:10.664 ************************************ 00:07:10.664 START TEST accel_compare 00:07:10.664 ************************************ 00:07:10.664 17:26:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:10.664 17:26:47 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.664 17:26:47 -- accel/accel.sh@17 -- # local accel_module 00:07:10.664 17:26:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:10.664 17:26:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:10.665 17:26:47 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.665 17:26:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.665 17:26:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.665 17:26:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.665 17:26:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.665 17:26:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.665 17:26:47 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.665 17:26:47 -- accel/accel.sh@42 -- # jq -r . 00:07:10.665 [2024-11-16 17:26:47.844018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:10.665 [2024-11-16 17:26:47.844106] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470446 ] 00:07:10.665 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.665 [2024-11-16 17:26:47.905691] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.665 [2024-11-16 17:26:47.996279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.067 17:26:49 -- accel/accel.sh@18 -- # out=' 00:07:12.067 SPDK Configuration: 00:07:12.067 Core mask: 0x1 00:07:12.067 00:07:12.067 Accel Perf Configuration: 00:07:12.067 Workload Type: compare 00:07:12.067 Transfer size: 4096 bytes 00:07:12.067 Vector count 1 00:07:12.067 Module: software 00:07:12.067 Queue depth: 32 00:07:12.067 Allocate depth: 32 00:07:12.067 # threads/core: 1 00:07:12.067 Run time: 1 seconds 00:07:12.067 Verify: Yes 00:07:12.067 00:07:12.067 Running for 1 seconds... 00:07:12.067 00:07:12.067 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:12.067 ------------------------------------------------------------------------------------ 00:07:12.067 0,0 405472/s 1583 MiB/s 0 0 00:07:12.067 ==================================================================================== 00:07:12.067 Total 405472/s 1583 MiB/s 0 0' 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.067 17:26:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.067 17:26:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:12.067 17:26:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.067 17:26:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.067 17:26:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.067 17:26:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.067 17:26:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.067 17:26:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.067 17:26:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.067 17:26:49 -- accel/accel.sh@42 -- # jq -r . 00:07:12.067 [2024-11-16 17:26:49.244897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:12.067 [2024-11-16 17:26:49.244981] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470665 ] 00:07:12.067 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.067 [2024-11-16 17:26:49.306459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.067 [2024-11-16 17:26:49.399590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.067 17:26:49 -- accel/accel.sh@21 -- # val= 00:07:12.067 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.067 17:26:49 -- accel/accel.sh@21 -- # val= 00:07:12.067 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.067 17:26:49 -- accel/accel.sh@21 -- # val=0x1 00:07:12.067 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.067 17:26:49 -- accel/accel.sh@21 -- # val= 00:07:12.067 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.067 17:26:49 -- accel/accel.sh@21 -- # val= 00:07:12.067 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.067 17:26:49 -- accel/accel.sh@21 -- # val=compare 00:07:12.067 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.067 17:26:49 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.067 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val= 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val=software 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val=32 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val=32 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val=1 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val=Yes 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val= 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:12.068 17:26:49 -- accel/accel.sh@21 -- # val= 00:07:12.068 17:26:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # IFS=: 00:07:12.068 17:26:49 -- accel/accel.sh@20 -- # read -r var val 00:07:13.452 17:26:50 -- accel/accel.sh@21 -- # val= 00:07:13.452 17:26:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # IFS=: 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # read -r var val 00:07:13.452 17:26:50 -- accel/accel.sh@21 -- # val= 00:07:13.452 17:26:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # IFS=: 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # read -r var val 00:07:13.452 17:26:50 -- accel/accel.sh@21 -- # val= 00:07:13.452 17:26:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # IFS=: 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # read -r var val 00:07:13.452 17:26:50 -- accel/accel.sh@21 -- # val= 00:07:13.452 17:26:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # IFS=: 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # read -r var val 00:07:13.452 17:26:50 -- accel/accel.sh@21 -- # val= 00:07:13.452 17:26:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # IFS=: 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # read -r var val 00:07:13.452 17:26:50 -- accel/accel.sh@21 -- # val= 00:07:13.452 17:26:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # IFS=: 00:07:13.452 17:26:50 -- accel/accel.sh@20 -- # read -r var val 00:07:13.452 17:26:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.452 17:26:50 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:13.452 17:26:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.452 00:07:13.452 real 0m2.811s 00:07:13.452 user 0m2.519s 00:07:13.452 sys 0m0.284s 00:07:13.452 17:26:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.452 17:26:50 -- common/autotest_common.sh@10 -- # set +x 00:07:13.452 ************************************ 00:07:13.452 END TEST accel_compare 00:07:13.452 ************************************ 00:07:13.452 17:26:50 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:13.452 17:26:50 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:13.452 17:26:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.452 17:26:50 -- common/autotest_common.sh@10 -- # set +x 00:07:13.452 ************************************ 00:07:13.452 START TEST accel_xor 00:07:13.452 ************************************ 00:07:13.452 17:26:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:13.452 17:26:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.452 17:26:50 -- accel/accel.sh@17 -- # local accel_module 00:07:13.452 17:26:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:13.452 17:26:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:13.452 17:26:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.452 17:26:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.452 17:26:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.452 17:26:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.452 17:26:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.452 17:26:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.452 17:26:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.452 17:26:50 -- accel/accel.sh@42 -- # jq -r . 00:07:13.452 [2024-11-16 17:26:50.681352] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:13.452 [2024-11-16 17:26:50.681430] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1470868 ] 00:07:13.452 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.452 [2024-11-16 17:26:50.744216] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.452 [2024-11-16 17:26:50.838757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.834 17:26:52 -- accel/accel.sh@18 -- # out=' 00:07:14.834 SPDK Configuration: 00:07:14.834 Core mask: 0x1 00:07:14.834 00:07:14.834 Accel Perf Configuration: 00:07:14.834 Workload Type: xor 00:07:14.834 Source buffers: 2 00:07:14.834 Transfer size: 4096 bytes 00:07:14.834 Vector count 1 00:07:14.834 Module: software 00:07:14.834 Queue depth: 32 00:07:14.834 Allocate depth: 32 00:07:14.834 # threads/core: 1 00:07:14.834 Run time: 1 seconds 00:07:14.834 Verify: Yes 00:07:14.834 00:07:14.834 Running for 1 seconds... 00:07:14.834 00:07:14.834 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.834 ------------------------------------------------------------------------------------ 00:07:14.834 0,0 193696/s 756 MiB/s 0 0 00:07:14.834 ==================================================================================== 00:07:14.834 Total 193696/s 756 MiB/s 0 0' 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:14.834 17:26:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.834 17:26:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.834 17:26:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.834 17:26:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.834 17:26:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.834 17:26:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.834 17:26:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.834 17:26:52 -- accel/accel.sh@42 -- # jq -r . 00:07:14.834 [2024-11-16 17:26:52.082608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.834 [2024-11-16 17:26:52.082709] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471016 ] 00:07:14.834 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.834 [2024-11-16 17:26:52.143946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.834 [2024-11-16 17:26:52.234162] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val= 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val= 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val=0x1 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val= 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val= 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val=xor 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val=2 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val= 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val=software 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val=32 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val=32 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val=1 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val=Yes 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.834 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.834 17:26:52 -- accel/accel.sh@21 -- # val= 00:07:14.834 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.835 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.835 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:14.835 17:26:52 -- accel/accel.sh@21 -- # val= 00:07:14.835 17:26:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.835 17:26:52 -- accel/accel.sh@20 -- # IFS=: 00:07:14.835 17:26:52 -- accel/accel.sh@20 -- # read -r var val 00:07:16.217 17:26:53 -- accel/accel.sh@21 -- # val= 00:07:16.217 17:26:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # IFS=: 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # read -r var val 00:07:16.217 17:26:53 -- accel/accel.sh@21 -- # val= 00:07:16.217 17:26:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # IFS=: 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # read -r var val 00:07:16.217 17:26:53 -- accel/accel.sh@21 -- # val= 00:07:16.217 17:26:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # IFS=: 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # read -r var val 00:07:16.217 17:26:53 -- accel/accel.sh@21 -- # val= 00:07:16.217 17:26:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # IFS=: 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # read -r var val 00:07:16.217 17:26:53 -- accel/accel.sh@21 -- # val= 00:07:16.217 17:26:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # IFS=: 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # read -r var val 00:07:16.217 17:26:53 -- accel/accel.sh@21 -- # val= 00:07:16.217 17:26:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # IFS=: 00:07:16.217 17:26:53 -- accel/accel.sh@20 -- # read -r var val 00:07:16.217 17:26:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.217 17:26:53 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:16.217 17:26:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.217 00:07:16.217 real 0m2.808s 00:07:16.217 user 0m2.512s 00:07:16.217 sys 0m0.289s 00:07:16.217 17:26:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.217 17:26:53 -- common/autotest_common.sh@10 -- # set +x 00:07:16.217 ************************************ 00:07:16.217 END TEST accel_xor 00:07:16.217 ************************************ 00:07:16.217 17:26:53 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:16.217 17:26:53 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:16.217 17:26:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.217 17:26:53 -- common/autotest_common.sh@10 -- # set +x 00:07:16.217 ************************************ 00:07:16.217 START TEST accel_xor 00:07:16.217 ************************************ 00:07:16.217 17:26:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:16.217 17:26:53 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.217 17:26:53 -- accel/accel.sh@17 -- # local accel_module 00:07:16.217 17:26:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:16.217 17:26:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:16.217 17:26:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.217 17:26:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.217 17:26:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.217 17:26:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.217 17:26:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.217 17:26:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.217 17:26:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.217 17:26:53 -- accel/accel.sh@42 -- # jq -r . 00:07:16.217 [2024-11-16 17:26:53.515671] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:16.217 [2024-11-16 17:26:53.515757] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471175 ] 00:07:16.217 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.217 [2024-11-16 17:26:53.577548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.217 [2024-11-16 17:26:53.668145] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.601 17:26:54 -- accel/accel.sh@18 -- # out=' 00:07:17.601 SPDK Configuration: 00:07:17.601 Core mask: 0x1 00:07:17.601 00:07:17.601 Accel Perf Configuration: 00:07:17.601 Workload Type: xor 00:07:17.601 Source buffers: 3 00:07:17.601 Transfer size: 4096 bytes 00:07:17.601 Vector count 1 00:07:17.601 Module: software 00:07:17.601 Queue depth: 32 00:07:17.601 Allocate depth: 32 00:07:17.601 # threads/core: 1 00:07:17.601 Run time: 1 seconds 00:07:17.601 Verify: Yes 00:07:17.601 00:07:17.601 Running for 1 seconds... 00:07:17.601 00:07:17.601 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.601 ------------------------------------------------------------------------------------ 00:07:17.601 0,0 185952/s 726 MiB/s 0 0 00:07:17.601 ==================================================================================== 00:07:17.601 Total 185952/s 726 MiB/s 0 0' 00:07:17.601 17:26:54 -- accel/accel.sh@20 -- # IFS=: 00:07:17.601 17:26:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:17.601 17:26:54 -- accel/accel.sh@20 -- # read -r var val 00:07:17.601 17:26:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:17.601 17:26:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.601 17:26:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.601 17:26:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.601 17:26:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.602 17:26:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.602 17:26:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.602 17:26:54 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.602 17:26:54 -- accel/accel.sh@42 -- # jq -r . 00:07:17.602 [2024-11-16 17:26:54.915996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.602 [2024-11-16 17:26:54.916078] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471365 ] 00:07:17.602 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.602 [2024-11-16 17:26:54.976702] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.602 [2024-11-16 17:26:55.067687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val= 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val= 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val=0x1 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val= 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val= 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val=xor 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val=3 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val= 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val=software 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val=32 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val=32 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val=1 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val=Yes 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val= 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:17.861 17:26:55 -- accel/accel.sh@21 -- # val= 00:07:17.861 17:26:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # IFS=: 00:07:17.861 17:26:55 -- accel/accel.sh@20 -- # read -r var val 00:07:19.244 17:26:56 -- accel/accel.sh@21 -- # val= 00:07:19.245 17:26:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # IFS=: 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # read -r var val 00:07:19.245 17:26:56 -- accel/accel.sh@21 -- # val= 00:07:19.245 17:26:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # IFS=: 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # read -r var val 00:07:19.245 17:26:56 -- accel/accel.sh@21 -- # val= 00:07:19.245 17:26:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # IFS=: 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # read -r var val 00:07:19.245 17:26:56 -- accel/accel.sh@21 -- # val= 00:07:19.245 17:26:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # IFS=: 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # read -r var val 00:07:19.245 17:26:56 -- accel/accel.sh@21 -- # val= 00:07:19.245 17:26:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # IFS=: 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # read -r var val 00:07:19.245 17:26:56 -- accel/accel.sh@21 -- # val= 00:07:19.245 17:26:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # IFS=: 00:07:19.245 17:26:56 -- accel/accel.sh@20 -- # read -r var val 00:07:19.245 17:26:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:19.245 17:26:56 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:19.245 17:26:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:19.245 00:07:19.245 real 0m2.807s 00:07:19.245 user 0m2.503s 00:07:19.245 sys 0m0.296s 00:07:19.245 17:26:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.245 17:26:56 -- common/autotest_common.sh@10 -- # set +x 00:07:19.245 ************************************ 00:07:19.245 END TEST accel_xor 00:07:19.245 ************************************ 00:07:19.245 17:26:56 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:19.245 17:26:56 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:19.245 17:26:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.245 17:26:56 -- common/autotest_common.sh@10 -- # set +x 00:07:19.245 ************************************ 00:07:19.245 START TEST accel_dif_verify 00:07:19.245 ************************************ 00:07:19.245 17:26:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:19.245 17:26:56 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.245 17:26:56 -- accel/accel.sh@17 -- # local accel_module 00:07:19.245 17:26:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:19.245 17:26:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:19.245 17:26:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.245 17:26:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.245 17:26:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.245 17:26:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.245 17:26:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.245 17:26:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.245 17:26:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.245 17:26:56 -- accel/accel.sh@42 -- # jq -r . 00:07:19.245 [2024-11-16 17:26:56.350380] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.245 [2024-11-16 17:26:56.350458] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471587 ] 00:07:19.245 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.245 [2024-11-16 17:26:56.412883] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.245 [2024-11-16 17:26:56.500398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.625 17:26:57 -- accel/accel.sh@18 -- # out=' 00:07:20.625 SPDK Configuration: 00:07:20.625 Core mask: 0x1 00:07:20.625 00:07:20.625 Accel Perf Configuration: 00:07:20.625 Workload Type: dif_verify 00:07:20.625 Vector size: 4096 bytes 00:07:20.625 Transfer size: 4096 bytes 00:07:20.625 Block size: 512 bytes 00:07:20.625 Metadata size: 8 bytes 00:07:20.625 Vector count 1 00:07:20.625 Module: software 00:07:20.625 Queue depth: 32 00:07:20.625 Allocate depth: 32 00:07:20.625 # threads/core: 1 00:07:20.625 Run time: 1 seconds 00:07:20.625 Verify: No 00:07:20.625 00:07:20.625 Running for 1 seconds... 00:07:20.625 00:07:20.625 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.625 ------------------------------------------------------------------------------------ 00:07:20.625 0,0 81920/s 325 MiB/s 0 0 00:07:20.625 ==================================================================================== 00:07:20.625 Total 81920/s 320 MiB/s 0 0' 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:20.625 17:26:57 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.625 17:26:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.625 17:26:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.625 17:26:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.625 17:26:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.625 17:26:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.625 17:26:57 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.625 17:26:57 -- accel/accel.sh@42 -- # jq -r . 00:07:20.625 [2024-11-16 17:26:57.737096] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.625 [2024-11-16 17:26:57.737186] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471742 ] 00:07:20.625 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.625 [2024-11-16 17:26:57.798405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.625 [2024-11-16 17:26:57.888295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val= 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val= 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val=0x1 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val= 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val= 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val=dif_verify 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val= 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val=software 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val=32 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val=32 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val=1 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val=No 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val= 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:20.625 17:26:57 -- accel/accel.sh@21 -- # val= 00:07:20.625 17:26:57 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # IFS=: 00:07:20.625 17:26:57 -- accel/accel.sh@20 -- # read -r var val 00:07:22.002 17:26:59 -- accel/accel.sh@21 -- # val= 00:07:22.002 17:26:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.002 17:26:59 -- accel/accel.sh@20 -- # IFS=: 00:07:22.002 17:26:59 -- accel/accel.sh@20 -- # read -r var val 00:07:22.002 17:26:59 -- accel/accel.sh@21 -- # val= 00:07:22.002 17:26:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.002 17:26:59 -- accel/accel.sh@20 -- # IFS=: 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # read -r var val 00:07:22.003 17:26:59 -- accel/accel.sh@21 -- # val= 00:07:22.003 17:26:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # IFS=: 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # read -r var val 00:07:22.003 17:26:59 -- accel/accel.sh@21 -- # val= 00:07:22.003 17:26:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # IFS=: 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # read -r var val 00:07:22.003 17:26:59 -- accel/accel.sh@21 -- # val= 00:07:22.003 17:26:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # IFS=: 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # read -r var val 00:07:22.003 17:26:59 -- accel/accel.sh@21 -- # val= 00:07:22.003 17:26:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # IFS=: 00:07:22.003 17:26:59 -- accel/accel.sh@20 -- # read -r var val 00:07:22.003 17:26:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:22.003 17:26:59 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:22.003 17:26:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.003 00:07:22.003 real 0m2.790s 00:07:22.003 user 0m2.507s 00:07:22.003 sys 0m0.279s 00:07:22.003 17:26:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.003 17:26:59 -- common/autotest_common.sh@10 -- # set +x 00:07:22.003 ************************************ 00:07:22.003 END TEST accel_dif_verify 00:07:22.003 ************************************ 00:07:22.003 17:26:59 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:22.003 17:26:59 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:22.003 17:26:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.003 17:26:59 -- common/autotest_common.sh@10 -- # set +x 00:07:22.003 ************************************ 00:07:22.003 START TEST accel_dif_generate 00:07:22.003 ************************************ 00:07:22.003 17:26:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:22.003 17:26:59 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.003 17:26:59 -- accel/accel.sh@17 -- # local accel_module 00:07:22.003 17:26:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:22.003 17:26:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:22.003 17:26:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.003 17:26:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.003 17:26:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.003 17:26:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.003 17:26:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.003 17:26:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.003 17:26:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.003 17:26:59 -- accel/accel.sh@42 -- # jq -r . 00:07:22.003 [2024-11-16 17:26:59.166808] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:22.003 [2024-11-16 17:26:59.166891] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1471896 ] 00:07:22.003 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.003 [2024-11-16 17:26:59.227676] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.003 [2024-11-16 17:26:59.318544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.379 17:27:00 -- accel/accel.sh@18 -- # out=' 00:07:23.379 SPDK Configuration: 00:07:23.379 Core mask: 0x1 00:07:23.379 00:07:23.379 Accel Perf Configuration: 00:07:23.379 Workload Type: dif_generate 00:07:23.379 Vector size: 4096 bytes 00:07:23.379 Transfer size: 4096 bytes 00:07:23.379 Block size: 512 bytes 00:07:23.379 Metadata size: 8 bytes 00:07:23.379 Vector count 1 00:07:23.379 Module: software 00:07:23.379 Queue depth: 32 00:07:23.379 Allocate depth: 32 00:07:23.379 # threads/core: 1 00:07:23.379 Run time: 1 seconds 00:07:23.379 Verify: No 00:07:23.379 00:07:23.379 Running for 1 seconds... 00:07:23.379 00:07:23.379 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.379 ------------------------------------------------------------------------------------ 00:07:23.379 0,0 97952/s 388 MiB/s 0 0 00:07:23.379 ==================================================================================== 00:07:23.379 Total 97952/s 382 MiB/s 0 0' 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.379 17:27:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.379 17:27:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:23.379 17:27:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.379 17:27:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.379 17:27:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.379 17:27:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.379 17:27:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.379 17:27:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.379 17:27:00 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.379 17:27:00 -- accel/accel.sh@42 -- # jq -r . 00:07:23.379 [2024-11-16 17:27:00.563791] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:23.379 [2024-11-16 17:27:00.563872] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472097 ] 00:07:23.379 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.379 [2024-11-16 17:27:00.627394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.379 [2024-11-16 17:27:00.719092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.379 17:27:00 -- accel/accel.sh@21 -- # val= 00:07:23.379 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.379 17:27:00 -- accel/accel.sh@21 -- # val= 00:07:23.379 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.379 17:27:00 -- accel/accel.sh@21 -- # val=0x1 00:07:23.379 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.379 17:27:00 -- accel/accel.sh@21 -- # val= 00:07:23.379 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.379 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.379 17:27:00 -- accel/accel.sh@21 -- # val= 00:07:23.379 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val=dif_generate 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val= 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val=software 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val=32 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val=32 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val=1 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val=No 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val= 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:23.380 17:27:00 -- accel/accel.sh@21 -- # val= 00:07:23.380 17:27:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # IFS=: 00:07:23.380 17:27:00 -- accel/accel.sh@20 -- # read -r var val 00:07:24.753 17:27:01 -- accel/accel.sh@21 -- # val= 00:07:24.753 17:27:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # IFS=: 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # read -r var val 00:07:24.753 17:27:01 -- accel/accel.sh@21 -- # val= 00:07:24.753 17:27:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # IFS=: 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # read -r var val 00:07:24.753 17:27:01 -- accel/accel.sh@21 -- # val= 00:07:24.753 17:27:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # IFS=: 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # read -r var val 00:07:24.753 17:27:01 -- accel/accel.sh@21 -- # val= 00:07:24.753 17:27:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # IFS=: 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # read -r var val 00:07:24.753 17:27:01 -- accel/accel.sh@21 -- # val= 00:07:24.753 17:27:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # IFS=: 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # read -r var val 00:07:24.753 17:27:01 -- accel/accel.sh@21 -- # val= 00:07:24.753 17:27:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # IFS=: 00:07:24.753 17:27:01 -- accel/accel.sh@20 -- # read -r var val 00:07:24.753 17:27:01 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.753 17:27:01 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:24.753 17:27:01 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.753 00:07:24.753 real 0m2.796s 00:07:24.753 user 0m2.506s 00:07:24.753 sys 0m0.283s 00:07:24.753 17:27:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.753 17:27:01 -- common/autotest_common.sh@10 -- # set +x 00:07:24.753 ************************************ 00:07:24.753 END TEST accel_dif_generate 00:07:24.753 ************************************ 00:07:24.753 17:27:01 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:24.753 17:27:01 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:24.753 17:27:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.753 17:27:01 -- common/autotest_common.sh@10 -- # set +x 00:07:24.753 ************************************ 00:07:24.753 START TEST accel_dif_generate_copy 00:07:24.753 ************************************ 00:07:24.753 17:27:01 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:24.753 17:27:01 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.753 17:27:01 -- accel/accel.sh@17 -- # local accel_module 00:07:24.753 17:27:01 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:24.753 17:27:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:24.753 17:27:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.753 17:27:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.753 17:27:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.753 17:27:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.753 17:27:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.753 17:27:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.753 17:27:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.753 17:27:01 -- accel/accel.sh@42 -- # jq -r . 00:07:24.753 [2024-11-16 17:27:01.991690] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:24.753 [2024-11-16 17:27:01.991777] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472427 ] 00:07:24.753 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.753 [2024-11-16 17:27:02.052717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.753 [2024-11-16 17:27:02.142578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.136 17:27:03 -- accel/accel.sh@18 -- # out=' 00:07:26.136 SPDK Configuration: 00:07:26.136 Core mask: 0x1 00:07:26.136 00:07:26.136 Accel Perf Configuration: 00:07:26.136 Workload Type: dif_generate_copy 00:07:26.136 Vector size: 4096 bytes 00:07:26.136 Transfer size: 4096 bytes 00:07:26.136 Vector count 1 00:07:26.136 Module: software 00:07:26.136 Queue depth: 32 00:07:26.136 Allocate depth: 32 00:07:26.136 # threads/core: 1 00:07:26.136 Run time: 1 seconds 00:07:26.136 Verify: No 00:07:26.136 00:07:26.136 Running for 1 seconds... 00:07:26.136 00:07:26.136 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:26.136 ------------------------------------------------------------------------------------ 00:07:26.136 0,0 77920/s 309 MiB/s 0 0 00:07:26.136 ==================================================================================== 00:07:26.136 Total 77920/s 304 MiB/s 0 0' 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:26.136 17:27:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.136 17:27:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.136 17:27:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.136 17:27:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.136 17:27:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.136 17:27:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.136 17:27:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.136 17:27:03 -- accel/accel.sh@42 -- # jq -r . 00:07:26.136 [2024-11-16 17:27:03.390224] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:26.136 [2024-11-16 17:27:03.390320] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472573 ] 00:07:26.136 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.136 [2024-11-16 17:27:03.450264] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.136 [2024-11-16 17:27:03.540241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val= 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val= 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val=0x1 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val= 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val= 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val= 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val=software 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@23 -- # accel_module=software 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val=32 00:07:26.136 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.136 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.136 17:27:03 -- accel/accel.sh@21 -- # val=32 00:07:26.137 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.137 17:27:03 -- accel/accel.sh@21 -- # val=1 00:07:26.137 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.137 17:27:03 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:26.137 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.137 17:27:03 -- accel/accel.sh@21 -- # val=No 00:07:26.137 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.137 17:27:03 -- accel/accel.sh@21 -- # val= 00:07:26.137 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:26.137 17:27:03 -- accel/accel.sh@21 -- # val= 00:07:26.137 17:27:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # IFS=: 00:07:26.137 17:27:03 -- accel/accel.sh@20 -- # read -r var val 00:07:27.519 17:27:04 -- accel/accel.sh@21 -- # val= 00:07:27.519 17:27:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # IFS=: 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # read -r var val 00:07:27.519 17:27:04 -- accel/accel.sh@21 -- # val= 00:07:27.519 17:27:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # IFS=: 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # read -r var val 00:07:27.519 17:27:04 -- accel/accel.sh@21 -- # val= 00:07:27.519 17:27:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # IFS=: 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # read -r var val 00:07:27.519 17:27:04 -- accel/accel.sh@21 -- # val= 00:07:27.519 17:27:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # IFS=: 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # read -r var val 00:07:27.519 17:27:04 -- accel/accel.sh@21 -- # val= 00:07:27.519 17:27:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # IFS=: 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # read -r var val 00:07:27.519 17:27:04 -- accel/accel.sh@21 -- # val= 00:07:27.519 17:27:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # IFS=: 00:07:27.519 17:27:04 -- accel/accel.sh@20 -- # read -r var val 00:07:27.519 17:27:04 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.519 17:27:04 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:27.519 17:27:04 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.519 00:07:27.519 real 0m2.797s 00:07:27.519 user 0m2.498s 00:07:27.519 sys 0m0.288s 00:07:27.519 17:27:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.519 17:27:04 -- common/autotest_common.sh@10 -- # set +x 00:07:27.519 ************************************ 00:07:27.519 END TEST accel_dif_generate_copy 00:07:27.519 ************************************ 00:07:27.519 17:27:04 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:27.519 17:27:04 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.519 17:27:04 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:27.519 17:27:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.519 17:27:04 -- common/autotest_common.sh@10 -- # set +x 00:07:27.519 ************************************ 00:07:27.519 START TEST accel_comp 00:07:27.519 ************************************ 00:07:27.519 17:27:04 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.519 17:27:04 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.519 17:27:04 -- accel/accel.sh@17 -- # local accel_module 00:07:27.519 17:27:04 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.519 17:27:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.519 17:27:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.519 17:27:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.519 17:27:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.519 17:27:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.519 17:27:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.519 17:27:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.519 17:27:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.519 17:27:04 -- accel/accel.sh@42 -- # jq -r . 00:07:27.519 [2024-11-16 17:27:04.816898] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.519 [2024-11-16 17:27:04.816985] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472736 ] 00:07:27.519 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.519 [2024-11-16 17:27:04.877301] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.519 [2024-11-16 17:27:04.967855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.902 17:27:06 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:28.902 00:07:28.902 SPDK Configuration: 00:07:28.902 Core mask: 0x1 00:07:28.902 00:07:28.902 Accel Perf Configuration: 00:07:28.902 Workload Type: compress 00:07:28.902 Transfer size: 4096 bytes 00:07:28.902 Vector count 1 00:07:28.902 Module: software 00:07:28.902 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.902 Queue depth: 32 00:07:28.902 Allocate depth: 32 00:07:28.902 # threads/core: 1 00:07:28.902 Run time: 1 seconds 00:07:28.902 Verify: No 00:07:28.902 00:07:28.902 Running for 1 seconds... 00:07:28.902 00:07:28.902 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:28.902 ------------------------------------------------------------------------------------ 00:07:28.902 0,0 31520/s 131 MiB/s 0 0 00:07:28.902 ==================================================================================== 00:07:28.902 Total 31520/s 123 MiB/s 0 0' 00:07:28.902 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:28.902 17:27:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.902 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:28.902 17:27:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.902 17:27:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.902 17:27:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.902 17:27:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.902 17:27:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.902 17:27:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.902 17:27:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.902 17:27:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.902 17:27:06 -- accel/accel.sh@42 -- # jq -r . 00:07:28.902 [2024-11-16 17:27:06.221804] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:28.902 [2024-11-16 17:27:06.221889] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1472892 ] 00:07:28.902 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.902 [2024-11-16 17:27:06.282507] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.902 [2024-11-16 17:27:06.372514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val= 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val= 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val= 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val=0x1 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val= 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val= 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val=compress 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val= 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val=software 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@23 -- # accel_module=software 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val=32 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val=32 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val=1 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val=No 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val= 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:29.163 17:27:06 -- accel/accel.sh@21 -- # val= 00:07:29.163 17:27:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # IFS=: 00:07:29.163 17:27:06 -- accel/accel.sh@20 -- # read -r var val 00:07:30.542 17:27:07 -- accel/accel.sh@21 -- # val= 00:07:30.542 17:27:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # IFS=: 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # read -r var val 00:07:30.542 17:27:07 -- accel/accel.sh@21 -- # val= 00:07:30.542 17:27:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # IFS=: 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # read -r var val 00:07:30.542 17:27:07 -- accel/accel.sh@21 -- # val= 00:07:30.542 17:27:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # IFS=: 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # read -r var val 00:07:30.542 17:27:07 -- accel/accel.sh@21 -- # val= 00:07:30.542 17:27:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # IFS=: 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # read -r var val 00:07:30.542 17:27:07 -- accel/accel.sh@21 -- # val= 00:07:30.542 17:27:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # IFS=: 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # read -r var val 00:07:30.542 17:27:07 -- accel/accel.sh@21 -- # val= 00:07:30.542 17:27:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # IFS=: 00:07:30.542 17:27:07 -- accel/accel.sh@20 -- # read -r var val 00:07:30.542 17:27:07 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:30.542 17:27:07 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:30.542 17:27:07 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.542 00:07:30.542 real 0m2.803s 00:07:30.542 user 0m2.518s 00:07:30.542 sys 0m0.276s 00:07:30.542 17:27:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.542 17:27:07 -- common/autotest_common.sh@10 -- # set +x 00:07:30.542 ************************************ 00:07:30.542 END TEST accel_comp 00:07:30.542 ************************************ 00:07:30.542 17:27:07 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.542 17:27:07 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:30.542 17:27:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.542 17:27:07 -- common/autotest_common.sh@10 -- # set +x 00:07:30.542 ************************************ 00:07:30.542 START TEST accel_decomp 00:07:30.542 ************************************ 00:07:30.542 17:27:07 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.542 17:27:07 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.542 17:27:07 -- accel/accel.sh@17 -- # local accel_module 00:07:30.542 17:27:07 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.542 17:27:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.542 17:27:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.542 17:27:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:30.542 17:27:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.542 17:27:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.542 17:27:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:30.542 17:27:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:30.542 17:27:07 -- accel/accel.sh@41 -- # local IFS=, 00:07:30.542 17:27:07 -- accel/accel.sh@42 -- # jq -r . 00:07:30.542 [2024-11-16 17:27:07.640628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:30.543 [2024-11-16 17:27:07.640708] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473309 ] 00:07:30.543 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.543 [2024-11-16 17:27:07.700101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.543 [2024-11-16 17:27:07.789880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.927 17:27:09 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:31.927 00:07:31.927 SPDK Configuration: 00:07:31.927 Core mask: 0x1 00:07:31.927 00:07:31.927 Accel Perf Configuration: 00:07:31.927 Workload Type: decompress 00:07:31.927 Transfer size: 4096 bytes 00:07:31.927 Vector count 1 00:07:31.927 Module: software 00:07:31.927 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.927 Queue depth: 32 00:07:31.927 Allocate depth: 32 00:07:31.927 # threads/core: 1 00:07:31.927 Run time: 1 seconds 00:07:31.928 Verify: Yes 00:07:31.928 00:07:31.928 Running for 1 seconds... 00:07:31.928 00:07:31.928 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.928 ------------------------------------------------------------------------------------ 00:07:31.928 0,0 57088/s 105 MiB/s 0 0 00:07:31.928 ==================================================================================== 00:07:31.928 Total 57088/s 223 MiB/s 0 0' 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:31.928 17:27:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.928 17:27:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.928 17:27:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.928 17:27:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.928 17:27:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.928 17:27:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.928 17:27:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.928 17:27:09 -- accel/accel.sh@42 -- # jq -r . 00:07:31.928 [2024-11-16 17:27:09.033130] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:31.928 [2024-11-16 17:27:09.033217] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473717 ] 00:07:31.928 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.928 [2024-11-16 17:27:09.094073] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.928 [2024-11-16 17:27:09.183799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val= 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val= 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val= 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val=0x1 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val= 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val= 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val=decompress 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val= 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val=software 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val=32 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val=32 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val=1 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val=Yes 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val= 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:31.928 17:27:09 -- accel/accel.sh@21 -- # val= 00:07:31.928 17:27:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # IFS=: 00:07:31.928 17:27:09 -- accel/accel.sh@20 -- # read -r var val 00:07:33.307 17:27:10 -- accel/accel.sh@21 -- # val= 00:07:33.307 17:27:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # IFS=: 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # read -r var val 00:07:33.307 17:27:10 -- accel/accel.sh@21 -- # val= 00:07:33.307 17:27:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # IFS=: 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # read -r var val 00:07:33.307 17:27:10 -- accel/accel.sh@21 -- # val= 00:07:33.307 17:27:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # IFS=: 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # read -r var val 00:07:33.307 17:27:10 -- accel/accel.sh@21 -- # val= 00:07:33.307 17:27:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # IFS=: 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # read -r var val 00:07:33.307 17:27:10 -- accel/accel.sh@21 -- # val= 00:07:33.307 17:27:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # IFS=: 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # read -r var val 00:07:33.307 17:27:10 -- accel/accel.sh@21 -- # val= 00:07:33.307 17:27:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # IFS=: 00:07:33.307 17:27:10 -- accel/accel.sh@20 -- # read -r var val 00:07:33.307 17:27:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:33.307 17:27:10 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:33.307 17:27:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:33.307 00:07:33.307 real 0m2.788s 00:07:33.307 user 0m2.503s 00:07:33.307 sys 0m0.278s 00:07:33.307 17:27:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.307 17:27:10 -- common/autotest_common.sh@10 -- # set +x 00:07:33.307 ************************************ 00:07:33.307 END TEST accel_decomp 00:07:33.307 ************************************ 00:07:33.307 17:27:10 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.307 17:27:10 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:33.307 17:27:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.307 17:27:10 -- common/autotest_common.sh@10 -- # set +x 00:07:33.307 ************************************ 00:07:33.307 START TEST accel_decmop_full 00:07:33.307 ************************************ 00:07:33.307 17:27:10 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.307 17:27:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.307 17:27:10 -- accel/accel.sh@17 -- # local accel_module 00:07:33.307 17:27:10 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.307 17:27:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.307 17:27:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.307 17:27:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.307 17:27:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.307 17:27:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.307 17:27:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.307 17:27:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.307 17:27:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.307 17:27:10 -- accel/accel.sh@42 -- # jq -r . 00:07:33.307 [2024-11-16 17:27:10.453334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:33.307 [2024-11-16 17:27:10.453420] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1473959 ] 00:07:33.307 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.307 [2024-11-16 17:27:10.516091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.307 [2024-11-16 17:27:10.606023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.690 17:27:11 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:34.690 00:07:34.690 SPDK Configuration: 00:07:34.690 Core mask: 0x1 00:07:34.690 00:07:34.690 Accel Perf Configuration: 00:07:34.690 Workload Type: decompress 00:07:34.690 Transfer size: 111250 bytes 00:07:34.690 Vector count 1 00:07:34.690 Module: software 00:07:34.690 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.690 Queue depth: 32 00:07:34.690 Allocate depth: 32 00:07:34.690 # threads/core: 1 00:07:34.690 Run time: 1 seconds 00:07:34.690 Verify: Yes 00:07:34.690 00:07:34.690 Running for 1 seconds... 00:07:34.690 00:07:34.690 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:34.690 ------------------------------------------------------------------------------------ 00:07:34.690 0,0 3808/s 157 MiB/s 0 0 00:07:34.690 ==================================================================================== 00:07:34.690 Total 3808/s 404 MiB/s 0 0' 00:07:34.690 17:27:11 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:34.690 17:27:11 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:34.690 17:27:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.690 17:27:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.690 17:27:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.690 17:27:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.690 17:27:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.690 17:27:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.690 17:27:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.690 17:27:11 -- accel/accel.sh@42 -- # jq -r . 00:07:34.690 [2024-11-16 17:27:11.876692] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:34.690 [2024-11-16 17:27:11.876774] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474113 ] 00:07:34.690 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.690 [2024-11-16 17:27:11.940640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.690 [2024-11-16 17:27:12.029214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val= 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val= 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val= 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val=0x1 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val= 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val= 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val=decompress 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val= 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val=software 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val=32 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val=32 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val=1 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val=Yes 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val= 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:34.690 17:27:12 -- accel/accel.sh@21 -- # val= 00:07:34.690 17:27:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # IFS=: 00:07:34.690 17:27:12 -- accel/accel.sh@20 -- # read -r var val 00:07:36.070 17:27:13 -- accel/accel.sh@21 -- # val= 00:07:36.070 17:27:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # IFS=: 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # read -r var val 00:07:36.070 17:27:13 -- accel/accel.sh@21 -- # val= 00:07:36.070 17:27:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # IFS=: 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # read -r var val 00:07:36.070 17:27:13 -- accel/accel.sh@21 -- # val= 00:07:36.070 17:27:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # IFS=: 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # read -r var val 00:07:36.070 17:27:13 -- accel/accel.sh@21 -- # val= 00:07:36.070 17:27:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # IFS=: 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # read -r var val 00:07:36.070 17:27:13 -- accel/accel.sh@21 -- # val= 00:07:36.070 17:27:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # IFS=: 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # read -r var val 00:07:36.070 17:27:13 -- accel/accel.sh@21 -- # val= 00:07:36.070 17:27:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # IFS=: 00:07:36.070 17:27:13 -- accel/accel.sh@20 -- # read -r var val 00:07:36.070 17:27:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:36.070 17:27:13 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:36.070 17:27:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.070 00:07:36.070 real 0m2.845s 00:07:36.070 user 0m2.546s 00:07:36.070 sys 0m0.291s 00:07:36.070 17:27:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.070 17:27:13 -- common/autotest_common.sh@10 -- # set +x 00:07:36.070 ************************************ 00:07:36.070 END TEST accel_decmop_full 00:07:36.070 ************************************ 00:07:36.070 17:27:13 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.070 17:27:13 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:36.070 17:27:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.070 17:27:13 -- common/autotest_common.sh@10 -- # set +x 00:07:36.070 ************************************ 00:07:36.070 START TEST accel_decomp_mcore 00:07:36.071 ************************************ 00:07:36.071 17:27:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.071 17:27:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.071 17:27:13 -- accel/accel.sh@17 -- # local accel_module 00:07:36.071 17:27:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.071 17:27:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.071 17:27:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.071 17:27:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.071 17:27:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.071 17:27:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.071 17:27:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.071 17:27:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.071 17:27:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.071 17:27:13 -- accel/accel.sh@42 -- # jq -r . 00:07:36.071 [2024-11-16 17:27:13.328266] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:36.071 [2024-11-16 17:27:13.328356] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474381 ] 00:07:36.071 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.071 [2024-11-16 17:27:13.389563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:36.071 [2024-11-16 17:27:13.483346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:36.071 [2024-11-16 17:27:13.483415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:36.071 [2024-11-16 17:27:13.483507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:36.071 [2024-11-16 17:27:13.483510] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.448 17:27:14 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:37.448 00:07:37.448 SPDK Configuration: 00:07:37.448 Core mask: 0xf 00:07:37.448 00:07:37.448 Accel Perf Configuration: 00:07:37.448 Workload Type: decompress 00:07:37.448 Transfer size: 4096 bytes 00:07:37.448 Vector count 1 00:07:37.448 Module: software 00:07:37.448 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.448 Queue depth: 32 00:07:37.448 Allocate depth: 32 00:07:37.448 # threads/core: 1 00:07:37.448 Run time: 1 seconds 00:07:37.448 Verify: Yes 00:07:37.448 00:07:37.448 Running for 1 seconds... 00:07:37.448 00:07:37.448 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:37.448 ------------------------------------------------------------------------------------ 00:07:37.448 0,0 56672/s 104 MiB/s 0 0 00:07:37.448 3,0 57248/s 105 MiB/s 0 0 00:07:37.448 2,0 57024/s 105 MiB/s 0 0 00:07:37.448 1,0 56992/s 105 MiB/s 0 0 00:07:37.448 ==================================================================================== 00:07:37.448 Total 227936/s 890 MiB/s 0 0' 00:07:37.448 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.449 17:27:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:37.449 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.449 17:27:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:37.449 17:27:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.449 17:27:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.449 17:27:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.449 17:27:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.449 17:27:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.449 17:27:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.449 17:27:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.449 17:27:14 -- accel/accel.sh@42 -- # jq -r . 00:07:37.449 [2024-11-16 17:27:14.741706] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:37.449 [2024-11-16 17:27:14.741786] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474531 ] 00:07:37.449 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.449 [2024-11-16 17:27:14.805473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:37.449 [2024-11-16 17:27:14.898872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:37.449 [2024-11-16 17:27:14.898925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:37.449 [2024-11-16 17:27:14.899042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:37.449 [2024-11-16 17:27:14.899045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val= 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val= 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val= 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val=0xf 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val= 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val= 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val=decompress 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val= 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val=software 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@23 -- # accel_module=software 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val=32 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val=32 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val=1 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val=Yes 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.709 17:27:14 -- accel/accel.sh@21 -- # val= 00:07:37.709 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.709 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.710 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:37.710 17:27:14 -- accel/accel.sh@21 -- # val= 00:07:37.710 17:27:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.710 17:27:14 -- accel/accel.sh@20 -- # IFS=: 00:07:37.710 17:27:14 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@21 -- # val= 00:07:38.648 17:27:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # IFS=: 00:07:38.648 17:27:16 -- accel/accel.sh@20 -- # read -r var val 00:07:38.648 17:27:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:38.648 17:27:16 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:38.648 17:27:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:38.648 00:07:38.648 real 0m2.821s 00:07:38.648 user 0m9.410s 00:07:38.648 sys 0m0.298s 00:07:38.648 17:27:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.648 17:27:16 -- common/autotest_common.sh@10 -- # set +x 00:07:38.648 ************************************ 00:07:38.648 END TEST accel_decomp_mcore 00:07:38.648 ************************************ 00:07:38.909 17:27:16 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.909 17:27:16 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:38.909 17:27:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.909 17:27:16 -- common/autotest_common.sh@10 -- # set +x 00:07:38.909 ************************************ 00:07:38.909 START TEST accel_decomp_full_mcore 00:07:38.909 ************************************ 00:07:38.909 17:27:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.909 17:27:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:38.909 17:27:16 -- accel/accel.sh@17 -- # local accel_module 00:07:38.909 17:27:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.909 17:27:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.909 17:27:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.909 17:27:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.909 17:27:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.909 17:27:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.909 17:27:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.909 17:27:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.909 17:27:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.909 17:27:16 -- accel/accel.sh@42 -- # jq -r . 00:07:38.909 [2024-11-16 17:27:16.173849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.909 [2024-11-16 17:27:16.173937] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474694 ] 00:07:38.909 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.909 [2024-11-16 17:27:16.235102] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:38.909 [2024-11-16 17:27:16.329057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:38.909 [2024-11-16 17:27:16.329113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:38.909 [2024-11-16 17:27:16.329195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:38.909 [2024-11-16 17:27:16.329197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.289 17:27:17 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:40.289 00:07:40.289 SPDK Configuration: 00:07:40.289 Core mask: 0xf 00:07:40.289 00:07:40.289 Accel Perf Configuration: 00:07:40.289 Workload Type: decompress 00:07:40.289 Transfer size: 111250 bytes 00:07:40.289 Vector count 1 00:07:40.289 Module: software 00:07:40.289 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.289 Queue depth: 32 00:07:40.289 Allocate depth: 32 00:07:40.289 # threads/core: 1 00:07:40.289 Run time: 1 seconds 00:07:40.289 Verify: Yes 00:07:40.289 00:07:40.289 Running for 1 seconds... 00:07:40.289 00:07:40.289 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:40.289 ------------------------------------------------------------------------------------ 00:07:40.289 0,0 4288/s 177 MiB/s 0 0 00:07:40.289 3,0 4288/s 177 MiB/s 0 0 00:07:40.289 2,0 4288/s 177 MiB/s 0 0 00:07:40.289 1,0 4288/s 177 MiB/s 0 0 00:07:40.290 ==================================================================================== 00:07:40.290 Total 17152/s 1819 MiB/s 0 0' 00:07:40.290 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.290 17:27:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:40.290 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.290 17:27:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:40.290 17:27:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.290 17:27:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.290 17:27:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.290 17:27:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.290 17:27:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.290 17:27:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.290 17:27:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.290 17:27:17 -- accel/accel.sh@42 -- # jq -r . 00:07:40.290 [2024-11-16 17:27:17.596716] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:40.290 [2024-11-16 17:27:17.596800] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1474852 ] 00:07:40.290 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.290 [2024-11-16 17:27:17.658635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:40.290 [2024-11-16 17:27:17.755738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:40.290 [2024-11-16 17:27:17.755763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:40.290 [2024-11-16 17:27:17.755823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:40.290 [2024-11-16 17:27:17.755826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val= 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val= 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val= 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val=0xf 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val= 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val= 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val=decompress 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val= 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val=software 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@23 -- # accel_module=software 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val=32 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val=32 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val=1 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val=Yes 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val= 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:40.550 17:27:17 -- accel/accel.sh@21 -- # val= 00:07:40.550 17:27:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # IFS=: 00:07:40.550 17:27:17 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@21 -- # val= 00:07:41.956 17:27:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # IFS=: 00:07:41.956 17:27:19 -- accel/accel.sh@20 -- # read -r var val 00:07:41.956 17:27:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:41.956 17:27:19 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:41.956 17:27:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.956 00:07:41.956 real 0m2.850s 00:07:41.956 user 0m9.495s 00:07:41.956 sys 0m0.314s 00:07:41.956 17:27:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.956 17:27:19 -- common/autotest_common.sh@10 -- # set +x 00:07:41.956 ************************************ 00:07:41.956 END TEST accel_decomp_full_mcore 00:07:41.956 ************************************ 00:07:41.956 17:27:19 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.956 17:27:19 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:41.956 17:27:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.956 17:27:19 -- common/autotest_common.sh@10 -- # set +x 00:07:41.956 ************************************ 00:07:41.956 START TEST accel_decomp_mthread 00:07:41.956 ************************************ 00:07:41.956 17:27:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.956 17:27:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.956 17:27:19 -- accel/accel.sh@17 -- # local accel_module 00:07:41.956 17:27:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.956 17:27:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.957 17:27:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.957 17:27:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.957 17:27:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.957 17:27:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.957 17:27:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.957 17:27:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.957 17:27:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.957 17:27:19 -- accel/accel.sh@42 -- # jq -r . 00:07:41.957 [2024-11-16 17:27:19.050143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:41.957 [2024-11-16 17:27:19.050231] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475122 ] 00:07:41.957 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.957 [2024-11-16 17:27:19.110985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.957 [2024-11-16 17:27:19.201612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.340 17:27:20 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:43.340 00:07:43.340 SPDK Configuration: 00:07:43.340 Core mask: 0x1 00:07:43.340 00:07:43.340 Accel Perf Configuration: 00:07:43.340 Workload Type: decompress 00:07:43.340 Transfer size: 4096 bytes 00:07:43.340 Vector count 1 00:07:43.340 Module: software 00:07:43.340 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.340 Queue depth: 32 00:07:43.340 Allocate depth: 32 00:07:43.340 # threads/core: 2 00:07:43.340 Run time: 1 seconds 00:07:43.340 Verify: Yes 00:07:43.340 00:07:43.340 Running for 1 seconds... 00:07:43.340 00:07:43.340 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:43.340 ------------------------------------------------------------------------------------ 00:07:43.340 0,1 28320/s 52 MiB/s 0 0 00:07:43.340 0,0 28192/s 51 MiB/s 0 0 00:07:43.340 ==================================================================================== 00:07:43.340 Total 56512/s 220 MiB/s 0 0' 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.340 17:27:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.340 17:27:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.340 17:27:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.340 17:27:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.340 17:27:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.340 17:27:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.340 17:27:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.340 17:27:20 -- accel/accel.sh@42 -- # jq -r . 00:07:43.340 [2024-11-16 17:27:20.466837] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:43.340 [2024-11-16 17:27:20.466929] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475260 ] 00:07:43.340 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.340 [2024-11-16 17:27:20.528402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.340 [2024-11-16 17:27:20.622049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val= 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val= 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val= 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val=0x1 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val= 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val= 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val=decompress 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val= 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val=software 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@23 -- # accel_module=software 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val=32 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val=32 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val=2 00:07:43.340 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.340 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.340 17:27:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:43.341 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.341 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.341 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.341 17:27:20 -- accel/accel.sh@21 -- # val=Yes 00:07:43.341 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.341 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.341 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.341 17:27:20 -- accel/accel.sh@21 -- # val= 00:07:43.341 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.341 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.341 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:43.341 17:27:20 -- accel/accel.sh@21 -- # val= 00:07:43.341 17:27:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.341 17:27:20 -- accel/accel.sh@20 -- # IFS=: 00:07:43.341 17:27:20 -- accel/accel.sh@20 -- # read -r var val 00:07:44.718 17:27:21 -- accel/accel.sh@21 -- # val= 00:07:44.718 17:27:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # IFS=: 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # read -r var val 00:07:44.718 17:27:21 -- accel/accel.sh@21 -- # val= 00:07:44.718 17:27:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # IFS=: 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # read -r var val 00:07:44.718 17:27:21 -- accel/accel.sh@21 -- # val= 00:07:44.718 17:27:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # IFS=: 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # read -r var val 00:07:44.718 17:27:21 -- accel/accel.sh@21 -- # val= 00:07:44.718 17:27:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # IFS=: 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # read -r var val 00:07:44.718 17:27:21 -- accel/accel.sh@21 -- # val= 00:07:44.718 17:27:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # IFS=: 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # read -r var val 00:07:44.718 17:27:21 -- accel/accel.sh@21 -- # val= 00:07:44.718 17:27:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # IFS=: 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # read -r var val 00:07:44.718 17:27:21 -- accel/accel.sh@21 -- # val= 00:07:44.718 17:27:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # IFS=: 00:07:44.718 17:27:21 -- accel/accel.sh@20 -- # read -r var val 00:07:44.718 17:27:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:44.718 17:27:21 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:44.719 17:27:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.719 00:07:44.719 real 0m2.830s 00:07:44.719 user 0m2.537s 00:07:44.719 sys 0m0.285s 00:07:44.719 17:27:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.719 17:27:21 -- common/autotest_common.sh@10 -- # set +x 00:07:44.719 ************************************ 00:07:44.719 END TEST accel_decomp_mthread 00:07:44.719 ************************************ 00:07:44.719 17:27:21 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.719 17:27:21 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:44.719 17:27:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.719 17:27:21 -- common/autotest_common.sh@10 -- # set +x 00:07:44.719 ************************************ 00:07:44.719 START TEST accel_deomp_full_mthread 00:07:44.719 ************************************ 00:07:44.719 17:27:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.719 17:27:21 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.719 17:27:21 -- accel/accel.sh@17 -- # local accel_module 00:07:44.719 17:27:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.719 17:27:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.719 17:27:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.719 17:27:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.719 17:27:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.719 17:27:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.719 17:27:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.719 17:27:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.719 17:27:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.719 17:27:21 -- accel/accel.sh@42 -- # jq -r . 00:07:44.719 [2024-11-16 17:27:21.905008] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:44.719 [2024-11-16 17:27:21.905093] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475429 ] 00:07:44.719 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.719 [2024-11-16 17:27:21.973030] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.719 [2024-11-16 17:27:22.065969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.171 17:27:23 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:46.171 00:07:46.171 SPDK Configuration: 00:07:46.171 Core mask: 0x1 00:07:46.171 00:07:46.171 Accel Perf Configuration: 00:07:46.171 Workload Type: decompress 00:07:46.171 Transfer size: 111250 bytes 00:07:46.171 Vector count 1 00:07:46.171 Module: software 00:07:46.171 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.171 Queue depth: 32 00:07:46.171 Allocate depth: 32 00:07:46.171 # threads/core: 2 00:07:46.171 Run time: 1 seconds 00:07:46.171 Verify: Yes 00:07:46.171 00:07:46.171 Running for 1 seconds... 00:07:46.171 00:07:46.171 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:46.171 ------------------------------------------------------------------------------------ 00:07:46.171 0,1 1952/s 80 MiB/s 0 0 00:07:46.171 0,0 1920/s 79 MiB/s 0 0 00:07:46.171 ==================================================================================== 00:07:46.171 Total 3872/s 410 MiB/s 0 0' 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:46.171 17:27:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:46.171 17:27:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.171 17:27:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.171 17:27:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.171 17:27:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.171 17:27:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.171 17:27:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.171 17:27:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.171 17:27:23 -- accel/accel.sh@42 -- # jq -r . 00:07:46.171 [2024-11-16 17:27:23.355913] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:46.171 [2024-11-16 17:27:23.356000] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475629 ] 00:07:46.171 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.171 [2024-11-16 17:27:23.416718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.171 [2024-11-16 17:27:23.510323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val= 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val= 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val= 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val=0x1 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val= 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val= 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val=decompress 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val= 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val=software 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@23 -- # accel_module=software 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val=32 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val=32 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val=2 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.171 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.171 17:27:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:46.171 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 17:27:23 -- accel/accel.sh@21 -- # val=Yes 00:07:46.172 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 17:27:23 -- accel/accel.sh@21 -- # val= 00:07:46.172 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:46.172 17:27:23 -- accel/accel.sh@21 -- # val= 00:07:46.172 17:27:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.172 17:27:23 -- accel/accel.sh@20 -- # IFS=: 00:07:46.172 17:27:23 -- accel/accel.sh@20 -- # read -r var val 00:07:47.574 17:27:24 -- accel/accel.sh@21 -- # val= 00:07:47.574 17:27:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # IFS=: 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # read -r var val 00:07:47.574 17:27:24 -- accel/accel.sh@21 -- # val= 00:07:47.574 17:27:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # IFS=: 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # read -r var val 00:07:47.574 17:27:24 -- accel/accel.sh@21 -- # val= 00:07:47.574 17:27:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # IFS=: 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # read -r var val 00:07:47.574 17:27:24 -- accel/accel.sh@21 -- # val= 00:07:47.574 17:27:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # IFS=: 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # read -r var val 00:07:47.574 17:27:24 -- accel/accel.sh@21 -- # val= 00:07:47.574 17:27:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # IFS=: 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # read -r var val 00:07:47.574 17:27:24 -- accel/accel.sh@21 -- # val= 00:07:47.574 17:27:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # IFS=: 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # read -r var val 00:07:47.574 17:27:24 -- accel/accel.sh@21 -- # val= 00:07:47.574 17:27:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # IFS=: 00:07:47.574 17:27:24 -- accel/accel.sh@20 -- # read -r var val 00:07:47.574 17:27:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:47.574 17:27:24 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:47.574 17:27:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:47.574 00:07:47.574 real 0m2.901s 00:07:47.574 user 0m2.600s 00:07:47.574 sys 0m0.293s 00:07:47.574 17:27:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.574 17:27:24 -- common/autotest_common.sh@10 -- # set +x 00:07:47.574 ************************************ 00:07:47.574 END TEST accel_deomp_full_mthread 00:07:47.574 ************************************ 00:07:47.574 17:27:24 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:47.574 17:27:24 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:47.574 17:27:24 -- accel/accel.sh@129 -- # build_accel_config 00:07:47.574 17:27:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:47.574 17:27:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:47.574 17:27:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.574 17:27:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.574 17:27:24 -- common/autotest_common.sh@10 -- # set +x 00:07:47.574 17:27:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.574 17:27:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:47.574 17:27:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:47.574 17:27:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:47.574 17:27:24 -- accel/accel.sh@42 -- # jq -r . 00:07:47.574 ************************************ 00:07:47.574 START TEST accel_dif_functional_tests 00:07:47.574 ************************************ 00:07:47.574 17:27:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:47.574 [2024-11-16 17:27:24.854984] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.574 [2024-11-16 17:27:24.855064] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475849 ] 00:07:47.574 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.574 [2024-11-16 17:27:24.916250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:47.574 [2024-11-16 17:27:25.012440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.574 [2024-11-16 17:27:25.012497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.574 [2024-11-16 17:27:25.012500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.834 00:07:47.834 00:07:47.834 CUnit - A unit testing framework for C - Version 2.1-3 00:07:47.834 http://cunit.sourceforge.net/ 00:07:47.834 00:07:47.834 00:07:47.834 Suite: accel_dif 00:07:47.834 Test: verify: DIF generated, GUARD check ...passed 00:07:47.834 Test: verify: DIF generated, APPTAG check ...passed 00:07:47.834 Test: verify: DIF generated, REFTAG check ...passed 00:07:47.834 Test: verify: DIF not generated, GUARD check ...[2024-11-16 17:27:25.111888] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:47.834 [2024-11-16 17:27:25.111966] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:47.834 passed 00:07:47.834 Test: verify: DIF not generated, APPTAG check ...[2024-11-16 17:27:25.112012] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:47.834 [2024-11-16 17:27:25.112041] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:47.834 passed 00:07:47.834 Test: verify: DIF not generated, REFTAG check ...[2024-11-16 17:27:25.112075] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:47.834 [2024-11-16 17:27:25.112103] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:47.834 passed 00:07:47.834 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:47.834 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-16 17:27:25.112172] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:47.834 passed 00:07:47.834 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:47.834 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:47.834 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:47.834 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-16 17:27:25.112327] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:47.834 passed 00:07:47.834 Test: generate copy: DIF generated, GUARD check ...passed 00:07:47.834 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:47.834 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:47.834 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:47.834 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:47.834 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:47.834 Test: generate copy: iovecs-len validate ...[2024-11-16 17:27:25.112585] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:47.834 passed 00:07:47.834 Test: generate copy: buffer alignment validate ...passed 00:07:47.834 00:07:47.834 Run Summary: Type Total Ran Passed Failed Inactive 00:07:47.834 suites 1 1 n/a 0 0 00:07:47.834 tests 20 20 20 0 0 00:07:47.834 asserts 204 204 204 0 n/a 00:07:47.834 00:07:47.834 Elapsed time = 0.003 seconds 00:07:48.093 00:07:48.093 real 0m0.518s 00:07:48.093 user 0m0.824s 00:07:48.093 sys 0m0.182s 00:07:48.093 17:27:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.093 17:27:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.093 ************************************ 00:07:48.093 END TEST accel_dif_functional_tests 00:07:48.093 ************************************ 00:07:48.093 00:07:48.093 real 0m59.922s 00:07:48.093 user 1m7.712s 00:07:48.093 sys 0m7.251s 00:07:48.093 17:27:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.093 17:27:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.093 ************************************ 00:07:48.093 END TEST accel 00:07:48.093 ************************************ 00:07:48.093 17:27:25 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:48.093 17:27:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:48.093 17:27:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.093 17:27:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.093 ************************************ 00:07:48.093 START TEST accel_rpc 00:07:48.093 ************************************ 00:07:48.093 17:27:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:48.093 * Looking for test storage... 00:07:48.093 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:48.093 17:27:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:48.093 17:27:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:48.093 17:27:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:48.093 17:27:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:48.093 17:27:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:48.093 17:27:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:48.093 17:27:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:48.093 17:27:25 -- scripts/common.sh@335 -- # IFS=.-: 00:07:48.093 17:27:25 -- scripts/common.sh@335 -- # read -ra ver1 00:07:48.093 17:27:25 -- scripts/common.sh@336 -- # IFS=.-: 00:07:48.093 17:27:25 -- scripts/common.sh@336 -- # read -ra ver2 00:07:48.093 17:27:25 -- scripts/common.sh@337 -- # local 'op=<' 00:07:48.093 17:27:25 -- scripts/common.sh@339 -- # ver1_l=2 00:07:48.093 17:27:25 -- scripts/common.sh@340 -- # ver2_l=1 00:07:48.093 17:27:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:48.093 17:27:25 -- scripts/common.sh@343 -- # case "$op" in 00:07:48.093 17:27:25 -- scripts/common.sh@344 -- # : 1 00:07:48.093 17:27:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:48.093 17:27:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:48.093 17:27:25 -- scripts/common.sh@364 -- # decimal 1 00:07:48.093 17:27:25 -- scripts/common.sh@352 -- # local d=1 00:07:48.093 17:27:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:48.093 17:27:25 -- scripts/common.sh@354 -- # echo 1 00:07:48.093 17:27:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:48.093 17:27:25 -- scripts/common.sh@365 -- # decimal 2 00:07:48.093 17:27:25 -- scripts/common.sh@352 -- # local d=2 00:07:48.093 17:27:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:48.093 17:27:25 -- scripts/common.sh@354 -- # echo 2 00:07:48.093 17:27:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:48.093 17:27:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:48.093 17:27:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:48.093 17:27:25 -- scripts/common.sh@367 -- # return 0 00:07:48.093 17:27:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:48.093 17:27:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:48.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.093 --rc genhtml_branch_coverage=1 00:07:48.093 --rc genhtml_function_coverage=1 00:07:48.093 --rc genhtml_legend=1 00:07:48.093 --rc geninfo_all_blocks=1 00:07:48.093 --rc geninfo_unexecuted_blocks=1 00:07:48.093 00:07:48.093 ' 00:07:48.093 17:27:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:48.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.093 --rc genhtml_branch_coverage=1 00:07:48.093 --rc genhtml_function_coverage=1 00:07:48.093 --rc genhtml_legend=1 00:07:48.093 --rc geninfo_all_blocks=1 00:07:48.093 --rc geninfo_unexecuted_blocks=1 00:07:48.093 00:07:48.093 ' 00:07:48.093 17:27:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:48.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.093 --rc genhtml_branch_coverage=1 00:07:48.093 --rc genhtml_function_coverage=1 00:07:48.093 --rc genhtml_legend=1 00:07:48.093 --rc geninfo_all_blocks=1 00:07:48.093 --rc geninfo_unexecuted_blocks=1 00:07:48.093 00:07:48.093 ' 00:07:48.093 17:27:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:48.093 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.093 --rc genhtml_branch_coverage=1 00:07:48.093 --rc genhtml_function_coverage=1 00:07:48.093 --rc genhtml_legend=1 00:07:48.093 --rc geninfo_all_blocks=1 00:07:48.093 --rc geninfo_unexecuted_blocks=1 00:07:48.093 00:07:48.093 ' 00:07:48.093 17:27:25 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:48.093 17:27:25 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1475931 00:07:48.093 17:27:25 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:48.093 17:27:25 -- accel/accel_rpc.sh@15 -- # waitforlisten 1475931 00:07:48.093 17:27:25 -- common/autotest_common.sh@829 -- # '[' -z 1475931 ']' 00:07:48.093 17:27:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.093 17:27:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:48.093 17:27:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.093 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.093 17:27:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:48.093 17:27:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.093 [2024-11-16 17:27:25.563389] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:48.093 [2024-11-16 17:27:25.563485] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1475931 ] 00:07:48.351 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.351 [2024-11-16 17:27:25.628394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.351 [2024-11-16 17:27:25.717897] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:48.351 [2024-11-16 17:27:25.718080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.351 17:27:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:48.351 17:27:25 -- common/autotest_common.sh@862 -- # return 0 00:07:48.351 17:27:25 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:48.351 17:27:25 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:48.351 17:27:25 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:48.351 17:27:25 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:48.351 17:27:25 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:48.351 17:27:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:48.351 17:27:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.351 17:27:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.351 ************************************ 00:07:48.351 START TEST accel_assign_opcode 00:07:48.351 ************************************ 00:07:48.351 17:27:25 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:48.351 17:27:25 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:48.351 17:27:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.351 17:27:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.352 [2024-11-16 17:27:25.786680] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:48.352 17:27:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.352 17:27:25 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:48.352 17:27:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.352 17:27:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.352 [2024-11-16 17:27:25.794695] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:48.352 17:27:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.352 17:27:25 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:48.352 17:27:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.352 17:27:25 -- common/autotest_common.sh@10 -- # set +x 00:07:48.610 17:27:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.610 17:27:26 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:48.610 17:27:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.610 17:27:26 -- common/autotest_common.sh@10 -- # set +x 00:07:48.610 17:27:26 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:48.610 17:27:26 -- accel/accel_rpc.sh@42 -- # grep software 00:07:48.610 17:27:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.610 software 00:07:48.610 00:07:48.610 real 0m0.294s 00:07:48.610 user 0m0.036s 00:07:48.610 sys 0m0.009s 00:07:48.610 17:27:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.610 17:27:26 -- common/autotest_common.sh@10 -- # set +x 00:07:48.610 ************************************ 00:07:48.610 END TEST accel_assign_opcode 00:07:48.610 ************************************ 00:07:48.610 17:27:26 -- accel/accel_rpc.sh@55 -- # killprocess 1475931 00:07:48.610 17:27:26 -- common/autotest_common.sh@936 -- # '[' -z 1475931 ']' 00:07:48.610 17:27:26 -- common/autotest_common.sh@940 -- # kill -0 1475931 00:07:48.610 17:27:26 -- common/autotest_common.sh@941 -- # uname 00:07:48.610 17:27:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:48.610 17:27:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1475931 00:07:48.870 17:27:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:48.870 17:27:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:48.870 17:27:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1475931' 00:07:48.870 killing process with pid 1475931 00:07:48.870 17:27:26 -- common/autotest_common.sh@955 -- # kill 1475931 00:07:48.870 17:27:26 -- common/autotest_common.sh@960 -- # wait 1475931 00:07:49.129 00:07:49.129 real 0m1.173s 00:07:49.129 user 0m1.090s 00:07:49.129 sys 0m0.447s 00:07:49.129 17:27:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:49.129 17:27:26 -- common/autotest_common.sh@10 -- # set +x 00:07:49.129 ************************************ 00:07:49.129 END TEST accel_rpc 00:07:49.129 ************************************ 00:07:49.129 17:27:26 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:49.129 17:27:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:49.129 17:27:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.129 17:27:26 -- common/autotest_common.sh@10 -- # set +x 00:07:49.129 ************************************ 00:07:49.129 START TEST app_cmdline 00:07:49.129 ************************************ 00:07:49.129 17:27:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:49.389 * Looking for test storage... 00:07:49.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:49.389 17:27:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:49.389 17:27:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:49.389 17:27:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:49.389 17:27:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:49.389 17:27:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:49.389 17:27:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:49.389 17:27:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:49.389 17:27:26 -- scripts/common.sh@335 -- # IFS=.-: 00:07:49.389 17:27:26 -- scripts/common.sh@335 -- # read -ra ver1 00:07:49.389 17:27:26 -- scripts/common.sh@336 -- # IFS=.-: 00:07:49.389 17:27:26 -- scripts/common.sh@336 -- # read -ra ver2 00:07:49.389 17:27:26 -- scripts/common.sh@337 -- # local 'op=<' 00:07:49.389 17:27:26 -- scripts/common.sh@339 -- # ver1_l=2 00:07:49.389 17:27:26 -- scripts/common.sh@340 -- # ver2_l=1 00:07:49.389 17:27:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:49.389 17:27:26 -- scripts/common.sh@343 -- # case "$op" in 00:07:49.389 17:27:26 -- scripts/common.sh@344 -- # : 1 00:07:49.389 17:27:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:49.389 17:27:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:49.389 17:27:26 -- scripts/common.sh@364 -- # decimal 1 00:07:49.389 17:27:26 -- scripts/common.sh@352 -- # local d=1 00:07:49.389 17:27:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:49.389 17:27:26 -- scripts/common.sh@354 -- # echo 1 00:07:49.389 17:27:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:49.389 17:27:26 -- scripts/common.sh@365 -- # decimal 2 00:07:49.389 17:27:26 -- scripts/common.sh@352 -- # local d=2 00:07:49.389 17:27:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:49.389 17:27:26 -- scripts/common.sh@354 -- # echo 2 00:07:49.389 17:27:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:49.389 17:27:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:49.389 17:27:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:49.389 17:27:26 -- scripts/common.sh@367 -- # return 0 00:07:49.389 17:27:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:49.389 17:27:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:49.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.389 --rc genhtml_branch_coverage=1 00:07:49.389 --rc genhtml_function_coverage=1 00:07:49.389 --rc genhtml_legend=1 00:07:49.389 --rc geninfo_all_blocks=1 00:07:49.389 --rc geninfo_unexecuted_blocks=1 00:07:49.389 00:07:49.389 ' 00:07:49.389 17:27:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:49.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.389 --rc genhtml_branch_coverage=1 00:07:49.389 --rc genhtml_function_coverage=1 00:07:49.389 --rc genhtml_legend=1 00:07:49.389 --rc geninfo_all_blocks=1 00:07:49.389 --rc geninfo_unexecuted_blocks=1 00:07:49.389 00:07:49.389 ' 00:07:49.389 17:27:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:49.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.389 --rc genhtml_branch_coverage=1 00:07:49.389 --rc genhtml_function_coverage=1 00:07:49.389 --rc genhtml_legend=1 00:07:49.389 --rc geninfo_all_blocks=1 00:07:49.389 --rc geninfo_unexecuted_blocks=1 00:07:49.389 00:07:49.389 ' 00:07:49.389 17:27:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:49.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.389 --rc genhtml_branch_coverage=1 00:07:49.389 --rc genhtml_function_coverage=1 00:07:49.389 --rc genhtml_legend=1 00:07:49.389 --rc geninfo_all_blocks=1 00:07:49.389 --rc geninfo_unexecuted_blocks=1 00:07:49.389 00:07:49.389 ' 00:07:49.389 17:27:26 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:49.389 17:27:26 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1476220 00:07:49.389 17:27:26 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:49.389 17:27:26 -- app/cmdline.sh@18 -- # waitforlisten 1476220 00:07:49.389 17:27:26 -- common/autotest_common.sh@829 -- # '[' -z 1476220 ']' 00:07:49.389 17:27:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:49.389 17:27:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:49.389 17:27:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:49.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:49.389 17:27:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:49.389 17:27:26 -- common/autotest_common.sh@10 -- # set +x 00:07:49.389 [2024-11-16 17:27:26.776292] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:49.389 [2024-11-16 17:27:26.776378] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1476220 ] 00:07:49.389 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.389 [2024-11-16 17:27:26.838153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:49.649 [2024-11-16 17:27:26.931711] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:49.649 [2024-11-16 17:27:26.931886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.586 17:27:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:50.586 17:27:27 -- common/autotest_common.sh@862 -- # return 0 00:07:50.586 17:27:27 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:50.586 { 00:07:50.586 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:50.586 "fields": { 00:07:50.586 "major": 24, 00:07:50.586 "minor": 1, 00:07:50.586 "patch": 1, 00:07:50.586 "suffix": "-pre", 00:07:50.586 "commit": "c13c99a5e" 00:07:50.586 } 00:07:50.586 } 00:07:50.586 17:27:28 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:50.586 17:27:28 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:50.586 17:27:28 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:50.586 17:27:28 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:50.586 17:27:28 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:50.586 17:27:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.586 17:27:28 -- common/autotest_common.sh@10 -- # set +x 00:07:50.586 17:27:28 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:50.586 17:27:28 -- app/cmdline.sh@26 -- # sort 00:07:50.586 17:27:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.586 17:27:28 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:50.586 17:27:28 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:50.586 17:27:28 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.586 17:27:28 -- common/autotest_common.sh@650 -- # local es=0 00:07:50.586 17:27:28 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.586 17:27:28 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.586 17:27:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.586 17:27:28 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.586 17:27:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.586 17:27:28 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.586 17:27:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.586 17:27:28 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.586 17:27:28 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:50.586 17:27:28 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.844 request: 00:07:50.844 { 00:07:50.844 "method": "env_dpdk_get_mem_stats", 00:07:50.844 "req_id": 1 00:07:50.844 } 00:07:50.844 Got JSON-RPC error response 00:07:50.844 response: 00:07:50.844 { 00:07:50.844 "code": -32601, 00:07:50.844 "message": "Method not found" 00:07:50.844 } 00:07:50.844 17:27:28 -- common/autotest_common.sh@653 -- # es=1 00:07:50.844 17:27:28 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:50.844 17:27:28 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:50.844 17:27:28 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:50.844 17:27:28 -- app/cmdline.sh@1 -- # killprocess 1476220 00:07:50.844 17:27:28 -- common/autotest_common.sh@936 -- # '[' -z 1476220 ']' 00:07:50.844 17:27:28 -- common/autotest_common.sh@940 -- # kill -0 1476220 00:07:50.844 17:27:28 -- common/autotest_common.sh@941 -- # uname 00:07:50.844 17:27:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:50.844 17:27:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1476220 00:07:51.103 17:27:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:51.103 17:27:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:51.104 17:27:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1476220' 00:07:51.104 killing process with pid 1476220 00:07:51.104 17:27:28 -- common/autotest_common.sh@955 -- # kill 1476220 00:07:51.104 17:27:28 -- common/autotest_common.sh@960 -- # wait 1476220 00:07:51.362 00:07:51.362 real 0m2.201s 00:07:51.362 user 0m2.754s 00:07:51.362 sys 0m0.543s 00:07:51.362 17:27:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:51.362 17:27:28 -- common/autotest_common.sh@10 -- # set +x 00:07:51.362 ************************************ 00:07:51.362 END TEST app_cmdline 00:07:51.362 ************************************ 00:07:51.362 17:27:28 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:51.362 17:27:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:51.362 17:27:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.362 17:27:28 -- common/autotest_common.sh@10 -- # set +x 00:07:51.362 ************************************ 00:07:51.362 START TEST version 00:07:51.362 ************************************ 00:07:51.362 17:27:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:51.362 * Looking for test storage... 00:07:51.621 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:51.621 17:27:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.621 17:27:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.621 17:27:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:51.621 17:27:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:51.621 17:27:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:51.621 17:27:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:51.621 17:27:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:51.621 17:27:28 -- scripts/common.sh@335 -- # IFS=.-: 00:07:51.621 17:27:28 -- scripts/common.sh@335 -- # read -ra ver1 00:07:51.621 17:27:28 -- scripts/common.sh@336 -- # IFS=.-: 00:07:51.621 17:27:28 -- scripts/common.sh@336 -- # read -ra ver2 00:07:51.621 17:27:28 -- scripts/common.sh@337 -- # local 'op=<' 00:07:51.621 17:27:28 -- scripts/common.sh@339 -- # ver1_l=2 00:07:51.621 17:27:28 -- scripts/common.sh@340 -- # ver2_l=1 00:07:51.621 17:27:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:51.621 17:27:28 -- scripts/common.sh@343 -- # case "$op" in 00:07:51.621 17:27:28 -- scripts/common.sh@344 -- # : 1 00:07:51.621 17:27:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:51.621 17:27:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:51.621 17:27:28 -- scripts/common.sh@364 -- # decimal 1 00:07:51.621 17:27:28 -- scripts/common.sh@352 -- # local d=1 00:07:51.621 17:27:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:51.621 17:27:28 -- scripts/common.sh@354 -- # echo 1 00:07:51.621 17:27:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:51.621 17:27:28 -- scripts/common.sh@365 -- # decimal 2 00:07:51.621 17:27:28 -- scripts/common.sh@352 -- # local d=2 00:07:51.621 17:27:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:51.621 17:27:28 -- scripts/common.sh@354 -- # echo 2 00:07:51.621 17:27:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:51.621 17:27:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:51.621 17:27:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:51.621 17:27:28 -- scripts/common.sh@367 -- # return 0 00:07:51.621 17:27:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:51.621 17:27:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:51.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.621 --rc genhtml_branch_coverage=1 00:07:51.621 --rc genhtml_function_coverage=1 00:07:51.621 --rc genhtml_legend=1 00:07:51.621 --rc geninfo_all_blocks=1 00:07:51.621 --rc geninfo_unexecuted_blocks=1 00:07:51.621 00:07:51.621 ' 00:07:51.621 17:27:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:51.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.621 --rc genhtml_branch_coverage=1 00:07:51.621 --rc genhtml_function_coverage=1 00:07:51.621 --rc genhtml_legend=1 00:07:51.621 --rc geninfo_all_blocks=1 00:07:51.621 --rc geninfo_unexecuted_blocks=1 00:07:51.621 00:07:51.621 ' 00:07:51.621 17:27:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:51.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.621 --rc genhtml_branch_coverage=1 00:07:51.621 --rc genhtml_function_coverage=1 00:07:51.621 --rc genhtml_legend=1 00:07:51.621 --rc geninfo_all_blocks=1 00:07:51.621 --rc geninfo_unexecuted_blocks=1 00:07:51.621 00:07:51.621 ' 00:07:51.621 17:27:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:51.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.621 --rc genhtml_branch_coverage=1 00:07:51.621 --rc genhtml_function_coverage=1 00:07:51.621 --rc genhtml_legend=1 00:07:51.621 --rc geninfo_all_blocks=1 00:07:51.621 --rc geninfo_unexecuted_blocks=1 00:07:51.621 00:07:51.621 ' 00:07:51.621 17:27:28 -- app/version.sh@17 -- # get_header_version major 00:07:51.621 17:27:28 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.621 17:27:28 -- app/version.sh@14 -- # cut -f2 00:07:51.621 17:27:28 -- app/version.sh@14 -- # tr -d '"' 00:07:51.621 17:27:28 -- app/version.sh@17 -- # major=24 00:07:51.621 17:27:28 -- app/version.sh@18 -- # get_header_version minor 00:07:51.621 17:27:28 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.621 17:27:28 -- app/version.sh@14 -- # cut -f2 00:07:51.621 17:27:28 -- app/version.sh@14 -- # tr -d '"' 00:07:51.621 17:27:28 -- app/version.sh@18 -- # minor=1 00:07:51.621 17:27:28 -- app/version.sh@19 -- # get_header_version patch 00:07:51.621 17:27:28 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.621 17:27:28 -- app/version.sh@14 -- # cut -f2 00:07:51.621 17:27:28 -- app/version.sh@14 -- # tr -d '"' 00:07:51.621 17:27:28 -- app/version.sh@19 -- # patch=1 00:07:51.621 17:27:28 -- app/version.sh@20 -- # get_header_version suffix 00:07:51.621 17:27:28 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.621 17:27:28 -- app/version.sh@14 -- # cut -f2 00:07:51.621 17:27:28 -- app/version.sh@14 -- # tr -d '"' 00:07:51.621 17:27:28 -- app/version.sh@20 -- # suffix=-pre 00:07:51.621 17:27:28 -- app/version.sh@22 -- # version=24.1 00:07:51.621 17:27:28 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:51.621 17:27:28 -- app/version.sh@25 -- # version=24.1.1 00:07:51.621 17:27:28 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:51.621 17:27:28 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:51.621 17:27:28 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:51.621 17:27:28 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:51.621 17:27:28 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:51.621 00:07:51.621 real 0m0.187s 00:07:51.621 user 0m0.125s 00:07:51.621 sys 0m0.086s 00:07:51.622 17:27:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:51.622 17:27:28 -- common/autotest_common.sh@10 -- # set +x 00:07:51.622 ************************************ 00:07:51.622 END TEST version 00:07:51.622 ************************************ 00:07:51.622 17:27:29 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:51.622 17:27:29 -- spdk/autotest.sh@191 -- # uname -s 00:07:51.622 17:27:29 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:51.622 17:27:29 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:51.622 17:27:29 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:51.622 17:27:29 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:51.622 17:27:29 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:51.622 17:27:29 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:51.622 17:27:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:51.622 17:27:29 -- common/autotest_common.sh@10 -- # set +x 00:07:51.622 17:27:29 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:51.622 17:27:29 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:51.622 17:27:29 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:51.622 17:27:29 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:51.622 17:27:29 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:51.622 17:27:29 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:51.622 17:27:29 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:51.622 17:27:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:51.622 17:27:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.622 17:27:29 -- common/autotest_common.sh@10 -- # set +x 00:07:51.622 ************************************ 00:07:51.622 START TEST nvmf_tcp 00:07:51.622 ************************************ 00:07:51.622 17:27:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:51.622 * Looking for test storage... 00:07:51.622 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:51.622 17:27:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.622 17:27:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.622 17:27:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:51.893 17:27:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:51.893 17:27:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:51.893 17:27:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:51.893 17:27:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:51.893 17:27:29 -- scripts/common.sh@335 -- # IFS=.-: 00:07:51.893 17:27:29 -- scripts/common.sh@335 -- # read -ra ver1 00:07:51.893 17:27:29 -- scripts/common.sh@336 -- # IFS=.-: 00:07:51.893 17:27:29 -- scripts/common.sh@336 -- # read -ra ver2 00:07:51.893 17:27:29 -- scripts/common.sh@337 -- # local 'op=<' 00:07:51.893 17:27:29 -- scripts/common.sh@339 -- # ver1_l=2 00:07:51.893 17:27:29 -- scripts/common.sh@340 -- # ver2_l=1 00:07:51.893 17:27:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:51.893 17:27:29 -- scripts/common.sh@343 -- # case "$op" in 00:07:51.893 17:27:29 -- scripts/common.sh@344 -- # : 1 00:07:51.893 17:27:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:51.893 17:27:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:51.893 17:27:29 -- scripts/common.sh@364 -- # decimal 1 00:07:51.893 17:27:29 -- scripts/common.sh@352 -- # local d=1 00:07:51.893 17:27:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:51.893 17:27:29 -- scripts/common.sh@354 -- # echo 1 00:07:51.893 17:27:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:51.893 17:27:29 -- scripts/common.sh@365 -- # decimal 2 00:07:51.893 17:27:29 -- scripts/common.sh@352 -- # local d=2 00:07:51.893 17:27:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:51.893 17:27:29 -- scripts/common.sh@354 -- # echo 2 00:07:51.893 17:27:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:51.893 17:27:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:51.893 17:27:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:51.893 17:27:29 -- scripts/common.sh@367 -- # return 0 00:07:51.893 17:27:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:51.893 17:27:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:51.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.893 --rc genhtml_branch_coverage=1 00:07:51.893 --rc genhtml_function_coverage=1 00:07:51.893 --rc genhtml_legend=1 00:07:51.893 --rc geninfo_all_blocks=1 00:07:51.893 --rc geninfo_unexecuted_blocks=1 00:07:51.893 00:07:51.893 ' 00:07:51.893 17:27:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:51.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.893 --rc genhtml_branch_coverage=1 00:07:51.893 --rc genhtml_function_coverage=1 00:07:51.893 --rc genhtml_legend=1 00:07:51.893 --rc geninfo_all_blocks=1 00:07:51.893 --rc geninfo_unexecuted_blocks=1 00:07:51.893 00:07:51.893 ' 00:07:51.893 17:27:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:51.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.893 --rc genhtml_branch_coverage=1 00:07:51.893 --rc genhtml_function_coverage=1 00:07:51.893 --rc genhtml_legend=1 00:07:51.893 --rc geninfo_all_blocks=1 00:07:51.893 --rc geninfo_unexecuted_blocks=1 00:07:51.893 00:07:51.893 ' 00:07:51.893 17:27:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:51.893 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.893 --rc genhtml_branch_coverage=1 00:07:51.893 --rc genhtml_function_coverage=1 00:07:51.893 --rc genhtml_legend=1 00:07:51.893 --rc geninfo_all_blocks=1 00:07:51.893 --rc geninfo_unexecuted_blocks=1 00:07:51.893 00:07:51.893 ' 00:07:51.893 17:27:29 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:51.893 17:27:29 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:51.894 17:27:29 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:51.894 17:27:29 -- nvmf/common.sh@7 -- # uname -s 00:07:51.894 17:27:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:51.894 17:27:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:51.894 17:27:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:51.894 17:27:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:51.894 17:27:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:51.894 17:27:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:51.894 17:27:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:51.894 17:27:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:51.894 17:27:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:51.894 17:27:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:51.894 17:27:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.894 17:27:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.894 17:27:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:51.894 17:27:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:51.894 17:27:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:51.894 17:27:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:51.894 17:27:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:51.894 17:27:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:51.894 17:27:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:51.894 17:27:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.894 17:27:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.894 17:27:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.894 17:27:29 -- paths/export.sh@5 -- # export PATH 00:07:51.894 17:27:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.894 17:27:29 -- nvmf/common.sh@46 -- # : 0 00:07:51.894 17:27:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:51.894 17:27:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:51.894 17:27:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:51.894 17:27:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:51.894 17:27:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:51.894 17:27:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:51.894 17:27:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:51.894 17:27:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:51.894 17:27:29 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:51.894 17:27:29 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:51.894 17:27:29 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:51.894 17:27:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:51.894 17:27:29 -- common/autotest_common.sh@10 -- # set +x 00:07:51.894 17:27:29 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:51.894 17:27:29 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:51.894 17:27:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:51.894 17:27:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.894 17:27:29 -- common/autotest_common.sh@10 -- # set +x 00:07:51.894 ************************************ 00:07:51.894 START TEST nvmf_example 00:07:51.894 ************************************ 00:07:51.894 17:27:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:51.894 * Looking for test storage... 00:07:51.894 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:51.894 17:27:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.894 17:27:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.894 17:27:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:51.894 17:27:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:51.894 17:27:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:51.894 17:27:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:51.894 17:27:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:51.894 17:27:29 -- scripts/common.sh@335 -- # IFS=.-: 00:07:51.894 17:27:29 -- scripts/common.sh@335 -- # read -ra ver1 00:07:51.894 17:27:29 -- scripts/common.sh@336 -- # IFS=.-: 00:07:51.894 17:27:29 -- scripts/common.sh@336 -- # read -ra ver2 00:07:51.894 17:27:29 -- scripts/common.sh@337 -- # local 'op=<' 00:07:51.894 17:27:29 -- scripts/common.sh@339 -- # ver1_l=2 00:07:51.894 17:27:29 -- scripts/common.sh@340 -- # ver2_l=1 00:07:51.894 17:27:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:51.894 17:27:29 -- scripts/common.sh@343 -- # case "$op" in 00:07:51.894 17:27:29 -- scripts/common.sh@344 -- # : 1 00:07:51.894 17:27:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:51.894 17:27:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:51.894 17:27:29 -- scripts/common.sh@364 -- # decimal 1 00:07:51.894 17:27:29 -- scripts/common.sh@352 -- # local d=1 00:07:51.894 17:27:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:51.894 17:27:29 -- scripts/common.sh@354 -- # echo 1 00:07:51.894 17:27:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:51.894 17:27:29 -- scripts/common.sh@365 -- # decimal 2 00:07:51.894 17:27:29 -- scripts/common.sh@352 -- # local d=2 00:07:51.894 17:27:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:51.894 17:27:29 -- scripts/common.sh@354 -- # echo 2 00:07:51.894 17:27:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:51.894 17:27:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:51.894 17:27:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:51.894 17:27:29 -- scripts/common.sh@367 -- # return 0 00:07:51.894 17:27:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:51.894 17:27:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:51.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.894 --rc genhtml_branch_coverage=1 00:07:51.894 --rc genhtml_function_coverage=1 00:07:51.894 --rc genhtml_legend=1 00:07:51.894 --rc geninfo_all_blocks=1 00:07:51.894 --rc geninfo_unexecuted_blocks=1 00:07:51.894 00:07:51.894 ' 00:07:51.894 17:27:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:51.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.894 --rc genhtml_branch_coverage=1 00:07:51.894 --rc genhtml_function_coverage=1 00:07:51.894 --rc genhtml_legend=1 00:07:51.894 --rc geninfo_all_blocks=1 00:07:51.894 --rc geninfo_unexecuted_blocks=1 00:07:51.894 00:07:51.894 ' 00:07:51.894 17:27:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:51.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.894 --rc genhtml_branch_coverage=1 00:07:51.894 --rc genhtml_function_coverage=1 00:07:51.894 --rc genhtml_legend=1 00:07:51.894 --rc geninfo_all_blocks=1 00:07:51.894 --rc geninfo_unexecuted_blocks=1 00:07:51.894 00:07:51.894 ' 00:07:51.894 17:27:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:51.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.894 --rc genhtml_branch_coverage=1 00:07:51.894 --rc genhtml_function_coverage=1 00:07:51.894 --rc genhtml_legend=1 00:07:51.894 --rc geninfo_all_blocks=1 00:07:51.894 --rc geninfo_unexecuted_blocks=1 00:07:51.894 00:07:51.894 ' 00:07:51.894 17:27:29 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:51.894 17:27:29 -- nvmf/common.sh@7 -- # uname -s 00:07:51.894 17:27:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:51.894 17:27:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:51.894 17:27:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:51.894 17:27:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:51.894 17:27:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:51.894 17:27:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:51.894 17:27:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:51.894 17:27:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:51.894 17:27:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:51.894 17:27:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:51.894 17:27:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.894 17:27:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.894 17:27:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:51.894 17:27:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:51.894 17:27:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:51.894 17:27:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:51.894 17:27:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:51.894 17:27:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:51.894 17:27:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:51.894 17:27:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.894 17:27:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.894 17:27:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.894 17:27:29 -- paths/export.sh@5 -- # export PATH 00:07:51.894 17:27:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.894 17:27:29 -- nvmf/common.sh@46 -- # : 0 00:07:51.894 17:27:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:51.894 17:27:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:51.894 17:27:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:51.894 17:27:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:51.894 17:27:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:51.894 17:27:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:51.894 17:27:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:51.894 17:27:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:51.894 17:27:29 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:51.894 17:27:29 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:51.894 17:27:29 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:51.894 17:27:29 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:51.894 17:27:29 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:51.894 17:27:29 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:51.894 17:27:29 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:51.894 17:27:29 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:51.894 17:27:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:51.894 17:27:29 -- common/autotest_common.sh@10 -- # set +x 00:07:51.894 17:27:29 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:51.894 17:27:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:51.894 17:27:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:51.894 17:27:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:51.894 17:27:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:51.894 17:27:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:51.894 17:27:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:51.894 17:27:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:51.894 17:27:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:51.894 17:27:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:51.894 17:27:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:51.894 17:27:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:51.894 17:27:29 -- common/autotest_common.sh@10 -- # set +x 00:07:54.429 17:27:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:54.429 17:27:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:54.429 17:27:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:54.429 17:27:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:54.429 17:27:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:54.429 17:27:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:54.429 17:27:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:54.429 17:27:31 -- nvmf/common.sh@294 -- # net_devs=() 00:07:54.429 17:27:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:54.429 17:27:31 -- nvmf/common.sh@295 -- # e810=() 00:07:54.429 17:27:31 -- nvmf/common.sh@295 -- # local -ga e810 00:07:54.429 17:27:31 -- nvmf/common.sh@296 -- # x722=() 00:07:54.429 17:27:31 -- nvmf/common.sh@296 -- # local -ga x722 00:07:54.429 17:27:31 -- nvmf/common.sh@297 -- # mlx=() 00:07:54.429 17:27:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:54.429 17:27:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:54.429 17:27:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:54.429 17:27:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:54.429 17:27:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:54.429 17:27:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:54.429 17:27:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:54.429 17:27:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:54.429 17:27:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.429 17:27:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:54.429 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:54.429 17:27:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.429 17:27:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.429 17:27:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.430 17:27:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:54.430 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:54.430 17:27:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:54.430 17:27:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.430 17:27:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.430 17:27:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.430 17:27:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.430 17:27:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:54.430 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:54.430 17:27:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.430 17:27:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.430 17:27:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.430 17:27:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.430 17:27:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.430 17:27:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:54.430 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:54.430 17:27:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.430 17:27:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:54.430 17:27:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:54.430 17:27:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:54.430 17:27:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:54.430 17:27:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:54.430 17:27:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:54.430 17:27:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:54.430 17:27:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:54.430 17:27:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:54.430 17:27:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:54.430 17:27:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:54.430 17:27:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:54.430 17:27:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:54.430 17:27:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:54.430 17:27:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:54.430 17:27:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:54.430 17:27:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:54.430 17:27:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:54.430 17:27:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:54.430 17:27:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:54.430 17:27:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:54.430 17:27:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:54.430 17:27:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:54.430 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:54.430 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:07:54.430 00:07:54.430 --- 10.0.0.2 ping statistics --- 00:07:54.430 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.430 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:07:54.430 17:27:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:54.430 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:54.430 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:07:54.430 00:07:54.430 --- 10.0.0.1 ping statistics --- 00:07:54.430 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.430 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:07:54.430 17:27:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:54.430 17:27:31 -- nvmf/common.sh@410 -- # return 0 00:07:54.430 17:27:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:54.430 17:27:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:54.430 17:27:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:54.430 17:27:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:54.430 17:27:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:54.430 17:27:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:54.430 17:27:31 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:54.430 17:27:31 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:54.430 17:27:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:54.430 17:27:31 -- common/autotest_common.sh@10 -- # set +x 00:07:54.430 17:27:31 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:54.430 17:27:31 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:54.430 17:27:31 -- target/nvmf_example.sh@34 -- # nvmfpid=1478342 00:07:54.430 17:27:31 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:54.430 17:27:31 -- target/nvmf_example.sh@36 -- # waitforlisten 1478342 00:07:54.430 17:27:31 -- common/autotest_common.sh@829 -- # '[' -z 1478342 ']' 00:07:54.430 17:27:31 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:54.430 17:27:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:54.430 17:27:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:54.430 17:27:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:54.430 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:54.430 17:27:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:54.430 17:27:31 -- common/autotest_common.sh@10 -- # set +x 00:07:54.430 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.368 17:27:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:55.368 17:27:32 -- common/autotest_common.sh@862 -- # return 0 00:07:55.368 17:27:32 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:55.368 17:27:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:55.368 17:27:32 -- common/autotest_common.sh@10 -- # set +x 00:07:55.368 17:27:32 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:55.368 17:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.368 17:27:32 -- common/autotest_common.sh@10 -- # set +x 00:07:55.368 17:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.368 17:27:32 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:55.368 17:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.368 17:27:32 -- common/autotest_common.sh@10 -- # set +x 00:07:55.368 17:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.368 17:27:32 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:55.368 17:27:32 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:55.368 17:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.368 17:27:32 -- common/autotest_common.sh@10 -- # set +x 00:07:55.368 17:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.368 17:27:32 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:55.368 17:27:32 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:55.368 17:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.368 17:27:32 -- common/autotest_common.sh@10 -- # set +x 00:07:55.368 17:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.368 17:27:32 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:55.368 17:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:55.368 17:27:32 -- common/autotest_common.sh@10 -- # set +x 00:07:55.368 17:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:55.368 17:27:32 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:55.368 17:27:32 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:55.368 EAL: No free 2048 kB hugepages reported on node 1 00:08:05.353 Initializing NVMe Controllers 00:08:05.353 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:05.353 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:05.353 Initialization complete. Launching workers. 00:08:05.353 ======================================================== 00:08:05.353 Latency(us) 00:08:05.354 Device Information : IOPS MiB/s Average min max 00:08:05.354 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15362.86 60.01 4165.63 590.10 45040.29 00:08:05.354 ======================================================== 00:08:05.354 Total : 15362.86 60.01 4165.63 590.10 45040.29 00:08:05.354 00:08:05.354 17:27:42 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:05.354 17:27:42 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:05.354 17:27:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:05.354 17:27:42 -- nvmf/common.sh@116 -- # sync 00:08:05.354 17:27:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:05.354 17:27:42 -- nvmf/common.sh@119 -- # set +e 00:08:05.354 17:27:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:05.354 17:27:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:05.354 rmmod nvme_tcp 00:08:05.354 rmmod nvme_fabrics 00:08:05.354 rmmod nvme_keyring 00:08:05.354 17:27:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:05.354 17:27:42 -- nvmf/common.sh@123 -- # set -e 00:08:05.354 17:27:42 -- nvmf/common.sh@124 -- # return 0 00:08:05.354 17:27:42 -- nvmf/common.sh@477 -- # '[' -n 1478342 ']' 00:08:05.354 17:27:42 -- nvmf/common.sh@478 -- # killprocess 1478342 00:08:05.354 17:27:42 -- common/autotest_common.sh@936 -- # '[' -z 1478342 ']' 00:08:05.354 17:27:42 -- common/autotest_common.sh@940 -- # kill -0 1478342 00:08:05.354 17:27:42 -- common/autotest_common.sh@941 -- # uname 00:08:05.354 17:27:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:05.354 17:27:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1478342 00:08:05.613 17:27:42 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:05.613 17:27:42 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:05.613 17:27:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1478342' 00:08:05.613 killing process with pid 1478342 00:08:05.613 17:27:42 -- common/autotest_common.sh@955 -- # kill 1478342 00:08:05.613 17:27:42 -- common/autotest_common.sh@960 -- # wait 1478342 00:08:05.613 nvmf threads initialize successfully 00:08:05.613 bdev subsystem init successfully 00:08:05.613 created a nvmf target service 00:08:05.613 create targets's poll groups done 00:08:05.613 all subsystems of target started 00:08:05.613 nvmf target is running 00:08:05.613 all subsystems of target stopped 00:08:05.613 destroy targets's poll groups done 00:08:05.613 destroyed the nvmf target service 00:08:05.613 bdev subsystem finish successfully 00:08:05.613 nvmf threads destroy successfully 00:08:05.613 17:27:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:05.613 17:27:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:05.613 17:27:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:05.613 17:27:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:05.613 17:27:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:05.613 17:27:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:05.613 17:27:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:05.614 17:27:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:08.153 17:27:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:08.153 17:27:45 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:08.153 17:27:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:08.153 17:27:45 -- common/autotest_common.sh@10 -- # set +x 00:08:08.153 00:08:08.153 real 0m15.926s 00:08:08.153 user 0m44.989s 00:08:08.153 sys 0m3.323s 00:08:08.153 17:27:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:08.154 17:27:45 -- common/autotest_common.sh@10 -- # set +x 00:08:08.154 ************************************ 00:08:08.154 END TEST nvmf_example 00:08:08.154 ************************************ 00:08:08.154 17:27:45 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:08.154 17:27:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:08.154 17:27:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:08.154 17:27:45 -- common/autotest_common.sh@10 -- # set +x 00:08:08.154 ************************************ 00:08:08.154 START TEST nvmf_filesystem 00:08:08.154 ************************************ 00:08:08.154 17:27:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:08.154 * Looking for test storage... 00:08:08.154 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.154 17:27:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:08.154 17:27:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:08.154 17:27:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:08.154 17:27:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:08.154 17:27:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:08.154 17:27:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:08.154 17:27:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:08.154 17:27:45 -- scripts/common.sh@335 -- # IFS=.-: 00:08:08.154 17:27:45 -- scripts/common.sh@335 -- # read -ra ver1 00:08:08.154 17:27:45 -- scripts/common.sh@336 -- # IFS=.-: 00:08:08.154 17:27:45 -- scripts/common.sh@336 -- # read -ra ver2 00:08:08.154 17:27:45 -- scripts/common.sh@337 -- # local 'op=<' 00:08:08.154 17:27:45 -- scripts/common.sh@339 -- # ver1_l=2 00:08:08.154 17:27:45 -- scripts/common.sh@340 -- # ver2_l=1 00:08:08.154 17:27:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:08.154 17:27:45 -- scripts/common.sh@343 -- # case "$op" in 00:08:08.154 17:27:45 -- scripts/common.sh@344 -- # : 1 00:08:08.154 17:27:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:08.154 17:27:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:08.154 17:27:45 -- scripts/common.sh@364 -- # decimal 1 00:08:08.154 17:27:45 -- scripts/common.sh@352 -- # local d=1 00:08:08.154 17:27:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:08.154 17:27:45 -- scripts/common.sh@354 -- # echo 1 00:08:08.154 17:27:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:08.154 17:27:45 -- scripts/common.sh@365 -- # decimal 2 00:08:08.154 17:27:45 -- scripts/common.sh@352 -- # local d=2 00:08:08.154 17:27:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:08.154 17:27:45 -- scripts/common.sh@354 -- # echo 2 00:08:08.154 17:27:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:08.154 17:27:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:08.154 17:27:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:08.154 17:27:45 -- scripts/common.sh@367 -- # return 0 00:08:08.154 17:27:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:08.154 17:27:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:08.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.154 --rc genhtml_branch_coverage=1 00:08:08.154 --rc genhtml_function_coverage=1 00:08:08.154 --rc genhtml_legend=1 00:08:08.154 --rc geninfo_all_blocks=1 00:08:08.154 --rc geninfo_unexecuted_blocks=1 00:08:08.154 00:08:08.154 ' 00:08:08.154 17:27:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:08.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.154 --rc genhtml_branch_coverage=1 00:08:08.154 --rc genhtml_function_coverage=1 00:08:08.154 --rc genhtml_legend=1 00:08:08.154 --rc geninfo_all_blocks=1 00:08:08.154 --rc geninfo_unexecuted_blocks=1 00:08:08.154 00:08:08.154 ' 00:08:08.154 17:27:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:08.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.154 --rc genhtml_branch_coverage=1 00:08:08.154 --rc genhtml_function_coverage=1 00:08:08.154 --rc genhtml_legend=1 00:08:08.154 --rc geninfo_all_blocks=1 00:08:08.154 --rc geninfo_unexecuted_blocks=1 00:08:08.154 00:08:08.154 ' 00:08:08.154 17:27:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:08.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.154 --rc genhtml_branch_coverage=1 00:08:08.154 --rc genhtml_function_coverage=1 00:08:08.154 --rc genhtml_legend=1 00:08:08.154 --rc geninfo_all_blocks=1 00:08:08.154 --rc geninfo_unexecuted_blocks=1 00:08:08.154 00:08:08.154 ' 00:08:08.154 17:27:45 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:08.154 17:27:45 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:08.154 17:27:45 -- common/autotest_common.sh@34 -- # set -e 00:08:08.154 17:27:45 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:08.154 17:27:45 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:08.154 17:27:45 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:08.154 17:27:45 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:08.154 17:27:45 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:08.154 17:27:45 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:08.154 17:27:45 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:08.154 17:27:45 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:08.154 17:27:45 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:08.154 17:27:45 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:08.154 17:27:45 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:08.154 17:27:45 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:08.154 17:27:45 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:08.154 17:27:45 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:08.154 17:27:45 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:08.154 17:27:45 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:08.154 17:27:45 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:08.154 17:27:45 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:08.154 17:27:45 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:08.154 17:27:45 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:08.154 17:27:45 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:08.154 17:27:45 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:08.154 17:27:45 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:08.154 17:27:45 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:08.154 17:27:45 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:08.154 17:27:45 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:08.154 17:27:45 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:08.154 17:27:45 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:08.154 17:27:45 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:08.154 17:27:45 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:08.154 17:27:45 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:08.154 17:27:45 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:08.154 17:27:45 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:08.154 17:27:45 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:08.154 17:27:45 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:08.154 17:27:45 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:08.154 17:27:45 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:08.154 17:27:45 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:08.154 17:27:45 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:08.154 17:27:45 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:08.154 17:27:45 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:08.154 17:27:45 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:08.154 17:27:45 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:08.154 17:27:45 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:08.154 17:27:45 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:08.154 17:27:45 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:08.154 17:27:45 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:08.154 17:27:45 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:08.154 17:27:45 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:08.154 17:27:45 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:08.154 17:27:45 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:08.154 17:27:45 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:08.154 17:27:45 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:08.154 17:27:45 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:08.154 17:27:45 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:08.154 17:27:45 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:08.154 17:27:45 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:08.154 17:27:45 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:08.155 17:27:45 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:08.155 17:27:45 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:08.155 17:27:45 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:08.155 17:27:45 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:08.155 17:27:45 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:08.155 17:27:45 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:08.155 17:27:45 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:08.155 17:27:45 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:08.155 17:27:45 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:08.155 17:27:45 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:08.155 17:27:45 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:08.155 17:27:45 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:08.155 17:27:45 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:08.155 17:27:45 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:08.155 17:27:45 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:08.155 17:27:45 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:08.155 17:27:45 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:08.155 17:27:45 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:08.155 17:27:45 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:08.155 17:27:45 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:08.155 17:27:45 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:08.155 17:27:45 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:08.155 17:27:45 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:08.155 17:27:45 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:08.155 17:27:45 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:08.155 17:27:45 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:08.155 17:27:45 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:08.155 17:27:45 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:08.155 17:27:45 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:08.155 17:27:45 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:08.155 17:27:45 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:08.155 17:27:45 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:08.155 17:27:45 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:08.155 17:27:45 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:08.155 17:27:45 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:08.155 17:27:45 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:08.155 17:27:45 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:08.155 17:27:45 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:08.155 17:27:45 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:08.155 17:27:45 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:08.155 17:27:45 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:08.155 #define SPDK_CONFIG_H 00:08:08.155 #define SPDK_CONFIG_APPS 1 00:08:08.155 #define SPDK_CONFIG_ARCH native 00:08:08.155 #undef SPDK_CONFIG_ASAN 00:08:08.155 #undef SPDK_CONFIG_AVAHI 00:08:08.155 #undef SPDK_CONFIG_CET 00:08:08.155 #define SPDK_CONFIG_COVERAGE 1 00:08:08.155 #define SPDK_CONFIG_CROSS_PREFIX 00:08:08.155 #undef SPDK_CONFIG_CRYPTO 00:08:08.155 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:08.155 #undef SPDK_CONFIG_CUSTOMOCF 00:08:08.155 #undef SPDK_CONFIG_DAOS 00:08:08.155 #define SPDK_CONFIG_DAOS_DIR 00:08:08.155 #define SPDK_CONFIG_DEBUG 1 00:08:08.155 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:08.155 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:08.155 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:08.155 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:08.155 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:08.155 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:08.155 #define SPDK_CONFIG_EXAMPLES 1 00:08:08.155 #undef SPDK_CONFIG_FC 00:08:08.155 #define SPDK_CONFIG_FC_PATH 00:08:08.155 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:08.155 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:08.155 #undef SPDK_CONFIG_FUSE 00:08:08.155 #undef SPDK_CONFIG_FUZZER 00:08:08.155 #define SPDK_CONFIG_FUZZER_LIB 00:08:08.155 #undef SPDK_CONFIG_GOLANG 00:08:08.155 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:08.155 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:08.155 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:08.155 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:08.155 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:08.155 #define SPDK_CONFIG_IDXD 1 00:08:08.155 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:08.155 #undef SPDK_CONFIG_IPSEC_MB 00:08:08.155 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:08.155 #define SPDK_CONFIG_ISAL 1 00:08:08.155 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:08.155 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:08.155 #define SPDK_CONFIG_LIBDIR 00:08:08.155 #undef SPDK_CONFIG_LTO 00:08:08.155 #define SPDK_CONFIG_MAX_LCORES 00:08:08.155 #define SPDK_CONFIG_NVME_CUSE 1 00:08:08.155 #undef SPDK_CONFIG_OCF 00:08:08.155 #define SPDK_CONFIG_OCF_PATH 00:08:08.155 #define SPDK_CONFIG_OPENSSL_PATH 00:08:08.155 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:08.155 #undef SPDK_CONFIG_PGO_USE 00:08:08.155 #define SPDK_CONFIG_PREFIX /usr/local 00:08:08.155 #undef SPDK_CONFIG_RAID5F 00:08:08.155 #undef SPDK_CONFIG_RBD 00:08:08.155 #define SPDK_CONFIG_RDMA 1 00:08:08.155 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:08.155 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:08.155 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:08.155 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:08.155 #define SPDK_CONFIG_SHARED 1 00:08:08.155 #undef SPDK_CONFIG_SMA 00:08:08.155 #define SPDK_CONFIG_TESTS 1 00:08:08.155 #undef SPDK_CONFIG_TSAN 00:08:08.155 #define SPDK_CONFIG_UBLK 1 00:08:08.155 #define SPDK_CONFIG_UBSAN 1 00:08:08.155 #undef SPDK_CONFIG_UNIT_TESTS 00:08:08.155 #undef SPDK_CONFIG_URING 00:08:08.155 #define SPDK_CONFIG_URING_PATH 00:08:08.155 #undef SPDK_CONFIG_URING_ZNS 00:08:08.155 #undef SPDK_CONFIG_USDT 00:08:08.155 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:08.155 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:08.155 #define SPDK_CONFIG_VFIO_USER 1 00:08:08.155 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:08.155 #define SPDK_CONFIG_VHOST 1 00:08:08.155 #define SPDK_CONFIG_VIRTIO 1 00:08:08.155 #undef SPDK_CONFIG_VTUNE 00:08:08.155 #define SPDK_CONFIG_VTUNE_DIR 00:08:08.155 #define SPDK_CONFIG_WERROR 1 00:08:08.155 #define SPDK_CONFIG_WPDK_DIR 00:08:08.155 #undef SPDK_CONFIG_XNVME 00:08:08.155 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:08.155 17:27:45 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:08.155 17:27:45 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:08.155 17:27:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:08.155 17:27:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:08.155 17:27:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:08.155 17:27:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.155 17:27:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.155 17:27:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.155 17:27:45 -- paths/export.sh@5 -- # export PATH 00:08:08.156 17:27:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.156 17:27:45 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:08.156 17:27:45 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:08.156 17:27:45 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:08.156 17:27:45 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:08.156 17:27:45 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:08.156 17:27:45 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:08.156 17:27:45 -- pm/common@16 -- # TEST_TAG=N/A 00:08:08.156 17:27:45 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:08.156 17:27:45 -- common/autotest_common.sh@52 -- # : 1 00:08:08.156 17:27:45 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:08.156 17:27:45 -- common/autotest_common.sh@56 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:08.156 17:27:45 -- common/autotest_common.sh@58 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:08.156 17:27:45 -- common/autotest_common.sh@60 -- # : 1 00:08:08.156 17:27:45 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:08.156 17:27:45 -- common/autotest_common.sh@62 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:08.156 17:27:45 -- common/autotest_common.sh@64 -- # : 00:08:08.156 17:27:45 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:08.156 17:27:45 -- common/autotest_common.sh@66 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:08.156 17:27:45 -- common/autotest_common.sh@68 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:08.156 17:27:45 -- common/autotest_common.sh@70 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:08.156 17:27:45 -- common/autotest_common.sh@72 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:08.156 17:27:45 -- common/autotest_common.sh@74 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:08.156 17:27:45 -- common/autotest_common.sh@76 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:08.156 17:27:45 -- common/autotest_common.sh@78 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:08.156 17:27:45 -- common/autotest_common.sh@80 -- # : 1 00:08:08.156 17:27:45 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:08.156 17:27:45 -- common/autotest_common.sh@82 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:08.156 17:27:45 -- common/autotest_common.sh@84 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:08.156 17:27:45 -- common/autotest_common.sh@86 -- # : 1 00:08:08.156 17:27:45 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:08.156 17:27:45 -- common/autotest_common.sh@88 -- # : 1 00:08:08.156 17:27:45 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:08.156 17:27:45 -- common/autotest_common.sh@90 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:08.156 17:27:45 -- common/autotest_common.sh@92 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:08.156 17:27:45 -- common/autotest_common.sh@94 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:08.156 17:27:45 -- common/autotest_common.sh@96 -- # : tcp 00:08:08.156 17:27:45 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:08.156 17:27:45 -- common/autotest_common.sh@98 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:08.156 17:27:45 -- common/autotest_common.sh@100 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:08.156 17:27:45 -- common/autotest_common.sh@102 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:08.156 17:27:45 -- common/autotest_common.sh@104 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:08.156 17:27:45 -- common/autotest_common.sh@106 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:08.156 17:27:45 -- common/autotest_common.sh@108 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:08.156 17:27:45 -- common/autotest_common.sh@110 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:08.156 17:27:45 -- common/autotest_common.sh@112 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:08.156 17:27:45 -- common/autotest_common.sh@114 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:08.156 17:27:45 -- common/autotest_common.sh@116 -- # : 1 00:08:08.156 17:27:45 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:08.156 17:27:45 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:08.156 17:27:45 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:08.156 17:27:45 -- common/autotest_common.sh@120 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:08.156 17:27:45 -- common/autotest_common.sh@122 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:08.156 17:27:45 -- common/autotest_common.sh@124 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:08.156 17:27:45 -- common/autotest_common.sh@126 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:08.156 17:27:45 -- common/autotest_common.sh@128 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:08.156 17:27:45 -- common/autotest_common.sh@130 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:08.156 17:27:45 -- common/autotest_common.sh@132 -- # : v23.11 00:08:08.156 17:27:45 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:08.156 17:27:45 -- common/autotest_common.sh@134 -- # : true 00:08:08.156 17:27:45 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:08.156 17:27:45 -- common/autotest_common.sh@136 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:08.156 17:27:45 -- common/autotest_common.sh@138 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:08.156 17:27:45 -- common/autotest_common.sh@140 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:08.156 17:27:45 -- common/autotest_common.sh@142 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:08.156 17:27:45 -- common/autotest_common.sh@144 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:08.156 17:27:45 -- common/autotest_common.sh@146 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:08.156 17:27:45 -- common/autotest_common.sh@148 -- # : e810 00:08:08.156 17:27:45 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:08.156 17:27:45 -- common/autotest_common.sh@150 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:08.156 17:27:45 -- common/autotest_common.sh@152 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:08.156 17:27:45 -- common/autotest_common.sh@154 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:08.156 17:27:45 -- common/autotest_common.sh@156 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:08.156 17:27:45 -- common/autotest_common.sh@158 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:08.156 17:27:45 -- common/autotest_common.sh@160 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:08.156 17:27:45 -- common/autotest_common.sh@163 -- # : 00:08:08.156 17:27:45 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:08.156 17:27:45 -- common/autotest_common.sh@165 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:08.156 17:27:45 -- common/autotest_common.sh@167 -- # : 0 00:08:08.156 17:27:45 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:08.156 17:27:45 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:08.156 17:27:45 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:08.156 17:27:45 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:08.156 17:27:45 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:08.156 17:27:45 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:08.157 17:27:45 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:08.157 17:27:45 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:08.157 17:27:45 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:08.157 17:27:45 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:08.157 17:27:45 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:08.157 17:27:45 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:08.157 17:27:45 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:08.157 17:27:45 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:08.157 17:27:45 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:08.157 17:27:45 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:08.157 17:27:45 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:08.157 17:27:45 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:08.157 17:27:45 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:08.157 17:27:45 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:08.157 17:27:45 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:08.157 17:27:45 -- common/autotest_common.sh@196 -- # cat 00:08:08.157 17:27:45 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:08.157 17:27:45 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:08.157 17:27:45 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:08.157 17:27:45 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:08.157 17:27:45 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:08.157 17:27:45 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:08.157 17:27:45 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:08.157 17:27:45 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:08.157 17:27:45 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:08.157 17:27:45 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:08.157 17:27:45 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:08.157 17:27:45 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:08.157 17:27:45 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:08.157 17:27:45 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:08.157 17:27:45 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:08.157 17:27:45 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:08.157 17:27:45 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:08.157 17:27:45 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:08.157 17:27:45 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:08.157 17:27:45 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:08.157 17:27:45 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:08.157 17:27:45 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:08.157 17:27:45 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:08.157 17:27:45 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:08.157 17:27:45 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:08.157 17:27:45 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:08.157 17:27:45 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:08.157 17:27:45 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:08.157 17:27:45 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:08.157 17:27:45 -- common/autotest_common.sh@259 -- # valgrind= 00:08:08.157 17:27:45 -- common/autotest_common.sh@265 -- # uname -s 00:08:08.157 17:27:45 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:08.157 17:27:45 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:08.157 17:27:45 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:08.157 17:27:45 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:08.157 17:27:45 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:08.157 17:27:45 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:08.157 17:27:45 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:08.157 17:27:45 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:08.157 17:27:45 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:08.157 17:27:45 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:08.157 17:27:45 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:08.157 17:27:45 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:08.157 17:27:45 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:08.157 17:27:45 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:08.157 17:27:45 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:08.157 17:27:45 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:08.157 17:27:45 -- common/autotest_common.sh@319 -- # [[ -z 1480096 ]] 00:08:08.157 17:27:45 -- common/autotest_common.sh@319 -- # kill -0 1480096 00:08:08.157 17:27:45 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:08.157 17:27:45 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:08.157 17:27:45 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:08.157 17:27:45 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:08.157 17:27:45 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:08.157 17:27:45 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:08.157 17:27:45 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:08.157 17:27:45 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:08.157 17:27:45 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.iPc977 00:08:08.157 17:27:45 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:08.157 17:27:45 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:08.157 17:27:45 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:08.157 17:27:45 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.iPc977/tests/target /tmp/spdk.iPc977 00:08:08.157 17:27:45 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:08.157 17:27:45 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.157 17:27:45 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:08.157 17:27:45 -- common/autotest_common.sh@328 -- # df -T 00:08:08.157 17:27:45 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:08.158 17:27:45 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:08.158 17:27:45 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:08.158 17:27:45 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:08.158 17:27:45 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # avails["$mount"]=53256372224 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988532224 00:08:08.158 17:27:45 -- common/autotest_common.sh@364 -- # uses["$mount"]=8732160000 00:08:08.158 17:27:45 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993006592 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:08:08.158 17:27:45 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:08:08.158 17:27:45 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:08:08.158 17:27:45 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:08.158 17:27:45 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # avails["$mount"]=30994038784 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994268160 00:08:08.158 17:27:45 -- common/autotest_common.sh@364 -- # uses["$mount"]=229376 00:08:08.158 17:27:45 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:08.158 17:27:45 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:08.158 17:27:45 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:08.158 17:27:45 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:08.158 17:27:45 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:08.158 * Looking for test storage... 00:08:08.158 17:27:45 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:08.158 17:27:45 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:08.158 17:27:45 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.158 17:27:45 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:08.158 17:27:45 -- common/autotest_common.sh@373 -- # mount=/ 00:08:08.158 17:27:45 -- common/autotest_common.sh@375 -- # target_space=53256372224 00:08:08.158 17:27:45 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:08.158 17:27:45 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:08.158 17:27:45 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:08.158 17:27:45 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:08.158 17:27:45 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:08.158 17:27:45 -- common/autotest_common.sh@382 -- # new_size=10946752512 00:08:08.158 17:27:45 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:08.158 17:27:45 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.158 17:27:45 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.158 17:27:45 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.158 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:08.158 17:27:45 -- common/autotest_common.sh@390 -- # return 0 00:08:08.158 17:27:45 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:08.158 17:27:45 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:08.158 17:27:45 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:08.158 17:27:45 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:08.158 17:27:45 -- common/autotest_common.sh@1682 -- # true 00:08:08.158 17:27:45 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:08.158 17:27:45 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:08.158 17:27:45 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:08.158 17:27:45 -- common/autotest_common.sh@27 -- # exec 00:08:08.158 17:27:45 -- common/autotest_common.sh@29 -- # exec 00:08:08.158 17:27:45 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:08.158 17:27:45 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:08.158 17:27:45 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:08.158 17:27:45 -- common/autotest_common.sh@18 -- # set -x 00:08:08.158 17:27:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:08.158 17:27:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:08.158 17:27:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:08.158 17:27:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:08.158 17:27:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:08.158 17:27:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:08.158 17:27:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:08.158 17:27:45 -- scripts/common.sh@335 -- # IFS=.-: 00:08:08.158 17:27:45 -- scripts/common.sh@335 -- # read -ra ver1 00:08:08.158 17:27:45 -- scripts/common.sh@336 -- # IFS=.-: 00:08:08.158 17:27:45 -- scripts/common.sh@336 -- # read -ra ver2 00:08:08.158 17:27:45 -- scripts/common.sh@337 -- # local 'op=<' 00:08:08.158 17:27:45 -- scripts/common.sh@339 -- # ver1_l=2 00:08:08.158 17:27:45 -- scripts/common.sh@340 -- # ver2_l=1 00:08:08.158 17:27:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:08.158 17:27:45 -- scripts/common.sh@343 -- # case "$op" in 00:08:08.158 17:27:45 -- scripts/common.sh@344 -- # : 1 00:08:08.158 17:27:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:08.158 17:27:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:08.158 17:27:45 -- scripts/common.sh@364 -- # decimal 1 00:08:08.158 17:27:45 -- scripts/common.sh@352 -- # local d=1 00:08:08.158 17:27:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:08.158 17:27:45 -- scripts/common.sh@354 -- # echo 1 00:08:08.158 17:27:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:08.158 17:27:45 -- scripts/common.sh@365 -- # decimal 2 00:08:08.158 17:27:45 -- scripts/common.sh@352 -- # local d=2 00:08:08.158 17:27:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:08.158 17:27:45 -- scripts/common.sh@354 -- # echo 2 00:08:08.158 17:27:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:08.158 17:27:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:08.158 17:27:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:08.158 17:27:45 -- scripts/common.sh@367 -- # return 0 00:08:08.158 17:27:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:08.158 17:27:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:08.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.158 --rc genhtml_branch_coverage=1 00:08:08.159 --rc genhtml_function_coverage=1 00:08:08.159 --rc genhtml_legend=1 00:08:08.159 --rc geninfo_all_blocks=1 00:08:08.159 --rc geninfo_unexecuted_blocks=1 00:08:08.159 00:08:08.159 ' 00:08:08.159 17:27:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:08.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.159 --rc genhtml_branch_coverage=1 00:08:08.159 --rc genhtml_function_coverage=1 00:08:08.159 --rc genhtml_legend=1 00:08:08.159 --rc geninfo_all_blocks=1 00:08:08.159 --rc geninfo_unexecuted_blocks=1 00:08:08.159 00:08:08.159 ' 00:08:08.159 17:27:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:08.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.159 --rc genhtml_branch_coverage=1 00:08:08.159 --rc genhtml_function_coverage=1 00:08:08.159 --rc genhtml_legend=1 00:08:08.159 --rc geninfo_all_blocks=1 00:08:08.159 --rc geninfo_unexecuted_blocks=1 00:08:08.159 00:08:08.159 ' 00:08:08.159 17:27:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:08.159 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.159 --rc genhtml_branch_coverage=1 00:08:08.159 --rc genhtml_function_coverage=1 00:08:08.159 --rc genhtml_legend=1 00:08:08.159 --rc geninfo_all_blocks=1 00:08:08.159 --rc geninfo_unexecuted_blocks=1 00:08:08.159 00:08:08.159 ' 00:08:08.159 17:27:45 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:08.159 17:27:45 -- nvmf/common.sh@7 -- # uname -s 00:08:08.159 17:27:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:08.159 17:27:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:08.159 17:27:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:08.159 17:27:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:08.159 17:27:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:08.159 17:27:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:08.159 17:27:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:08.159 17:27:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:08.159 17:27:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:08.159 17:27:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:08.159 17:27:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:08.159 17:27:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:08.159 17:27:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:08.159 17:27:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:08.159 17:27:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:08.159 17:27:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:08.159 17:27:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:08.159 17:27:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:08.159 17:27:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:08.159 17:27:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.159 17:27:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.159 17:27:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.159 17:27:45 -- paths/export.sh@5 -- # export PATH 00:08:08.159 17:27:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.159 17:27:45 -- nvmf/common.sh@46 -- # : 0 00:08:08.159 17:27:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:08.159 17:27:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:08.159 17:27:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:08.159 17:27:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:08.159 17:27:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:08.159 17:27:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:08.159 17:27:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:08.159 17:27:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:08.159 17:27:45 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:08.159 17:27:45 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:08.159 17:27:45 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:08.159 17:27:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:08.159 17:27:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:08.159 17:27:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:08.159 17:27:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:08.159 17:27:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:08.159 17:27:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:08.159 17:27:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:08.159 17:27:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:08.159 17:27:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:08.159 17:27:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:08.159 17:27:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:08.159 17:27:45 -- common/autotest_common.sh@10 -- # set +x 00:08:10.690 17:27:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:10.690 17:27:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:10.690 17:27:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:10.690 17:27:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:10.690 17:27:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:10.690 17:27:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:10.690 17:27:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:10.690 17:27:47 -- nvmf/common.sh@294 -- # net_devs=() 00:08:10.690 17:27:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:10.690 17:27:47 -- nvmf/common.sh@295 -- # e810=() 00:08:10.690 17:27:47 -- nvmf/common.sh@295 -- # local -ga e810 00:08:10.690 17:27:47 -- nvmf/common.sh@296 -- # x722=() 00:08:10.690 17:27:47 -- nvmf/common.sh@296 -- # local -ga x722 00:08:10.690 17:27:47 -- nvmf/common.sh@297 -- # mlx=() 00:08:10.690 17:27:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:10.690 17:27:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:10.690 17:27:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:10.690 17:27:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:10.690 17:27:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:10.690 17:27:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:10.690 17:27:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:10.690 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:10.690 17:27:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:10.690 17:27:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:10.690 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:10.690 17:27:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:10.690 17:27:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:10.690 17:27:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:10.690 17:27:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:10.690 17:27:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:10.690 17:27:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:10.690 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:10.690 17:27:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:10.690 17:27:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:10.690 17:27:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:10.690 17:27:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:10.690 17:27:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:10.690 17:27:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:10.690 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:10.690 17:27:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:10.690 17:27:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:10.690 17:27:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:10.690 17:27:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:10.690 17:27:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:10.690 17:27:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:10.690 17:27:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:10.690 17:27:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:10.690 17:27:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:10.690 17:27:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:10.690 17:27:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:10.690 17:27:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:10.690 17:27:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:10.690 17:27:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:10.690 17:27:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:10.690 17:27:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:10.690 17:27:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:10.690 17:27:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:10.690 17:27:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:10.690 17:27:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:10.690 17:27:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:10.690 17:27:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:10.690 17:27:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:10.690 17:27:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:10.690 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:10.690 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.138 ms 00:08:10.690 00:08:10.690 --- 10.0.0.2 ping statistics --- 00:08:10.690 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:10.690 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:08:10.690 17:27:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:10.690 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:10.690 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:08:10.690 00:08:10.690 --- 10.0.0.1 ping statistics --- 00:08:10.690 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:10.690 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:08:10.690 17:27:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:10.690 17:27:47 -- nvmf/common.sh@410 -- # return 0 00:08:10.690 17:27:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:10.690 17:27:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:10.690 17:27:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:10.690 17:27:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:10.690 17:27:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:10.690 17:27:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:10.690 17:27:47 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:10.690 17:27:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:10.690 17:27:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.690 17:27:47 -- common/autotest_common.sh@10 -- # set +x 00:08:10.690 ************************************ 00:08:10.690 START TEST nvmf_filesystem_no_in_capsule 00:08:10.690 ************************************ 00:08:10.690 17:27:47 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:10.690 17:27:47 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:10.690 17:27:47 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:10.691 17:27:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:10.691 17:27:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:10.691 17:27:47 -- common/autotest_common.sh@10 -- # set +x 00:08:10.691 17:27:47 -- nvmf/common.sh@469 -- # nvmfpid=1481743 00:08:10.691 17:27:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:10.691 17:27:47 -- nvmf/common.sh@470 -- # waitforlisten 1481743 00:08:10.691 17:27:47 -- common/autotest_common.sh@829 -- # '[' -z 1481743 ']' 00:08:10.691 17:27:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:10.691 17:27:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:10.691 17:27:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:10.691 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:10.691 17:27:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:10.691 17:27:47 -- common/autotest_common.sh@10 -- # set +x 00:08:10.691 [2024-11-16 17:27:47.961462] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:10.691 [2024-11-16 17:27:47.961539] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:10.691 EAL: No free 2048 kB hugepages reported on node 1 00:08:10.691 [2024-11-16 17:27:48.030347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:10.691 [2024-11-16 17:27:48.127460] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:10.691 [2024-11-16 17:27:48.127634] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:10.691 [2024-11-16 17:27:48.127656] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:10.691 [2024-11-16 17:27:48.127670] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:10.691 [2024-11-16 17:27:48.127734] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:10.691 [2024-11-16 17:27:48.127762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:10.691 [2024-11-16 17:27:48.127813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:10.691 [2024-11-16 17:27:48.127815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.629 17:27:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:11.629 17:27:48 -- common/autotest_common.sh@862 -- # return 0 00:08:11.629 17:27:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:11.629 17:27:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:11.629 17:27:48 -- common/autotest_common.sh@10 -- # set +x 00:08:11.629 17:27:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:11.629 17:27:48 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:11.629 17:27:48 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:11.629 17:27:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.629 17:27:48 -- common/autotest_common.sh@10 -- # set +x 00:08:11.629 [2024-11-16 17:27:48.954278] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:11.629 17:27:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.629 17:27:48 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:11.629 17:27:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.629 17:27:48 -- common/autotest_common.sh@10 -- # set +x 00:08:11.888 Malloc1 00:08:11.888 17:27:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.888 17:27:49 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:11.888 17:27:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.888 17:27:49 -- common/autotest_common.sh@10 -- # set +x 00:08:11.888 17:27:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.888 17:27:49 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:11.888 17:27:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.888 17:27:49 -- common/autotest_common.sh@10 -- # set +x 00:08:11.888 17:27:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.888 17:27:49 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:11.888 17:27:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.888 17:27:49 -- common/autotest_common.sh@10 -- # set +x 00:08:11.888 [2024-11-16 17:27:49.142430] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:11.888 17:27:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.888 17:27:49 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:11.888 17:27:49 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:11.888 17:27:49 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:11.888 17:27:49 -- common/autotest_common.sh@1369 -- # local bs 00:08:11.888 17:27:49 -- common/autotest_common.sh@1370 -- # local nb 00:08:11.888 17:27:49 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:11.888 17:27:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.888 17:27:49 -- common/autotest_common.sh@10 -- # set +x 00:08:11.888 17:27:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.888 17:27:49 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:11.888 { 00:08:11.888 "name": "Malloc1", 00:08:11.888 "aliases": [ 00:08:11.888 "23adb132-4ddc-49f6-b5dc-8c9376797f7f" 00:08:11.888 ], 00:08:11.888 "product_name": "Malloc disk", 00:08:11.888 "block_size": 512, 00:08:11.888 "num_blocks": 1048576, 00:08:11.888 "uuid": "23adb132-4ddc-49f6-b5dc-8c9376797f7f", 00:08:11.888 "assigned_rate_limits": { 00:08:11.888 "rw_ios_per_sec": 0, 00:08:11.888 "rw_mbytes_per_sec": 0, 00:08:11.888 "r_mbytes_per_sec": 0, 00:08:11.888 "w_mbytes_per_sec": 0 00:08:11.889 }, 00:08:11.889 "claimed": true, 00:08:11.889 "claim_type": "exclusive_write", 00:08:11.889 "zoned": false, 00:08:11.889 "supported_io_types": { 00:08:11.889 "read": true, 00:08:11.889 "write": true, 00:08:11.889 "unmap": true, 00:08:11.889 "write_zeroes": true, 00:08:11.889 "flush": true, 00:08:11.889 "reset": true, 00:08:11.889 "compare": false, 00:08:11.889 "compare_and_write": false, 00:08:11.889 "abort": true, 00:08:11.889 "nvme_admin": false, 00:08:11.889 "nvme_io": false 00:08:11.889 }, 00:08:11.889 "memory_domains": [ 00:08:11.889 { 00:08:11.889 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:11.889 "dma_device_type": 2 00:08:11.889 } 00:08:11.889 ], 00:08:11.889 "driver_specific": {} 00:08:11.889 } 00:08:11.889 ]' 00:08:11.889 17:27:49 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:11.889 17:27:49 -- common/autotest_common.sh@1372 -- # bs=512 00:08:11.889 17:27:49 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:11.889 17:27:49 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:11.889 17:27:49 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:11.889 17:27:49 -- common/autotest_common.sh@1377 -- # echo 512 00:08:11.889 17:27:49 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:11.889 17:27:49 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:12.456 17:27:49 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:12.456 17:27:49 -- common/autotest_common.sh@1187 -- # local i=0 00:08:12.456 17:27:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:12.456 17:27:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:12.456 17:27:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:14.996 17:27:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:14.996 17:27:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:14.996 17:27:51 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:14.996 17:27:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:14.996 17:27:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:14.996 17:27:51 -- common/autotest_common.sh@1197 -- # return 0 00:08:14.996 17:27:51 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:14.996 17:27:51 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:14.996 17:27:51 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:14.996 17:27:51 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:14.996 17:27:51 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:14.996 17:27:51 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:14.996 17:27:51 -- setup/common.sh@80 -- # echo 536870912 00:08:14.996 17:27:51 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:14.996 17:27:51 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:14.996 17:27:51 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:14.996 17:27:51 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:14.996 17:27:52 -- target/filesystem.sh@69 -- # partprobe 00:08:15.566 17:27:52 -- target/filesystem.sh@70 -- # sleep 1 00:08:16.504 17:27:53 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:16.504 17:27:53 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:16.504 17:27:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:16.504 17:27:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.504 17:27:53 -- common/autotest_common.sh@10 -- # set +x 00:08:16.504 ************************************ 00:08:16.504 START TEST filesystem_ext4 00:08:16.504 ************************************ 00:08:16.504 17:27:53 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:16.504 17:27:53 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:16.504 17:27:53 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:16.504 17:27:53 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:16.504 17:27:53 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:16.504 17:27:53 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:16.504 17:27:53 -- common/autotest_common.sh@914 -- # local i=0 00:08:16.504 17:27:53 -- common/autotest_common.sh@915 -- # local force 00:08:16.504 17:27:53 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:16.504 17:27:53 -- common/autotest_common.sh@918 -- # force=-F 00:08:16.504 17:27:53 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:16.504 mke2fs 1.47.0 (5-Feb-2023) 00:08:16.765 Discarding device blocks: 0/522240 done 00:08:16.765 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:16.765 Filesystem UUID: 7e35d58b-a5a9-4d3d-9c07-a65348d6f1a3 00:08:16.765 Superblock backups stored on blocks: 00:08:16.765 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:16.765 00:08:16.765 Allocating group tables: 0/64 done 00:08:16.765 Writing inode tables: 0/64 done 00:08:16.765 Creating journal (8192 blocks): done 00:08:16.765 Writing superblocks and filesystem accounting information: 0/64 done 00:08:16.765 00:08:16.765 17:27:54 -- common/autotest_common.sh@931 -- # return 0 00:08:16.765 17:27:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:23.340 17:28:00 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:23.340 17:28:00 -- target/filesystem.sh@25 -- # sync 00:08:23.340 17:28:00 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:23.340 17:28:00 -- target/filesystem.sh@27 -- # sync 00:08:23.340 17:28:00 -- target/filesystem.sh@29 -- # i=0 00:08:23.340 17:28:00 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:23.340 17:28:00 -- target/filesystem.sh@37 -- # kill -0 1481743 00:08:23.340 17:28:00 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:23.340 17:28:00 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:23.340 17:28:00 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:23.340 17:28:00 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:23.341 00:08:23.341 real 0m6.404s 00:08:23.341 user 0m0.016s 00:08:23.341 sys 0m0.075s 00:08:23.341 17:28:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:23.341 17:28:00 -- common/autotest_common.sh@10 -- # set +x 00:08:23.341 ************************************ 00:08:23.341 END TEST filesystem_ext4 00:08:23.341 ************************************ 00:08:23.341 17:28:00 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:23.341 17:28:00 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:23.341 17:28:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:23.341 17:28:00 -- common/autotest_common.sh@10 -- # set +x 00:08:23.341 ************************************ 00:08:23.341 START TEST filesystem_btrfs 00:08:23.341 ************************************ 00:08:23.341 17:28:00 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:23.341 17:28:00 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:23.341 17:28:00 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:23.341 17:28:00 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:23.341 17:28:00 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:23.341 17:28:00 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:23.341 17:28:00 -- common/autotest_common.sh@914 -- # local i=0 00:08:23.341 17:28:00 -- common/autotest_common.sh@915 -- # local force 00:08:23.341 17:28:00 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:23.341 17:28:00 -- common/autotest_common.sh@920 -- # force=-f 00:08:23.341 17:28:00 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:23.341 btrfs-progs v6.8.1 00:08:23.341 See https://btrfs.readthedocs.io for more information. 00:08:23.341 00:08:23.341 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:23.341 NOTE: several default settings have changed in version 5.15, please make sure 00:08:23.341 this does not affect your deployments: 00:08:23.341 - DUP for metadata (-m dup) 00:08:23.341 - enabled no-holes (-O no-holes) 00:08:23.341 - enabled free-space-tree (-R free-space-tree) 00:08:23.341 00:08:23.341 Label: (null) 00:08:23.341 UUID: 0ea5d5dd-7b2a-4f4d-821d-b33955b06df0 00:08:23.341 Node size: 16384 00:08:23.341 Sector size: 4096 (CPU page size: 4096) 00:08:23.341 Filesystem size: 510.00MiB 00:08:23.341 Block group profiles: 00:08:23.341 Data: single 8.00MiB 00:08:23.341 Metadata: DUP 32.00MiB 00:08:23.341 System: DUP 8.00MiB 00:08:23.341 SSD detected: yes 00:08:23.341 Zoned device: no 00:08:23.341 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:23.341 Checksum: crc32c 00:08:23.341 Number of devices: 1 00:08:23.341 Devices: 00:08:23.341 ID SIZE PATH 00:08:23.341 1 510.00MiB /dev/nvme0n1p1 00:08:23.341 00:08:23.341 17:28:00 -- common/autotest_common.sh@931 -- # return 0 00:08:23.341 17:28:00 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:24.280 17:28:01 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:24.280 17:28:01 -- target/filesystem.sh@25 -- # sync 00:08:24.280 17:28:01 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:24.280 17:28:01 -- target/filesystem.sh@27 -- # sync 00:08:24.280 17:28:01 -- target/filesystem.sh@29 -- # i=0 00:08:24.280 17:28:01 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:24.280 17:28:01 -- target/filesystem.sh@37 -- # kill -0 1481743 00:08:24.280 17:28:01 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:24.280 17:28:01 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:24.280 17:28:01 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:24.280 17:28:01 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:24.280 00:08:24.280 real 0m1.318s 00:08:24.280 user 0m0.025s 00:08:24.280 sys 0m0.093s 00:08:24.280 17:28:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:24.280 17:28:01 -- common/autotest_common.sh@10 -- # set +x 00:08:24.280 ************************************ 00:08:24.280 END TEST filesystem_btrfs 00:08:24.280 ************************************ 00:08:24.280 17:28:01 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:24.280 17:28:01 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:24.280 17:28:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:24.280 17:28:01 -- common/autotest_common.sh@10 -- # set +x 00:08:24.280 ************************************ 00:08:24.280 START TEST filesystem_xfs 00:08:24.280 ************************************ 00:08:24.280 17:28:01 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:24.280 17:28:01 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:24.280 17:28:01 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:24.280 17:28:01 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:24.280 17:28:01 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:24.280 17:28:01 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:24.280 17:28:01 -- common/autotest_common.sh@914 -- # local i=0 00:08:24.280 17:28:01 -- common/autotest_common.sh@915 -- # local force 00:08:24.280 17:28:01 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:24.280 17:28:01 -- common/autotest_common.sh@920 -- # force=-f 00:08:24.280 17:28:01 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:24.538 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:24.538 = sectsz=512 attr=2, projid32bit=1 00:08:24.538 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:24.538 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:24.538 data = bsize=4096 blocks=130560, imaxpct=25 00:08:24.538 = sunit=0 swidth=0 blks 00:08:24.538 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:24.538 log =internal log bsize=4096 blocks=16384, version=2 00:08:24.538 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:24.538 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:25.107 Discarding blocks...Done. 00:08:25.107 17:28:02 -- common/autotest_common.sh@931 -- # return 0 00:08:25.107 17:28:02 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:27.642 17:28:04 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:27.642 17:28:04 -- target/filesystem.sh@25 -- # sync 00:08:27.642 17:28:04 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:27.642 17:28:04 -- target/filesystem.sh@27 -- # sync 00:08:27.642 17:28:04 -- target/filesystem.sh@29 -- # i=0 00:08:27.642 17:28:04 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:27.642 17:28:04 -- target/filesystem.sh@37 -- # kill -0 1481743 00:08:27.642 17:28:04 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:27.642 17:28:04 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:27.642 17:28:04 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:27.642 17:28:04 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:27.642 00:08:27.642 real 0m3.105s 00:08:27.642 user 0m0.018s 00:08:27.642 sys 0m0.060s 00:08:27.642 17:28:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:27.642 17:28:04 -- common/autotest_common.sh@10 -- # set +x 00:08:27.642 ************************************ 00:08:27.642 END TEST filesystem_xfs 00:08:27.642 ************************************ 00:08:27.642 17:28:04 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:27.642 17:28:04 -- target/filesystem.sh@93 -- # sync 00:08:27.642 17:28:04 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:27.642 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.642 17:28:04 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:27.642 17:28:04 -- common/autotest_common.sh@1208 -- # local i=0 00:08:27.642 17:28:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:27.642 17:28:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:27.642 17:28:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:27.642 17:28:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:27.642 17:28:04 -- common/autotest_common.sh@1220 -- # return 0 00:08:27.642 17:28:04 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:27.642 17:28:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:27.642 17:28:04 -- common/autotest_common.sh@10 -- # set +x 00:08:27.642 17:28:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:27.642 17:28:04 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:27.642 17:28:04 -- target/filesystem.sh@101 -- # killprocess 1481743 00:08:27.642 17:28:04 -- common/autotest_common.sh@936 -- # '[' -z 1481743 ']' 00:08:27.642 17:28:04 -- common/autotest_common.sh@940 -- # kill -0 1481743 00:08:27.642 17:28:04 -- common/autotest_common.sh@941 -- # uname 00:08:27.642 17:28:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:27.642 17:28:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1481743 00:08:27.642 17:28:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:27.642 17:28:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:27.642 17:28:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1481743' 00:08:27.642 killing process with pid 1481743 00:08:27.642 17:28:04 -- common/autotest_common.sh@955 -- # kill 1481743 00:08:27.642 17:28:04 -- common/autotest_common.sh@960 -- # wait 1481743 00:08:28.209 17:28:05 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:28.209 00:08:28.209 real 0m17.502s 00:08:28.209 user 1m7.844s 00:08:28.209 sys 0m2.167s 00:08:28.209 17:28:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:28.209 17:28:05 -- common/autotest_common.sh@10 -- # set +x 00:08:28.209 ************************************ 00:08:28.209 END TEST nvmf_filesystem_no_in_capsule 00:08:28.209 ************************************ 00:08:28.209 17:28:05 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:28.209 17:28:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:28.209 17:28:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.209 17:28:05 -- common/autotest_common.sh@10 -- # set +x 00:08:28.209 ************************************ 00:08:28.209 START TEST nvmf_filesystem_in_capsule 00:08:28.209 ************************************ 00:08:28.209 17:28:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:28.209 17:28:05 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:28.209 17:28:05 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:28.209 17:28:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:28.209 17:28:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:28.209 17:28:05 -- common/autotest_common.sh@10 -- # set +x 00:08:28.209 17:28:05 -- nvmf/common.sh@469 -- # nvmfpid=1484157 00:08:28.209 17:28:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:28.209 17:28:05 -- nvmf/common.sh@470 -- # waitforlisten 1484157 00:08:28.209 17:28:05 -- common/autotest_common.sh@829 -- # '[' -z 1484157 ']' 00:08:28.209 17:28:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:28.209 17:28:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:28.209 17:28:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:28.209 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:28.209 17:28:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:28.209 17:28:05 -- common/autotest_common.sh@10 -- # set +x 00:08:28.209 [2024-11-16 17:28:05.490749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:28.209 [2024-11-16 17:28:05.490840] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:28.209 EAL: No free 2048 kB hugepages reported on node 1 00:08:28.209 [2024-11-16 17:28:05.557507] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:28.209 [2024-11-16 17:28:05.646574] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:28.209 [2024-11-16 17:28:05.646749] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:28.209 [2024-11-16 17:28:05.646767] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:28.209 [2024-11-16 17:28:05.646779] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:28.209 [2024-11-16 17:28:05.646845] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:28.209 [2024-11-16 17:28:05.646900] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:28.209 [2024-11-16 17:28:05.646964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:28.209 [2024-11-16 17:28:05.646967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:29.145 17:28:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:29.145 17:28:06 -- common/autotest_common.sh@862 -- # return 0 00:08:29.145 17:28:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:29.145 17:28:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:29.145 17:28:06 -- common/autotest_common.sh@10 -- # set +x 00:08:29.145 17:28:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:29.145 17:28:06 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:29.145 17:28:06 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:29.145 17:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.145 17:28:06 -- common/autotest_common.sh@10 -- # set +x 00:08:29.145 [2024-11-16 17:28:06.519395] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:29.145 17:28:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.145 17:28:06 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:29.145 17:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.145 17:28:06 -- common/autotest_common.sh@10 -- # set +x 00:08:29.405 Malloc1 00:08:29.405 17:28:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.405 17:28:06 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:29.405 17:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.405 17:28:06 -- common/autotest_common.sh@10 -- # set +x 00:08:29.405 17:28:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.405 17:28:06 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:29.405 17:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.405 17:28:06 -- common/autotest_common.sh@10 -- # set +x 00:08:29.405 17:28:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.405 17:28:06 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:29.405 17:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.405 17:28:06 -- common/autotest_common.sh@10 -- # set +x 00:08:29.405 [2024-11-16 17:28:06.690061] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:29.405 17:28:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.405 17:28:06 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:29.405 17:28:06 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:29.405 17:28:06 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:29.405 17:28:06 -- common/autotest_common.sh@1369 -- # local bs 00:08:29.405 17:28:06 -- common/autotest_common.sh@1370 -- # local nb 00:08:29.405 17:28:06 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:29.405 17:28:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.405 17:28:06 -- common/autotest_common.sh@10 -- # set +x 00:08:29.405 17:28:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.405 17:28:06 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:29.405 { 00:08:29.405 "name": "Malloc1", 00:08:29.405 "aliases": [ 00:08:29.405 "7cd86443-172f-417a-970c-9d7cbeffe71a" 00:08:29.405 ], 00:08:29.405 "product_name": "Malloc disk", 00:08:29.405 "block_size": 512, 00:08:29.405 "num_blocks": 1048576, 00:08:29.405 "uuid": "7cd86443-172f-417a-970c-9d7cbeffe71a", 00:08:29.405 "assigned_rate_limits": { 00:08:29.405 "rw_ios_per_sec": 0, 00:08:29.405 "rw_mbytes_per_sec": 0, 00:08:29.405 "r_mbytes_per_sec": 0, 00:08:29.405 "w_mbytes_per_sec": 0 00:08:29.405 }, 00:08:29.405 "claimed": true, 00:08:29.405 "claim_type": "exclusive_write", 00:08:29.405 "zoned": false, 00:08:29.405 "supported_io_types": { 00:08:29.405 "read": true, 00:08:29.405 "write": true, 00:08:29.405 "unmap": true, 00:08:29.405 "write_zeroes": true, 00:08:29.405 "flush": true, 00:08:29.405 "reset": true, 00:08:29.405 "compare": false, 00:08:29.405 "compare_and_write": false, 00:08:29.405 "abort": true, 00:08:29.405 "nvme_admin": false, 00:08:29.405 "nvme_io": false 00:08:29.405 }, 00:08:29.405 "memory_domains": [ 00:08:29.405 { 00:08:29.405 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:29.405 "dma_device_type": 2 00:08:29.405 } 00:08:29.405 ], 00:08:29.405 "driver_specific": {} 00:08:29.405 } 00:08:29.405 ]' 00:08:29.405 17:28:06 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:29.405 17:28:06 -- common/autotest_common.sh@1372 -- # bs=512 00:08:29.405 17:28:06 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:29.405 17:28:06 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:29.405 17:28:06 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:29.405 17:28:06 -- common/autotest_common.sh@1377 -- # echo 512 00:08:29.405 17:28:06 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:29.405 17:28:06 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:30.342 17:28:07 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:30.342 17:28:07 -- common/autotest_common.sh@1187 -- # local i=0 00:08:30.342 17:28:07 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:30.342 17:28:07 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:30.342 17:28:07 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:32.308 17:28:09 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:32.308 17:28:09 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:32.308 17:28:09 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:32.308 17:28:09 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:32.308 17:28:09 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:32.308 17:28:09 -- common/autotest_common.sh@1197 -- # return 0 00:08:32.308 17:28:09 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:32.308 17:28:09 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:32.308 17:28:09 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:32.308 17:28:09 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:32.308 17:28:09 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:32.308 17:28:09 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:32.308 17:28:09 -- setup/common.sh@80 -- # echo 536870912 00:08:32.308 17:28:09 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:32.308 17:28:09 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:32.308 17:28:09 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:32.308 17:28:09 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:32.308 17:28:09 -- target/filesystem.sh@69 -- # partprobe 00:08:33.246 17:28:10 -- target/filesystem.sh@70 -- # sleep 1 00:08:34.184 17:28:11 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:34.184 17:28:11 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:34.184 17:28:11 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:34.184 17:28:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.184 17:28:11 -- common/autotest_common.sh@10 -- # set +x 00:08:34.184 ************************************ 00:08:34.184 START TEST filesystem_in_capsule_ext4 00:08:34.184 ************************************ 00:08:34.184 17:28:11 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:34.184 17:28:11 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:34.184 17:28:11 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:34.184 17:28:11 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:34.184 17:28:11 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:34.184 17:28:11 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:34.184 17:28:11 -- common/autotest_common.sh@914 -- # local i=0 00:08:34.184 17:28:11 -- common/autotest_common.sh@915 -- # local force 00:08:34.184 17:28:11 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:34.184 17:28:11 -- common/autotest_common.sh@918 -- # force=-F 00:08:34.184 17:28:11 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:34.184 mke2fs 1.47.0 (5-Feb-2023) 00:08:34.444 Discarding device blocks: 0/522240 done 00:08:34.445 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:34.445 Filesystem UUID: 2062375a-80c0-416d-9e88-26b8b4a9f621 00:08:34.445 Superblock backups stored on blocks: 00:08:34.445 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:34.445 00:08:34.445 Allocating group tables: 0/64 done 00:08:34.445 Writing inode tables: 0/64 done 00:08:35.383 Creating journal (8192 blocks): done 00:08:37.594 Writing superblocks and filesystem accounting information: 0/64 done 00:08:37.594 00:08:37.594 17:28:14 -- common/autotest_common.sh@931 -- # return 0 00:08:37.594 17:28:14 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:44.172 17:28:20 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:44.172 17:28:20 -- target/filesystem.sh@25 -- # sync 00:08:44.172 17:28:20 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:44.172 17:28:20 -- target/filesystem.sh@27 -- # sync 00:08:44.172 17:28:20 -- target/filesystem.sh@29 -- # i=0 00:08:44.172 17:28:20 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:44.172 17:28:20 -- target/filesystem.sh@37 -- # kill -0 1484157 00:08:44.172 17:28:20 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:44.172 17:28:20 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:44.172 17:28:20 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:44.172 17:28:20 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:44.172 00:08:44.172 real 0m8.886s 00:08:44.172 user 0m0.010s 00:08:44.172 sys 0m0.079s 00:08:44.172 17:28:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:44.172 17:28:20 -- common/autotest_common.sh@10 -- # set +x 00:08:44.172 ************************************ 00:08:44.172 END TEST filesystem_in_capsule_ext4 00:08:44.172 ************************************ 00:08:44.172 17:28:20 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:44.172 17:28:20 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:44.172 17:28:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:44.172 17:28:20 -- common/autotest_common.sh@10 -- # set +x 00:08:44.172 ************************************ 00:08:44.172 START TEST filesystem_in_capsule_btrfs 00:08:44.172 ************************************ 00:08:44.172 17:28:20 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:44.172 17:28:20 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:44.172 17:28:20 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:44.172 17:28:20 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:44.172 17:28:20 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:44.172 17:28:20 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:44.172 17:28:20 -- common/autotest_common.sh@914 -- # local i=0 00:08:44.172 17:28:20 -- common/autotest_common.sh@915 -- # local force 00:08:44.172 17:28:20 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:44.172 17:28:20 -- common/autotest_common.sh@920 -- # force=-f 00:08:44.172 17:28:20 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:44.172 btrfs-progs v6.8.1 00:08:44.172 See https://btrfs.readthedocs.io for more information. 00:08:44.172 00:08:44.172 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:44.172 NOTE: several default settings have changed in version 5.15, please make sure 00:08:44.172 this does not affect your deployments: 00:08:44.172 - DUP for metadata (-m dup) 00:08:44.172 - enabled no-holes (-O no-holes) 00:08:44.172 - enabled free-space-tree (-R free-space-tree) 00:08:44.172 00:08:44.172 Label: (null) 00:08:44.172 UUID: dd0e4868-44c4-42fb-b017-c50d78dd612b 00:08:44.172 Node size: 16384 00:08:44.172 Sector size: 4096 (CPU page size: 4096) 00:08:44.172 Filesystem size: 510.00MiB 00:08:44.172 Block group profiles: 00:08:44.172 Data: single 8.00MiB 00:08:44.172 Metadata: DUP 32.00MiB 00:08:44.172 System: DUP 8.00MiB 00:08:44.172 SSD detected: yes 00:08:44.172 Zoned device: no 00:08:44.172 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:44.172 Checksum: crc32c 00:08:44.172 Number of devices: 1 00:08:44.172 Devices: 00:08:44.172 ID SIZE PATH 00:08:44.172 1 510.00MiB /dev/nvme0n1p1 00:08:44.172 00:08:44.172 17:28:20 -- common/autotest_common.sh@931 -- # return 0 00:08:44.172 17:28:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:44.433 17:28:21 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:44.433 17:28:21 -- target/filesystem.sh@25 -- # sync 00:08:44.433 17:28:21 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:44.433 17:28:21 -- target/filesystem.sh@27 -- # sync 00:08:44.433 17:28:21 -- target/filesystem.sh@29 -- # i=0 00:08:44.433 17:28:21 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:44.433 17:28:21 -- target/filesystem.sh@37 -- # kill -0 1484157 00:08:44.433 17:28:21 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:44.433 17:28:21 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:44.433 17:28:21 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:44.433 17:28:21 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:44.433 00:08:44.433 real 0m1.169s 00:08:44.433 user 0m0.016s 00:08:44.433 sys 0m0.110s 00:08:44.433 17:28:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:44.433 17:28:21 -- common/autotest_common.sh@10 -- # set +x 00:08:44.433 ************************************ 00:08:44.433 END TEST filesystem_in_capsule_btrfs 00:08:44.433 ************************************ 00:08:44.433 17:28:21 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:44.433 17:28:21 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:44.433 17:28:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:44.433 17:28:21 -- common/autotest_common.sh@10 -- # set +x 00:08:44.433 ************************************ 00:08:44.433 START TEST filesystem_in_capsule_xfs 00:08:44.433 ************************************ 00:08:44.433 17:28:21 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:44.433 17:28:21 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:44.433 17:28:21 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:44.433 17:28:21 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:44.433 17:28:21 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:44.433 17:28:21 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:44.433 17:28:21 -- common/autotest_common.sh@914 -- # local i=0 00:08:44.433 17:28:21 -- common/autotest_common.sh@915 -- # local force 00:08:44.433 17:28:21 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:44.433 17:28:21 -- common/autotest_common.sh@920 -- # force=-f 00:08:44.433 17:28:21 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:44.433 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:44.433 = sectsz=512 attr=2, projid32bit=1 00:08:44.433 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:44.433 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:44.433 data = bsize=4096 blocks=130560, imaxpct=25 00:08:44.433 = sunit=0 swidth=0 blks 00:08:44.433 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:44.433 log =internal log bsize=4096 blocks=16384, version=2 00:08:44.433 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:44.433 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:45.368 Discarding blocks...Done. 00:08:45.368 17:28:22 -- common/autotest_common.sh@931 -- # return 0 00:08:45.368 17:28:22 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:47.902 17:28:25 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:47.902 17:28:25 -- target/filesystem.sh@25 -- # sync 00:08:47.902 17:28:25 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:47.902 17:28:25 -- target/filesystem.sh@27 -- # sync 00:08:47.902 17:28:25 -- target/filesystem.sh@29 -- # i=0 00:08:47.902 17:28:25 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:47.902 17:28:25 -- target/filesystem.sh@37 -- # kill -0 1484157 00:08:47.902 17:28:25 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:47.902 17:28:25 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:47.902 17:28:25 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:47.902 17:28:25 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:47.902 00:08:47.902 real 0m3.418s 00:08:47.902 user 0m0.017s 00:08:47.902 sys 0m0.064s 00:08:47.902 17:28:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:47.902 17:28:25 -- common/autotest_common.sh@10 -- # set +x 00:08:47.902 ************************************ 00:08:47.902 END TEST filesystem_in_capsule_xfs 00:08:47.902 ************************************ 00:08:47.902 17:28:25 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:48.161 17:28:25 -- target/filesystem.sh@93 -- # sync 00:08:48.162 17:28:25 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:48.162 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.162 17:28:25 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:48.162 17:28:25 -- common/autotest_common.sh@1208 -- # local i=0 00:08:48.162 17:28:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:48.162 17:28:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:48.162 17:28:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:48.162 17:28:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:48.162 17:28:25 -- common/autotest_common.sh@1220 -- # return 0 00:08:48.162 17:28:25 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:48.162 17:28:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:48.162 17:28:25 -- common/autotest_common.sh@10 -- # set +x 00:08:48.162 17:28:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:48.162 17:28:25 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:48.162 17:28:25 -- target/filesystem.sh@101 -- # killprocess 1484157 00:08:48.162 17:28:25 -- common/autotest_common.sh@936 -- # '[' -z 1484157 ']' 00:08:48.162 17:28:25 -- common/autotest_common.sh@940 -- # kill -0 1484157 00:08:48.419 17:28:25 -- common/autotest_common.sh@941 -- # uname 00:08:48.419 17:28:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:48.419 17:28:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1484157 00:08:48.419 17:28:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:48.419 17:28:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:48.419 17:28:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1484157' 00:08:48.419 killing process with pid 1484157 00:08:48.419 17:28:25 -- common/autotest_common.sh@955 -- # kill 1484157 00:08:48.419 17:28:25 -- common/autotest_common.sh@960 -- # wait 1484157 00:08:48.677 17:28:26 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:48.677 00:08:48.677 real 0m20.681s 00:08:48.677 user 1m20.268s 00:08:48.677 sys 0m2.487s 00:08:48.677 17:28:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:48.677 17:28:26 -- common/autotest_common.sh@10 -- # set +x 00:08:48.677 ************************************ 00:08:48.677 END TEST nvmf_filesystem_in_capsule 00:08:48.677 ************************************ 00:08:48.677 17:28:26 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:48.677 17:28:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:48.677 17:28:26 -- nvmf/common.sh@116 -- # sync 00:08:48.677 17:28:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:48.677 17:28:26 -- nvmf/common.sh@119 -- # set +e 00:08:48.677 17:28:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:48.677 17:28:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:48.677 rmmod nvme_tcp 00:08:48.677 rmmod nvme_fabrics 00:08:48.938 rmmod nvme_keyring 00:08:48.938 17:28:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:48.938 17:28:26 -- nvmf/common.sh@123 -- # set -e 00:08:48.938 17:28:26 -- nvmf/common.sh@124 -- # return 0 00:08:48.938 17:28:26 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:48.938 17:28:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:48.938 17:28:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:48.938 17:28:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:48.938 17:28:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:48.938 17:28:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:48.938 17:28:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:48.938 17:28:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:48.938 17:28:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:50.848 17:28:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:50.848 00:08:50.848 real 0m43.094s 00:08:50.848 user 2m29.202s 00:08:50.848 sys 0m6.377s 00:08:50.848 17:28:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:50.848 17:28:28 -- common/autotest_common.sh@10 -- # set +x 00:08:50.848 ************************************ 00:08:50.848 END TEST nvmf_filesystem 00:08:50.848 ************************************ 00:08:50.848 17:28:28 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:50.848 17:28:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:50.848 17:28:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:50.848 17:28:28 -- common/autotest_common.sh@10 -- # set +x 00:08:50.848 ************************************ 00:08:50.848 START TEST nvmf_discovery 00:08:50.848 ************************************ 00:08:50.848 17:28:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:50.848 * Looking for test storage... 00:08:50.848 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:50.848 17:28:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:50.848 17:28:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:50.848 17:28:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:51.108 17:28:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:51.108 17:28:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:51.108 17:28:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:51.108 17:28:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:51.108 17:28:28 -- scripts/common.sh@335 -- # IFS=.-: 00:08:51.108 17:28:28 -- scripts/common.sh@335 -- # read -ra ver1 00:08:51.108 17:28:28 -- scripts/common.sh@336 -- # IFS=.-: 00:08:51.108 17:28:28 -- scripts/common.sh@336 -- # read -ra ver2 00:08:51.108 17:28:28 -- scripts/common.sh@337 -- # local 'op=<' 00:08:51.108 17:28:28 -- scripts/common.sh@339 -- # ver1_l=2 00:08:51.108 17:28:28 -- scripts/common.sh@340 -- # ver2_l=1 00:08:51.108 17:28:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:51.108 17:28:28 -- scripts/common.sh@343 -- # case "$op" in 00:08:51.108 17:28:28 -- scripts/common.sh@344 -- # : 1 00:08:51.108 17:28:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:51.108 17:28:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:51.108 17:28:28 -- scripts/common.sh@364 -- # decimal 1 00:08:51.108 17:28:28 -- scripts/common.sh@352 -- # local d=1 00:08:51.108 17:28:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:51.108 17:28:28 -- scripts/common.sh@354 -- # echo 1 00:08:51.108 17:28:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:51.108 17:28:28 -- scripts/common.sh@365 -- # decimal 2 00:08:51.108 17:28:28 -- scripts/common.sh@352 -- # local d=2 00:08:51.108 17:28:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:51.108 17:28:28 -- scripts/common.sh@354 -- # echo 2 00:08:51.108 17:28:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:51.108 17:28:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:51.108 17:28:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:51.108 17:28:28 -- scripts/common.sh@367 -- # return 0 00:08:51.108 17:28:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:51.108 17:28:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:51.108 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.108 --rc genhtml_branch_coverage=1 00:08:51.108 --rc genhtml_function_coverage=1 00:08:51.108 --rc genhtml_legend=1 00:08:51.108 --rc geninfo_all_blocks=1 00:08:51.108 --rc geninfo_unexecuted_blocks=1 00:08:51.108 00:08:51.108 ' 00:08:51.108 17:28:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:51.108 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.108 --rc genhtml_branch_coverage=1 00:08:51.108 --rc genhtml_function_coverage=1 00:08:51.108 --rc genhtml_legend=1 00:08:51.108 --rc geninfo_all_blocks=1 00:08:51.108 --rc geninfo_unexecuted_blocks=1 00:08:51.108 00:08:51.108 ' 00:08:51.108 17:28:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:51.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.109 --rc genhtml_branch_coverage=1 00:08:51.109 --rc genhtml_function_coverage=1 00:08:51.109 --rc genhtml_legend=1 00:08:51.109 --rc geninfo_all_blocks=1 00:08:51.109 --rc geninfo_unexecuted_blocks=1 00:08:51.109 00:08:51.109 ' 00:08:51.109 17:28:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:51.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:51.109 --rc genhtml_branch_coverage=1 00:08:51.109 --rc genhtml_function_coverage=1 00:08:51.109 --rc genhtml_legend=1 00:08:51.109 --rc geninfo_all_blocks=1 00:08:51.109 --rc geninfo_unexecuted_blocks=1 00:08:51.109 00:08:51.109 ' 00:08:51.109 17:28:28 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:51.109 17:28:28 -- nvmf/common.sh@7 -- # uname -s 00:08:51.109 17:28:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:51.109 17:28:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:51.109 17:28:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:51.109 17:28:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:51.109 17:28:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:51.109 17:28:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:51.109 17:28:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:51.109 17:28:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:51.109 17:28:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:51.109 17:28:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:51.109 17:28:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:51.109 17:28:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:51.109 17:28:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:51.109 17:28:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:51.109 17:28:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:51.109 17:28:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:51.109 17:28:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:51.109 17:28:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:51.109 17:28:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:51.109 17:28:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.109 17:28:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.109 17:28:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.109 17:28:28 -- paths/export.sh@5 -- # export PATH 00:08:51.109 17:28:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:51.109 17:28:28 -- nvmf/common.sh@46 -- # : 0 00:08:51.109 17:28:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:51.109 17:28:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:51.109 17:28:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:51.109 17:28:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:51.109 17:28:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:51.109 17:28:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:51.109 17:28:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:51.109 17:28:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:51.109 17:28:28 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:51.109 17:28:28 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:51.109 17:28:28 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:51.109 17:28:28 -- target/discovery.sh@15 -- # hash nvme 00:08:51.109 17:28:28 -- target/discovery.sh@20 -- # nvmftestinit 00:08:51.109 17:28:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:51.109 17:28:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:51.109 17:28:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:51.109 17:28:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:51.109 17:28:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:51.109 17:28:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:51.109 17:28:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:51.109 17:28:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:51.109 17:28:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:51.109 17:28:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:51.109 17:28:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:51.109 17:28:28 -- common/autotest_common.sh@10 -- # set +x 00:08:53.648 17:28:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:53.648 17:28:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:53.648 17:28:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:53.648 17:28:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:53.648 17:28:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:53.648 17:28:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:53.648 17:28:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:53.648 17:28:30 -- nvmf/common.sh@294 -- # net_devs=() 00:08:53.648 17:28:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:53.648 17:28:30 -- nvmf/common.sh@295 -- # e810=() 00:08:53.648 17:28:30 -- nvmf/common.sh@295 -- # local -ga e810 00:08:53.648 17:28:30 -- nvmf/common.sh@296 -- # x722=() 00:08:53.648 17:28:30 -- nvmf/common.sh@296 -- # local -ga x722 00:08:53.648 17:28:30 -- nvmf/common.sh@297 -- # mlx=() 00:08:53.648 17:28:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:53.648 17:28:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:53.648 17:28:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:53.648 17:28:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:53.649 17:28:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:53.649 17:28:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:53.649 17:28:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:53.649 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:53.649 17:28:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:53.649 17:28:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:53.649 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:53.649 17:28:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:53.649 17:28:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:53.649 17:28:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:53.649 17:28:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:53.649 17:28:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:53.649 17:28:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:53.649 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:53.649 17:28:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:53.649 17:28:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:53.649 17:28:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:53.649 17:28:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:53.649 17:28:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:53.649 17:28:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:53.649 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:53.649 17:28:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:53.649 17:28:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:53.649 17:28:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:53.649 17:28:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:53.649 17:28:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:53.649 17:28:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:53.649 17:28:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:53.649 17:28:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:53.649 17:28:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:53.649 17:28:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:53.649 17:28:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:53.649 17:28:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:53.649 17:28:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:53.649 17:28:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:53.649 17:28:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:53.649 17:28:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:53.649 17:28:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:53.649 17:28:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:53.649 17:28:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:53.649 17:28:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:53.649 17:28:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:53.649 17:28:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:53.649 17:28:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:53.649 17:28:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:53.649 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:53.649 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:08:53.649 00:08:53.649 --- 10.0.0.2 ping statistics --- 00:08:53.649 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:53.649 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:08:53.649 17:28:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:53.649 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:53.649 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:08:53.649 00:08:53.649 --- 10.0.0.1 ping statistics --- 00:08:53.649 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:53.649 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:08:53.649 17:28:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:53.649 17:28:30 -- nvmf/common.sh@410 -- # return 0 00:08:53.649 17:28:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:53.649 17:28:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:53.649 17:28:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:53.649 17:28:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:53.649 17:28:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:53.649 17:28:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:53.649 17:28:30 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:53.649 17:28:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:53.649 17:28:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:53.649 17:28:30 -- common/autotest_common.sh@10 -- # set +x 00:08:53.649 17:28:30 -- nvmf/common.sh@469 -- # nvmfpid=1488811 00:08:53.649 17:28:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:53.649 17:28:30 -- nvmf/common.sh@470 -- # waitforlisten 1488811 00:08:53.649 17:28:30 -- common/autotest_common.sh@829 -- # '[' -z 1488811 ']' 00:08:53.649 17:28:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:53.649 17:28:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:53.649 17:28:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:53.649 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:53.649 17:28:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:53.649 17:28:30 -- common/autotest_common.sh@10 -- # set +x 00:08:53.649 [2024-11-16 17:28:30.904698] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:53.649 [2024-11-16 17:28:30.904769] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:53.649 EAL: No free 2048 kB hugepages reported on node 1 00:08:53.649 [2024-11-16 17:28:30.974312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:53.649 [2024-11-16 17:28:31.066358] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:53.649 [2024-11-16 17:28:31.066523] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:53.649 [2024-11-16 17:28:31.066543] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:53.649 [2024-11-16 17:28:31.066558] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:53.649 [2024-11-16 17:28:31.066646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:53.649 [2024-11-16 17:28:31.066678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:53.649 [2024-11-16 17:28:31.066731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:53.649 [2024-11-16 17:28:31.066733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:54.589 17:28:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:54.589 17:28:31 -- common/autotest_common.sh@862 -- # return 0 00:08:54.589 17:28:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:54.589 17:28:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 17:28:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:54.589 17:28:31 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 [2024-11-16 17:28:31.932420] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:54.589 17:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:31 -- target/discovery.sh@26 -- # seq 1 4 00:08:54.589 17:28:31 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:54.589 17:28:31 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 Null1 00:08:54.589 17:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:31 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 17:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:31 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 17:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:31 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 [2024-11-16 17:28:31.972759] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:54.589 17:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:31 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:54.589 17:28:31 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 Null2 00:08:54.589 17:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:31 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 17:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:31 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 17:28:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:31 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:54.589 17:28:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:31 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:54.589 17:28:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:54.589 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 Null3 00:08:54.589 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.589 17:28:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:54.589 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.589 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.589 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.590 17:28:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:54.590 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.590 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.590 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.590 17:28:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:54.590 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.590 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.590 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.590 17:28:32 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:54.590 17:28:32 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:54.590 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.590 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.590 Null4 00:08:54.590 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.590 17:28:32 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:54.590 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.590 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.590 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.590 17:28:32 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:54.590 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.590 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.590 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.590 17:28:32 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:54.590 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.590 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.590 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.590 17:28:32 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:54.590 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.590 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.590 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.850 17:28:32 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:54.850 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.850 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.850 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.850 17:28:32 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:54.850 00:08:54.850 Discovery Log Number of Records 6, Generation counter 6 00:08:54.850 =====Discovery Log Entry 0====== 00:08:54.850 trtype: tcp 00:08:54.850 adrfam: ipv4 00:08:54.850 subtype: current discovery subsystem 00:08:54.850 treq: not required 00:08:54.850 portid: 0 00:08:54.850 trsvcid: 4420 00:08:54.850 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:54.850 traddr: 10.0.0.2 00:08:54.850 eflags: explicit discovery connections, duplicate discovery information 00:08:54.850 sectype: none 00:08:54.850 =====Discovery Log Entry 1====== 00:08:54.850 trtype: tcp 00:08:54.850 adrfam: ipv4 00:08:54.850 subtype: nvme subsystem 00:08:54.850 treq: not required 00:08:54.850 portid: 0 00:08:54.850 trsvcid: 4420 00:08:54.850 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:54.850 traddr: 10.0.0.2 00:08:54.850 eflags: none 00:08:54.850 sectype: none 00:08:54.850 =====Discovery Log Entry 2====== 00:08:54.850 trtype: tcp 00:08:54.850 adrfam: ipv4 00:08:54.850 subtype: nvme subsystem 00:08:54.850 treq: not required 00:08:54.850 portid: 0 00:08:54.850 trsvcid: 4420 00:08:54.850 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:54.850 traddr: 10.0.0.2 00:08:54.850 eflags: none 00:08:54.850 sectype: none 00:08:54.850 =====Discovery Log Entry 3====== 00:08:54.850 trtype: tcp 00:08:54.850 adrfam: ipv4 00:08:54.850 subtype: nvme subsystem 00:08:54.850 treq: not required 00:08:54.850 portid: 0 00:08:54.850 trsvcid: 4420 00:08:54.850 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:54.850 traddr: 10.0.0.2 00:08:54.850 eflags: none 00:08:54.850 sectype: none 00:08:54.850 =====Discovery Log Entry 4====== 00:08:54.850 trtype: tcp 00:08:54.850 adrfam: ipv4 00:08:54.850 subtype: nvme subsystem 00:08:54.850 treq: not required 00:08:54.850 portid: 0 00:08:54.850 trsvcid: 4420 00:08:54.850 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:54.850 traddr: 10.0.0.2 00:08:54.850 eflags: none 00:08:54.850 sectype: none 00:08:54.850 =====Discovery Log Entry 5====== 00:08:54.850 trtype: tcp 00:08:54.850 adrfam: ipv4 00:08:54.850 subtype: discovery subsystem referral 00:08:54.850 treq: not required 00:08:54.850 portid: 0 00:08:54.850 trsvcid: 4430 00:08:54.850 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:54.850 traddr: 10.0.0.2 00:08:54.850 eflags: none 00:08:54.850 sectype: none 00:08:54.850 17:28:32 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:54.850 Perform nvmf subsystem discovery via RPC 00:08:54.850 17:28:32 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:54.850 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.850 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.851 [2024-11-16 17:28:32.305675] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:54.851 [ 00:08:54.851 { 00:08:54.851 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:54.851 "subtype": "Discovery", 00:08:54.851 "listen_addresses": [ 00:08:54.851 { 00:08:54.851 "transport": "TCP", 00:08:54.851 "trtype": "TCP", 00:08:54.851 "adrfam": "IPv4", 00:08:54.851 "traddr": "10.0.0.2", 00:08:54.851 "trsvcid": "4420" 00:08:54.851 } 00:08:54.851 ], 00:08:54.851 "allow_any_host": true, 00:08:54.851 "hosts": [] 00:08:54.851 }, 00:08:54.851 { 00:08:54.851 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:54.851 "subtype": "NVMe", 00:08:54.851 "listen_addresses": [ 00:08:54.851 { 00:08:54.851 "transport": "TCP", 00:08:54.851 "trtype": "TCP", 00:08:54.851 "adrfam": "IPv4", 00:08:54.851 "traddr": "10.0.0.2", 00:08:54.851 "trsvcid": "4420" 00:08:54.851 } 00:08:54.851 ], 00:08:54.851 "allow_any_host": true, 00:08:54.851 "hosts": [], 00:08:54.851 "serial_number": "SPDK00000000000001", 00:08:54.851 "model_number": "SPDK bdev Controller", 00:08:54.851 "max_namespaces": 32, 00:08:54.851 "min_cntlid": 1, 00:08:54.851 "max_cntlid": 65519, 00:08:54.851 "namespaces": [ 00:08:54.851 { 00:08:54.851 "nsid": 1, 00:08:54.851 "bdev_name": "Null1", 00:08:54.851 "name": "Null1", 00:08:54.851 "nguid": "B4C0F676E1784E5F8106DCAE72A0BF0B", 00:08:54.851 "uuid": "b4c0f676-e178-4e5f-8106-dcae72a0bf0b" 00:08:54.851 } 00:08:54.851 ] 00:08:54.851 }, 00:08:54.851 { 00:08:54.851 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:54.851 "subtype": "NVMe", 00:08:54.851 "listen_addresses": [ 00:08:54.851 { 00:08:54.851 "transport": "TCP", 00:08:54.851 "trtype": "TCP", 00:08:54.851 "adrfam": "IPv4", 00:08:54.851 "traddr": "10.0.0.2", 00:08:54.851 "trsvcid": "4420" 00:08:54.851 } 00:08:54.851 ], 00:08:54.851 "allow_any_host": true, 00:08:54.851 "hosts": [], 00:08:54.851 "serial_number": "SPDK00000000000002", 00:08:54.851 "model_number": "SPDK bdev Controller", 00:08:54.851 "max_namespaces": 32, 00:08:54.851 "min_cntlid": 1, 00:08:54.851 "max_cntlid": 65519, 00:08:54.851 "namespaces": [ 00:08:54.851 { 00:08:54.851 "nsid": 1, 00:08:54.851 "bdev_name": "Null2", 00:08:54.851 "name": "Null2", 00:08:54.851 "nguid": "D16576EC96AA4F90B66E3E7AF0451250", 00:08:54.851 "uuid": "d16576ec-96aa-4f90-b66e-3e7af0451250" 00:08:54.851 } 00:08:54.851 ] 00:08:54.851 }, 00:08:54.851 { 00:08:54.851 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:54.851 "subtype": "NVMe", 00:08:54.851 "listen_addresses": [ 00:08:54.851 { 00:08:54.851 "transport": "TCP", 00:08:54.851 "trtype": "TCP", 00:08:54.851 "adrfam": "IPv4", 00:08:54.851 "traddr": "10.0.0.2", 00:08:54.851 "trsvcid": "4420" 00:08:54.851 } 00:08:54.851 ], 00:08:54.851 "allow_any_host": true, 00:08:54.851 "hosts": [], 00:08:54.851 "serial_number": "SPDK00000000000003", 00:08:54.851 "model_number": "SPDK bdev Controller", 00:08:54.851 "max_namespaces": 32, 00:08:54.851 "min_cntlid": 1, 00:08:54.851 "max_cntlid": 65519, 00:08:54.851 "namespaces": [ 00:08:54.851 { 00:08:54.851 "nsid": 1, 00:08:54.851 "bdev_name": "Null3", 00:08:54.851 "name": "Null3", 00:08:54.851 "nguid": "D3B24B5B0A0B433AB8F11753205688CC", 00:08:54.851 "uuid": "d3b24b5b-0a0b-433a-b8f1-1753205688cc" 00:08:54.851 } 00:08:54.851 ] 00:08:54.851 }, 00:08:54.851 { 00:08:54.851 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:54.851 "subtype": "NVMe", 00:08:54.851 "listen_addresses": [ 00:08:54.851 { 00:08:54.851 "transport": "TCP", 00:08:54.851 "trtype": "TCP", 00:08:54.851 "adrfam": "IPv4", 00:08:54.851 "traddr": "10.0.0.2", 00:08:54.851 "trsvcid": "4420" 00:08:54.851 } 00:08:54.851 ], 00:08:54.851 "allow_any_host": true, 00:08:54.851 "hosts": [], 00:08:54.851 "serial_number": "SPDK00000000000004", 00:08:54.851 "model_number": "SPDK bdev Controller", 00:08:54.851 "max_namespaces": 32, 00:08:54.851 "min_cntlid": 1, 00:08:54.851 "max_cntlid": 65519, 00:08:54.851 "namespaces": [ 00:08:54.851 { 00:08:54.851 "nsid": 1, 00:08:54.851 "bdev_name": "Null4", 00:08:54.851 "name": "Null4", 00:08:54.851 "nguid": "B04272161B64468DA4A41255EA2A467C", 00:08:54.851 "uuid": "b0427216-1b64-468d-a4a4-1255ea2a467c" 00:08:54.851 } 00:08:54.851 ] 00:08:54.851 } 00:08:54.851 ] 00:08:54.851 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.851 17:28:32 -- target/discovery.sh@42 -- # seq 1 4 00:08:54.851 17:28:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:54.851 17:28:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:54.851 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.851 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.851 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.851 17:28:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:54.851 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:54.851 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:54.851 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:54.851 17:28:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:54.851 17:28:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:54.851 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.111 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:55.111 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.111 17:28:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:55.111 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.111 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:55.111 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.111 17:28:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:55.111 17:28:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:55.111 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.111 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:55.111 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.111 17:28:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:55.111 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.111 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:55.111 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.111 17:28:32 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:55.111 17:28:32 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:55.111 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.111 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:55.111 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.111 17:28:32 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:55.111 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.111 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:55.111 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.111 17:28:32 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:55.111 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.111 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:55.111 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.111 17:28:32 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:55.111 17:28:32 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:55.111 17:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:55.111 17:28:32 -- common/autotest_common.sh@10 -- # set +x 00:08:55.111 17:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:55.111 17:28:32 -- target/discovery.sh@49 -- # check_bdevs= 00:08:55.111 17:28:32 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:55.111 17:28:32 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:55.111 17:28:32 -- target/discovery.sh@57 -- # nvmftestfini 00:08:55.111 17:28:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:55.111 17:28:32 -- nvmf/common.sh@116 -- # sync 00:08:55.111 17:28:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:55.111 17:28:32 -- nvmf/common.sh@119 -- # set +e 00:08:55.111 17:28:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:55.111 17:28:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:55.111 rmmod nvme_tcp 00:08:55.111 rmmod nvme_fabrics 00:08:55.111 rmmod nvme_keyring 00:08:55.111 17:28:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:55.111 17:28:32 -- nvmf/common.sh@123 -- # set -e 00:08:55.111 17:28:32 -- nvmf/common.sh@124 -- # return 0 00:08:55.111 17:28:32 -- nvmf/common.sh@477 -- # '[' -n 1488811 ']' 00:08:55.111 17:28:32 -- nvmf/common.sh@478 -- # killprocess 1488811 00:08:55.111 17:28:32 -- common/autotest_common.sh@936 -- # '[' -z 1488811 ']' 00:08:55.111 17:28:32 -- common/autotest_common.sh@940 -- # kill -0 1488811 00:08:55.111 17:28:32 -- common/autotest_common.sh@941 -- # uname 00:08:55.111 17:28:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:55.111 17:28:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1488811 00:08:55.111 17:28:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:55.111 17:28:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:55.111 17:28:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1488811' 00:08:55.111 killing process with pid 1488811 00:08:55.111 17:28:32 -- common/autotest_common.sh@955 -- # kill 1488811 00:08:55.111 [2024-11-16 17:28:32.536851] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:55.111 17:28:32 -- common/autotest_common.sh@960 -- # wait 1488811 00:08:55.370 17:28:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:55.370 17:28:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:55.370 17:28:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:55.370 17:28:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:55.370 17:28:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:55.370 17:28:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:55.370 17:28:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:55.370 17:28:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:57.905 17:28:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:57.905 00:08:57.905 real 0m6.532s 00:08:57.905 user 0m7.917s 00:08:57.905 sys 0m2.004s 00:08:57.905 17:28:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:57.905 17:28:34 -- common/autotest_common.sh@10 -- # set +x 00:08:57.905 ************************************ 00:08:57.905 END TEST nvmf_discovery 00:08:57.905 ************************************ 00:08:57.905 17:28:34 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:57.905 17:28:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:57.905 17:28:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:57.905 17:28:34 -- common/autotest_common.sh@10 -- # set +x 00:08:57.905 ************************************ 00:08:57.905 START TEST nvmf_referrals 00:08:57.905 ************************************ 00:08:57.905 17:28:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:57.905 * Looking for test storage... 00:08:57.905 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:57.905 17:28:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:57.905 17:28:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:57.905 17:28:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:57.905 17:28:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:57.905 17:28:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:57.905 17:28:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:57.905 17:28:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:57.905 17:28:34 -- scripts/common.sh@335 -- # IFS=.-: 00:08:57.905 17:28:34 -- scripts/common.sh@335 -- # read -ra ver1 00:08:57.905 17:28:34 -- scripts/common.sh@336 -- # IFS=.-: 00:08:57.905 17:28:34 -- scripts/common.sh@336 -- # read -ra ver2 00:08:57.905 17:28:34 -- scripts/common.sh@337 -- # local 'op=<' 00:08:57.905 17:28:34 -- scripts/common.sh@339 -- # ver1_l=2 00:08:57.905 17:28:34 -- scripts/common.sh@340 -- # ver2_l=1 00:08:57.905 17:28:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:57.905 17:28:34 -- scripts/common.sh@343 -- # case "$op" in 00:08:57.905 17:28:34 -- scripts/common.sh@344 -- # : 1 00:08:57.905 17:28:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:57.905 17:28:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:57.905 17:28:34 -- scripts/common.sh@364 -- # decimal 1 00:08:57.905 17:28:34 -- scripts/common.sh@352 -- # local d=1 00:08:57.905 17:28:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:57.905 17:28:34 -- scripts/common.sh@354 -- # echo 1 00:08:57.905 17:28:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:57.905 17:28:34 -- scripts/common.sh@365 -- # decimal 2 00:08:57.905 17:28:34 -- scripts/common.sh@352 -- # local d=2 00:08:57.905 17:28:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:57.905 17:28:34 -- scripts/common.sh@354 -- # echo 2 00:08:57.905 17:28:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:57.905 17:28:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:57.905 17:28:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:57.905 17:28:34 -- scripts/common.sh@367 -- # return 0 00:08:57.905 17:28:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:57.905 17:28:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:57.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.905 --rc genhtml_branch_coverage=1 00:08:57.905 --rc genhtml_function_coverage=1 00:08:57.905 --rc genhtml_legend=1 00:08:57.905 --rc geninfo_all_blocks=1 00:08:57.905 --rc geninfo_unexecuted_blocks=1 00:08:57.905 00:08:57.905 ' 00:08:57.905 17:28:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:57.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.905 --rc genhtml_branch_coverage=1 00:08:57.905 --rc genhtml_function_coverage=1 00:08:57.905 --rc genhtml_legend=1 00:08:57.905 --rc geninfo_all_blocks=1 00:08:57.905 --rc geninfo_unexecuted_blocks=1 00:08:57.905 00:08:57.905 ' 00:08:57.905 17:28:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:57.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.905 --rc genhtml_branch_coverage=1 00:08:57.905 --rc genhtml_function_coverage=1 00:08:57.905 --rc genhtml_legend=1 00:08:57.905 --rc geninfo_all_blocks=1 00:08:57.905 --rc geninfo_unexecuted_blocks=1 00:08:57.905 00:08:57.905 ' 00:08:57.905 17:28:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:57.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:57.905 --rc genhtml_branch_coverage=1 00:08:57.905 --rc genhtml_function_coverage=1 00:08:57.905 --rc genhtml_legend=1 00:08:57.905 --rc geninfo_all_blocks=1 00:08:57.905 --rc geninfo_unexecuted_blocks=1 00:08:57.905 00:08:57.905 ' 00:08:57.905 17:28:34 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:57.905 17:28:34 -- nvmf/common.sh@7 -- # uname -s 00:08:57.905 17:28:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:57.905 17:28:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:57.905 17:28:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:57.905 17:28:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:57.905 17:28:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:57.905 17:28:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:57.905 17:28:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:57.905 17:28:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:57.905 17:28:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:57.905 17:28:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:57.905 17:28:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:57.905 17:28:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:57.905 17:28:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:57.905 17:28:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:57.905 17:28:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:57.905 17:28:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:57.905 17:28:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:57.905 17:28:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:57.905 17:28:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:57.905 17:28:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.905 17:28:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.905 17:28:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.905 17:28:34 -- paths/export.sh@5 -- # export PATH 00:08:57.905 17:28:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:57.905 17:28:34 -- nvmf/common.sh@46 -- # : 0 00:08:57.905 17:28:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:57.905 17:28:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:57.905 17:28:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:57.905 17:28:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:57.905 17:28:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:57.905 17:28:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:57.905 17:28:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:57.905 17:28:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:57.905 17:28:34 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:57.905 17:28:34 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:57.905 17:28:34 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:57.905 17:28:34 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:57.905 17:28:34 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:57.905 17:28:34 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:57.905 17:28:34 -- target/referrals.sh@37 -- # nvmftestinit 00:08:57.905 17:28:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:57.905 17:28:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:57.905 17:28:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:57.905 17:28:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:57.905 17:28:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:57.905 17:28:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:57.906 17:28:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:57.906 17:28:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:57.906 17:28:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:57.906 17:28:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:57.906 17:28:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:57.906 17:28:35 -- common/autotest_common.sh@10 -- # set +x 00:08:59.811 17:28:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:59.811 17:28:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:59.811 17:28:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:59.811 17:28:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:59.811 17:28:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:59.811 17:28:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:59.811 17:28:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:59.811 17:28:37 -- nvmf/common.sh@294 -- # net_devs=() 00:08:59.811 17:28:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:59.811 17:28:37 -- nvmf/common.sh@295 -- # e810=() 00:08:59.811 17:28:37 -- nvmf/common.sh@295 -- # local -ga e810 00:08:59.811 17:28:37 -- nvmf/common.sh@296 -- # x722=() 00:08:59.811 17:28:37 -- nvmf/common.sh@296 -- # local -ga x722 00:08:59.811 17:28:37 -- nvmf/common.sh@297 -- # mlx=() 00:08:59.811 17:28:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:59.811 17:28:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:59.811 17:28:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:59.811 17:28:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:59.811 17:28:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:59.811 17:28:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:59.811 17:28:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:59.811 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:59.811 17:28:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:59.811 17:28:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:59.811 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:59.811 17:28:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:59.811 17:28:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:59.811 17:28:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:59.811 17:28:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:59.811 17:28:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:59.811 17:28:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:59.811 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:59.811 17:28:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:59.811 17:28:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:59.811 17:28:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:59.811 17:28:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:59.811 17:28:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:59.811 17:28:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:59.811 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:59.811 17:28:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:59.811 17:28:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:59.811 17:28:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:59.811 17:28:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:59.811 17:28:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:59.811 17:28:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:59.811 17:28:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:59.811 17:28:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:59.811 17:28:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:59.811 17:28:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:59.811 17:28:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:59.811 17:28:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:59.811 17:28:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:59.811 17:28:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:59.811 17:28:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:59.811 17:28:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:59.811 17:28:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:59.811 17:28:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:59.811 17:28:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:59.811 17:28:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:59.811 17:28:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:59.811 17:28:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:59.811 17:28:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:00.071 17:28:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:00.071 17:28:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:00.071 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:00.071 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.185 ms 00:09:00.071 00:09:00.071 --- 10.0.0.2 ping statistics --- 00:09:00.071 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:00.071 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:09:00.071 17:28:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:00.071 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:00.071 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:09:00.071 00:09:00.071 --- 10.0.0.1 ping statistics --- 00:09:00.071 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:00.071 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:09:00.071 17:28:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:00.071 17:28:37 -- nvmf/common.sh@410 -- # return 0 00:09:00.071 17:28:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:00.071 17:28:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:00.071 17:28:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:00.071 17:28:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:00.071 17:28:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:00.071 17:28:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:00.071 17:28:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:00.071 17:28:37 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:00.071 17:28:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:00.071 17:28:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:00.071 17:28:37 -- common/autotest_common.sh@10 -- # set +x 00:09:00.071 17:28:37 -- nvmf/common.sh@469 -- # nvmfpid=1491051 00:09:00.071 17:28:37 -- nvmf/common.sh@470 -- # waitforlisten 1491051 00:09:00.071 17:28:37 -- common/autotest_common.sh@829 -- # '[' -z 1491051 ']' 00:09:00.071 17:28:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:00.071 17:28:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:00.071 17:28:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:00.071 17:28:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:00.071 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:00.071 17:28:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:00.071 17:28:37 -- common/autotest_common.sh@10 -- # set +x 00:09:00.071 [2024-11-16 17:28:37.394966] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:00.071 [2024-11-16 17:28:37.395044] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:00.071 EAL: No free 2048 kB hugepages reported on node 1 00:09:00.071 [2024-11-16 17:28:37.467629] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:00.071 [2024-11-16 17:28:37.560648] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:00.071 [2024-11-16 17:28:37.560812] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:00.071 [2024-11-16 17:28:37.560851] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:00.071 [2024-11-16 17:28:37.560866] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:00.071 [2024-11-16 17:28:37.560978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:00.071 [2024-11-16 17:28:37.561035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:00.071 [2024-11-16 17:28:37.561091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:00.071 [2024-11-16 17:28:37.561094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:01.006 17:28:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:01.006 17:28:38 -- common/autotest_common.sh@862 -- # return 0 00:09:01.006 17:28:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:01.006 17:28:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:01.006 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.006 17:28:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:01.006 17:28:38 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:01.006 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.006 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.006 [2024-11-16 17:28:38.433367] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:01.006 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.006 17:28:38 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:01.006 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.006 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.006 [2024-11-16 17:28:38.445562] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:01.006 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.006 17:28:38 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:01.006 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.006 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.006 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.006 17:28:38 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:01.006 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.006 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.006 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.006 17:28:38 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:01.006 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.006 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.006 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.006 17:28:38 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:01.006 17:28:38 -- target/referrals.sh@48 -- # jq length 00:09:01.006 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.006 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.006 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.267 17:28:38 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:01.267 17:28:38 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:01.267 17:28:38 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:01.267 17:28:38 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:01.267 17:28:38 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:01.267 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.267 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.267 17:28:38 -- target/referrals.sh@21 -- # sort 00:09:01.267 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.267 17:28:38 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:01.267 17:28:38 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:01.267 17:28:38 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:01.267 17:28:38 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:01.267 17:28:38 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:01.267 17:28:38 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.267 17:28:38 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:01.267 17:28:38 -- target/referrals.sh@26 -- # sort 00:09:01.528 17:28:38 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:01.528 17:28:38 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:01.528 17:28:38 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:01.528 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.528 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.528 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.528 17:28:38 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:01.528 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.528 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.528 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.528 17:28:38 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:01.528 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.528 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.528 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.528 17:28:38 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:01.528 17:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.528 17:28:38 -- target/referrals.sh@56 -- # jq length 00:09:01.528 17:28:38 -- common/autotest_common.sh@10 -- # set +x 00:09:01.528 17:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.528 17:28:38 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:01.528 17:28:38 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:01.528 17:28:38 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:01.529 17:28:38 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:01.529 17:28:38 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.529 17:28:38 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:01.529 17:28:38 -- target/referrals.sh@26 -- # sort 00:09:01.800 17:28:39 -- target/referrals.sh@26 -- # echo 00:09:01.800 17:28:39 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:01.800 17:28:39 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:01.800 17:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.800 17:28:39 -- common/autotest_common.sh@10 -- # set +x 00:09:01.800 17:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.800 17:28:39 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:01.800 17:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.800 17:28:39 -- common/autotest_common.sh@10 -- # set +x 00:09:01.800 17:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.800 17:28:39 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:01.800 17:28:39 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:01.800 17:28:39 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:01.800 17:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:01.800 17:28:39 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:01.800 17:28:39 -- common/autotest_common.sh@10 -- # set +x 00:09:01.800 17:28:39 -- target/referrals.sh@21 -- # sort 00:09:01.800 17:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:01.800 17:28:39 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:01.800 17:28:39 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:01.800 17:28:39 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:01.800 17:28:39 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:01.800 17:28:39 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:01.800 17:28:39 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.800 17:28:39 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:01.800 17:28:39 -- target/referrals.sh@26 -- # sort 00:09:01.800 17:28:39 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:01.800 17:28:39 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:01.800 17:28:39 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:01.800 17:28:39 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:01.800 17:28:39 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:01.800 17:28:39 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:01.800 17:28:39 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:02.067 17:28:39 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:02.067 17:28:39 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:02.067 17:28:39 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:02.067 17:28:39 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:02.067 17:28:39 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.067 17:28:39 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:02.324 17:28:39 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:02.324 17:28:39 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:02.324 17:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.324 17:28:39 -- common/autotest_common.sh@10 -- # set +x 00:09:02.324 17:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.324 17:28:39 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:02.324 17:28:39 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:02.324 17:28:39 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.324 17:28:39 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:02.324 17:28:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.324 17:28:39 -- common/autotest_common.sh@10 -- # set +x 00:09:02.324 17:28:39 -- target/referrals.sh@21 -- # sort 00:09:02.324 17:28:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.324 17:28:39 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:02.324 17:28:39 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:02.324 17:28:39 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:02.324 17:28:39 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.324 17:28:39 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.324 17:28:39 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.324 17:28:39 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.324 17:28:39 -- target/referrals.sh@26 -- # sort 00:09:02.583 17:28:39 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:02.583 17:28:39 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:02.583 17:28:39 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:02.583 17:28:39 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:02.583 17:28:39 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:02.583 17:28:39 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.583 17:28:39 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:02.583 17:28:40 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:02.583 17:28:40 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:02.583 17:28:40 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:02.583 17:28:40 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:02.583 17:28:40 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.583 17:28:40 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:02.840 17:28:40 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:02.840 17:28:40 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:02.840 17:28:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.840 17:28:40 -- common/autotest_common.sh@10 -- # set +x 00:09:02.840 17:28:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.840 17:28:40 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:02.840 17:28:40 -- target/referrals.sh@82 -- # jq length 00:09:02.840 17:28:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:02.840 17:28:40 -- common/autotest_common.sh@10 -- # set +x 00:09:02.840 17:28:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:02.840 17:28:40 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:02.840 17:28:40 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:02.840 17:28:40 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:02.840 17:28:40 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:02.840 17:28:40 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:02.840 17:28:40 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:02.840 17:28:40 -- target/referrals.sh@26 -- # sort 00:09:03.098 17:28:40 -- target/referrals.sh@26 -- # echo 00:09:03.098 17:28:40 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:03.098 17:28:40 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:03.098 17:28:40 -- target/referrals.sh@86 -- # nvmftestfini 00:09:03.098 17:28:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:03.098 17:28:40 -- nvmf/common.sh@116 -- # sync 00:09:03.098 17:28:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:03.098 17:28:40 -- nvmf/common.sh@119 -- # set +e 00:09:03.098 17:28:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:03.098 17:28:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:03.098 rmmod nvme_tcp 00:09:03.098 rmmod nvme_fabrics 00:09:03.098 rmmod nvme_keyring 00:09:03.098 17:28:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:03.098 17:28:40 -- nvmf/common.sh@123 -- # set -e 00:09:03.098 17:28:40 -- nvmf/common.sh@124 -- # return 0 00:09:03.098 17:28:40 -- nvmf/common.sh@477 -- # '[' -n 1491051 ']' 00:09:03.098 17:28:40 -- nvmf/common.sh@478 -- # killprocess 1491051 00:09:03.098 17:28:40 -- common/autotest_common.sh@936 -- # '[' -z 1491051 ']' 00:09:03.098 17:28:40 -- common/autotest_common.sh@940 -- # kill -0 1491051 00:09:03.098 17:28:40 -- common/autotest_common.sh@941 -- # uname 00:09:03.098 17:28:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:03.098 17:28:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1491051 00:09:03.356 17:28:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:03.356 17:28:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:03.356 17:28:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1491051' 00:09:03.356 killing process with pid 1491051 00:09:03.356 17:28:40 -- common/autotest_common.sh@955 -- # kill 1491051 00:09:03.356 17:28:40 -- common/autotest_common.sh@960 -- # wait 1491051 00:09:03.356 17:28:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:03.356 17:28:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:03.356 17:28:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:03.356 17:28:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:03.356 17:28:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:03.356 17:28:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:03.356 17:28:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:03.356 17:28:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:05.895 17:28:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:05.895 00:09:05.895 real 0m8.036s 00:09:05.895 user 0m14.746s 00:09:05.895 sys 0m2.397s 00:09:05.895 17:28:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:05.895 17:28:42 -- common/autotest_common.sh@10 -- # set +x 00:09:05.895 ************************************ 00:09:05.895 END TEST nvmf_referrals 00:09:05.895 ************************************ 00:09:05.895 17:28:42 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:05.895 17:28:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:05.895 17:28:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:05.895 17:28:42 -- common/autotest_common.sh@10 -- # set +x 00:09:05.895 ************************************ 00:09:05.895 START TEST nvmf_connect_disconnect 00:09:05.895 ************************************ 00:09:05.895 17:28:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:05.895 * Looking for test storage... 00:09:05.895 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:05.895 17:28:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:05.895 17:28:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:05.895 17:28:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:05.895 17:28:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:05.895 17:28:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:05.895 17:28:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:05.895 17:28:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:05.895 17:28:43 -- scripts/common.sh@335 -- # IFS=.-: 00:09:05.895 17:28:43 -- scripts/common.sh@335 -- # read -ra ver1 00:09:05.895 17:28:43 -- scripts/common.sh@336 -- # IFS=.-: 00:09:05.895 17:28:43 -- scripts/common.sh@336 -- # read -ra ver2 00:09:05.895 17:28:43 -- scripts/common.sh@337 -- # local 'op=<' 00:09:05.895 17:28:43 -- scripts/common.sh@339 -- # ver1_l=2 00:09:05.895 17:28:43 -- scripts/common.sh@340 -- # ver2_l=1 00:09:05.895 17:28:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:05.895 17:28:43 -- scripts/common.sh@343 -- # case "$op" in 00:09:05.895 17:28:43 -- scripts/common.sh@344 -- # : 1 00:09:05.895 17:28:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:05.895 17:28:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:05.895 17:28:43 -- scripts/common.sh@364 -- # decimal 1 00:09:05.895 17:28:43 -- scripts/common.sh@352 -- # local d=1 00:09:05.895 17:28:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:05.895 17:28:43 -- scripts/common.sh@354 -- # echo 1 00:09:05.895 17:28:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:05.895 17:28:43 -- scripts/common.sh@365 -- # decimal 2 00:09:05.895 17:28:43 -- scripts/common.sh@352 -- # local d=2 00:09:05.895 17:28:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:05.895 17:28:43 -- scripts/common.sh@354 -- # echo 2 00:09:05.895 17:28:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:05.895 17:28:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:05.895 17:28:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:05.895 17:28:43 -- scripts/common.sh@367 -- # return 0 00:09:05.895 17:28:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:05.895 17:28:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:05.895 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.895 --rc genhtml_branch_coverage=1 00:09:05.895 --rc genhtml_function_coverage=1 00:09:05.895 --rc genhtml_legend=1 00:09:05.895 --rc geninfo_all_blocks=1 00:09:05.895 --rc geninfo_unexecuted_blocks=1 00:09:05.895 00:09:05.895 ' 00:09:05.895 17:28:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:05.895 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.895 --rc genhtml_branch_coverage=1 00:09:05.895 --rc genhtml_function_coverage=1 00:09:05.895 --rc genhtml_legend=1 00:09:05.895 --rc geninfo_all_blocks=1 00:09:05.895 --rc geninfo_unexecuted_blocks=1 00:09:05.895 00:09:05.895 ' 00:09:05.895 17:28:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:05.895 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.895 --rc genhtml_branch_coverage=1 00:09:05.895 --rc genhtml_function_coverage=1 00:09:05.895 --rc genhtml_legend=1 00:09:05.895 --rc geninfo_all_blocks=1 00:09:05.895 --rc geninfo_unexecuted_blocks=1 00:09:05.895 00:09:05.895 ' 00:09:05.895 17:28:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:05.895 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:05.895 --rc genhtml_branch_coverage=1 00:09:05.895 --rc genhtml_function_coverage=1 00:09:05.895 --rc genhtml_legend=1 00:09:05.895 --rc geninfo_all_blocks=1 00:09:05.895 --rc geninfo_unexecuted_blocks=1 00:09:05.895 00:09:05.895 ' 00:09:05.895 17:28:43 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:05.895 17:28:43 -- nvmf/common.sh@7 -- # uname -s 00:09:05.895 17:28:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:05.895 17:28:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:05.895 17:28:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:05.895 17:28:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:05.895 17:28:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:05.895 17:28:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:05.895 17:28:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:05.895 17:28:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:05.895 17:28:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:05.895 17:28:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:05.895 17:28:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:05.895 17:28:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:05.895 17:28:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:05.895 17:28:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:05.895 17:28:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:05.895 17:28:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:05.895 17:28:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:05.895 17:28:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:05.895 17:28:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:05.895 17:28:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.896 17:28:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.896 17:28:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.896 17:28:43 -- paths/export.sh@5 -- # export PATH 00:09:05.896 17:28:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:05.896 17:28:43 -- nvmf/common.sh@46 -- # : 0 00:09:05.896 17:28:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:05.896 17:28:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:05.896 17:28:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:05.896 17:28:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:05.896 17:28:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:05.896 17:28:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:05.896 17:28:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:05.896 17:28:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:05.896 17:28:43 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:05.896 17:28:43 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:05.896 17:28:43 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:05.896 17:28:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:05.896 17:28:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:05.896 17:28:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:05.896 17:28:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:05.896 17:28:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:05.896 17:28:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:05.896 17:28:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:05.896 17:28:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:05.896 17:28:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:05.896 17:28:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:05.896 17:28:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:05.896 17:28:43 -- common/autotest_common.sh@10 -- # set +x 00:09:07.797 17:28:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:07.797 17:28:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:07.797 17:28:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:07.797 17:28:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:07.797 17:28:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:07.797 17:28:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:07.797 17:28:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:07.797 17:28:45 -- nvmf/common.sh@294 -- # net_devs=() 00:09:07.797 17:28:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:07.797 17:28:45 -- nvmf/common.sh@295 -- # e810=() 00:09:07.797 17:28:45 -- nvmf/common.sh@295 -- # local -ga e810 00:09:07.797 17:28:45 -- nvmf/common.sh@296 -- # x722=() 00:09:07.797 17:28:45 -- nvmf/common.sh@296 -- # local -ga x722 00:09:07.797 17:28:45 -- nvmf/common.sh@297 -- # mlx=() 00:09:07.797 17:28:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:07.797 17:28:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:07.797 17:28:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:07.797 17:28:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:07.797 17:28:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:07.797 17:28:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:07.797 17:28:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:07.797 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:07.797 17:28:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:07.797 17:28:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:07.797 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:07.797 17:28:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:07.797 17:28:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:07.797 17:28:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:07.797 17:28:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:07.797 17:28:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:07.797 17:28:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:07.797 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:07.797 17:28:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:07.797 17:28:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:07.797 17:28:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:07.797 17:28:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:07.797 17:28:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:07.797 17:28:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:07.797 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:07.797 17:28:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:07.797 17:28:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:07.797 17:28:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:07.797 17:28:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:07.797 17:28:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:07.797 17:28:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:07.797 17:28:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:07.797 17:28:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:07.797 17:28:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:07.797 17:28:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:07.797 17:28:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:07.797 17:28:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:07.797 17:28:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:07.797 17:28:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:07.797 17:28:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:07.797 17:28:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:07.797 17:28:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:07.797 17:28:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:07.797 17:28:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:07.797 17:28:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:07.797 17:28:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:07.797 17:28:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:07.797 17:28:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:07.797 17:28:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:07.797 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:07.797 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:09:07.797 00:09:07.797 --- 10.0.0.2 ping statistics --- 00:09:07.797 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:07.797 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:09:07.797 17:28:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:07.797 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:07.797 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.265 ms 00:09:07.797 00:09:07.797 --- 10.0.0.1 ping statistics --- 00:09:07.797 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:07.797 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:09:07.797 17:28:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:07.797 17:28:45 -- nvmf/common.sh@410 -- # return 0 00:09:07.797 17:28:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:07.797 17:28:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:07.797 17:28:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:07.797 17:28:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:07.797 17:28:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:07.797 17:28:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:08.056 17:28:45 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:08.056 17:28:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:08.056 17:28:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:08.056 17:28:45 -- common/autotest_common.sh@10 -- # set +x 00:09:08.056 17:28:45 -- nvmf/common.sh@469 -- # nvmfpid=1493511 00:09:08.056 17:28:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:08.056 17:28:45 -- nvmf/common.sh@470 -- # waitforlisten 1493511 00:09:08.056 17:28:45 -- common/autotest_common.sh@829 -- # '[' -z 1493511 ']' 00:09:08.056 17:28:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:08.056 17:28:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:08.056 17:28:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:08.056 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:08.056 17:28:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:08.056 17:28:45 -- common/autotest_common.sh@10 -- # set +x 00:09:08.056 [2024-11-16 17:28:45.346825] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:08.056 [2024-11-16 17:28:45.346897] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:08.056 EAL: No free 2048 kB hugepages reported on node 1 00:09:08.056 [2024-11-16 17:28:45.415593] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:08.056 [2024-11-16 17:28:45.505271] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:08.056 [2024-11-16 17:28:45.505450] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:08.056 [2024-11-16 17:28:45.505471] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:08.056 [2024-11-16 17:28:45.505486] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:08.056 [2024-11-16 17:28:45.505545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:08.056 [2024-11-16 17:28:45.505631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:08.056 [2024-11-16 17:28:45.505835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:08.056 [2024-11-16 17:28:45.505840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:08.991 17:28:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:08.991 17:28:46 -- common/autotest_common.sh@862 -- # return 0 00:09:08.991 17:28:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:08.991 17:28:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:08.991 17:28:46 -- common/autotest_common.sh@10 -- # set +x 00:09:08.991 17:28:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:08.991 17:28:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.991 17:28:46 -- common/autotest_common.sh@10 -- # set +x 00:09:08.991 [2024-11-16 17:28:46.375429] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:08.991 17:28:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:08.991 17:28:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.991 17:28:46 -- common/autotest_common.sh@10 -- # set +x 00:09:08.991 17:28:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:08.991 17:28:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.991 17:28:46 -- common/autotest_common.sh@10 -- # set +x 00:09:08.991 17:28:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:08.991 17:28:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.991 17:28:46 -- common/autotest_common.sh@10 -- # set +x 00:09:08.991 17:28:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:08.991 17:28:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:08.991 17:28:46 -- common/autotest_common.sh@10 -- # set +x 00:09:08.991 [2024-11-16 17:28:46.426424] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:08.991 17:28:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:08.991 17:28:46 -- target/connect_disconnect.sh@34 -- # set +x 00:09:11.541 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.065 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.017 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.912 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.964 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.489 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.386 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.911 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.809 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.343 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.411 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.307 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.731 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.254 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.825 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.758 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.286 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.184 [2024-11-16 17:29:39.673385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcd1fd0 is same with the state(5) to be set 00:10:02.184 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.713 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.767 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.662 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.731 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.682 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.579 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.105 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.668 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.566 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.094 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.991 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.521 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.049 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.477 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.373 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.900 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.427 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.851 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.903 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.802 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.350 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.257 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.782 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.306 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.204 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.730 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.149 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.676 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.581 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.119 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.651 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.559 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.100 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.636 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.105 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.641 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.546 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.083 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.621 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.068 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.604 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.508 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.034 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.560 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.398 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.906 [2024-11-16 17:31:58.288438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcd21e0 is same with the state(5) to be set 00:12:20.906 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.446 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.977 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.517 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.423 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.957 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:35.498 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:38.032 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:42.481 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:45.018 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.922 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:49.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.993 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.899 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:56.459 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.026 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.932 17:32:38 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:00.932 17:32:38 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:00.932 17:32:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:00.932 17:32:38 -- nvmf/common.sh@116 -- # sync 00:13:00.932 17:32:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:00.932 17:32:38 -- nvmf/common.sh@119 -- # set +e 00:13:00.932 17:32:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:00.932 17:32:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:00.932 rmmod nvme_tcp 00:13:00.932 rmmod nvme_fabrics 00:13:00.932 rmmod nvme_keyring 00:13:00.932 17:32:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:00.932 17:32:38 -- nvmf/common.sh@123 -- # set -e 00:13:00.932 17:32:38 -- nvmf/common.sh@124 -- # return 0 00:13:00.932 17:32:38 -- nvmf/common.sh@477 -- # '[' -n 1493511 ']' 00:13:00.932 17:32:38 -- nvmf/common.sh@478 -- # killprocess 1493511 00:13:00.932 17:32:38 -- common/autotest_common.sh@936 -- # '[' -z 1493511 ']' 00:13:00.932 17:32:38 -- common/autotest_common.sh@940 -- # kill -0 1493511 00:13:00.932 17:32:38 -- common/autotest_common.sh@941 -- # uname 00:13:00.932 17:32:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:00.932 17:32:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1493511 00:13:01.190 17:32:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:01.190 17:32:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:01.190 17:32:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1493511' 00:13:01.190 killing process with pid 1493511 00:13:01.190 17:32:38 -- common/autotest_common.sh@955 -- # kill 1493511 00:13:01.190 17:32:38 -- common/autotest_common.sh@960 -- # wait 1493511 00:13:01.451 17:32:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:01.451 17:32:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:01.451 17:32:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:01.451 17:32:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:01.451 17:32:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:01.451 17:32:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:01.451 17:32:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:01.451 17:32:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:03.359 17:32:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:03.359 00:13:03.359 real 3m57.844s 00:13:03.359 user 15m6.401s 00:13:03.359 sys 0m35.376s 00:13:03.359 17:32:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:03.359 17:32:40 -- common/autotest_common.sh@10 -- # set +x 00:13:03.359 ************************************ 00:13:03.359 END TEST nvmf_connect_disconnect 00:13:03.359 ************************************ 00:13:03.359 17:32:40 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:03.359 17:32:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:03.359 17:32:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:03.359 17:32:40 -- common/autotest_common.sh@10 -- # set +x 00:13:03.359 ************************************ 00:13:03.359 START TEST nvmf_multitarget 00:13:03.359 ************************************ 00:13:03.359 17:32:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:03.359 * Looking for test storage... 00:13:03.359 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:03.359 17:32:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:03.359 17:32:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:03.359 17:32:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:03.619 17:32:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:03.619 17:32:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:03.619 17:32:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:03.619 17:32:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:03.619 17:32:40 -- scripts/common.sh@335 -- # IFS=.-: 00:13:03.619 17:32:40 -- scripts/common.sh@335 -- # read -ra ver1 00:13:03.619 17:32:40 -- scripts/common.sh@336 -- # IFS=.-: 00:13:03.619 17:32:40 -- scripts/common.sh@336 -- # read -ra ver2 00:13:03.619 17:32:40 -- scripts/common.sh@337 -- # local 'op=<' 00:13:03.619 17:32:40 -- scripts/common.sh@339 -- # ver1_l=2 00:13:03.620 17:32:40 -- scripts/common.sh@340 -- # ver2_l=1 00:13:03.620 17:32:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:03.620 17:32:40 -- scripts/common.sh@343 -- # case "$op" in 00:13:03.620 17:32:40 -- scripts/common.sh@344 -- # : 1 00:13:03.620 17:32:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:03.620 17:32:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:03.620 17:32:40 -- scripts/common.sh@364 -- # decimal 1 00:13:03.620 17:32:40 -- scripts/common.sh@352 -- # local d=1 00:13:03.620 17:32:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:03.620 17:32:40 -- scripts/common.sh@354 -- # echo 1 00:13:03.620 17:32:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:03.620 17:32:40 -- scripts/common.sh@365 -- # decimal 2 00:13:03.620 17:32:40 -- scripts/common.sh@352 -- # local d=2 00:13:03.620 17:32:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:03.620 17:32:40 -- scripts/common.sh@354 -- # echo 2 00:13:03.620 17:32:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:03.620 17:32:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:03.620 17:32:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:03.620 17:32:40 -- scripts/common.sh@367 -- # return 0 00:13:03.620 17:32:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:03.620 17:32:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:03.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:03.620 --rc genhtml_branch_coverage=1 00:13:03.620 --rc genhtml_function_coverage=1 00:13:03.620 --rc genhtml_legend=1 00:13:03.620 --rc geninfo_all_blocks=1 00:13:03.620 --rc geninfo_unexecuted_blocks=1 00:13:03.620 00:13:03.620 ' 00:13:03.620 17:32:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:03.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:03.620 --rc genhtml_branch_coverage=1 00:13:03.620 --rc genhtml_function_coverage=1 00:13:03.620 --rc genhtml_legend=1 00:13:03.620 --rc geninfo_all_blocks=1 00:13:03.620 --rc geninfo_unexecuted_blocks=1 00:13:03.620 00:13:03.620 ' 00:13:03.620 17:32:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:03.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:03.620 --rc genhtml_branch_coverage=1 00:13:03.620 --rc genhtml_function_coverage=1 00:13:03.620 --rc genhtml_legend=1 00:13:03.620 --rc geninfo_all_blocks=1 00:13:03.620 --rc geninfo_unexecuted_blocks=1 00:13:03.620 00:13:03.620 ' 00:13:03.620 17:32:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:03.620 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:03.620 --rc genhtml_branch_coverage=1 00:13:03.620 --rc genhtml_function_coverage=1 00:13:03.620 --rc genhtml_legend=1 00:13:03.620 --rc geninfo_all_blocks=1 00:13:03.620 --rc geninfo_unexecuted_blocks=1 00:13:03.620 00:13:03.620 ' 00:13:03.620 17:32:40 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:03.620 17:32:40 -- nvmf/common.sh@7 -- # uname -s 00:13:03.620 17:32:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:03.620 17:32:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:03.620 17:32:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:03.620 17:32:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:03.620 17:32:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:03.620 17:32:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:03.620 17:32:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:03.620 17:32:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:03.620 17:32:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:03.620 17:32:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:03.620 17:32:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:03.620 17:32:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:03.620 17:32:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:03.620 17:32:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:03.620 17:32:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:03.620 17:32:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:03.620 17:32:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:03.620 17:32:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:03.620 17:32:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:03.620 17:32:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:03.620 17:32:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:03.620 17:32:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:03.620 17:32:40 -- paths/export.sh@5 -- # export PATH 00:13:03.620 17:32:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:03.620 17:32:40 -- nvmf/common.sh@46 -- # : 0 00:13:03.620 17:32:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:03.620 17:32:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:03.620 17:32:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:03.620 17:32:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:03.620 17:32:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:03.620 17:32:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:03.620 17:32:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:03.620 17:32:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:03.620 17:32:40 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:03.620 17:32:40 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:03.620 17:32:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:03.620 17:32:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:03.620 17:32:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:03.620 17:32:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:03.620 17:32:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:03.620 17:32:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:03.620 17:32:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:03.620 17:32:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:03.620 17:32:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:03.620 17:32:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:03.620 17:32:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:03.620 17:32:40 -- common/autotest_common.sh@10 -- # set +x 00:13:05.525 17:32:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:05.525 17:32:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:05.525 17:32:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:05.525 17:32:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:05.525 17:32:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:05.525 17:32:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:05.525 17:32:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:05.525 17:32:42 -- nvmf/common.sh@294 -- # net_devs=() 00:13:05.525 17:32:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:05.525 17:32:42 -- nvmf/common.sh@295 -- # e810=() 00:13:05.525 17:32:42 -- nvmf/common.sh@295 -- # local -ga e810 00:13:05.525 17:32:42 -- nvmf/common.sh@296 -- # x722=() 00:13:05.525 17:32:42 -- nvmf/common.sh@296 -- # local -ga x722 00:13:05.525 17:32:42 -- nvmf/common.sh@297 -- # mlx=() 00:13:05.525 17:32:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:05.525 17:32:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:05.525 17:32:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:05.525 17:32:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:05.525 17:32:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:05.525 17:32:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:05.525 17:32:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:05.525 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:05.525 17:32:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:05.525 17:32:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:05.525 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:05.525 17:32:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:05.525 17:32:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:05.525 17:32:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:05.525 17:32:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:05.525 17:32:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:05.525 17:32:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:05.525 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:05.525 17:32:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:05.525 17:32:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:05.525 17:32:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:05.525 17:32:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:05.525 17:32:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:05.525 17:32:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:05.525 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:05.525 17:32:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:05.525 17:32:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:05.525 17:32:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:05.525 17:32:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:05.525 17:32:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:05.525 17:32:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:05.525 17:32:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:05.525 17:32:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:05.525 17:32:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:05.525 17:32:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:05.525 17:32:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:05.525 17:32:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:05.525 17:32:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:05.525 17:32:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:05.525 17:32:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:05.525 17:32:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:05.525 17:32:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:05.525 17:32:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:05.525 17:32:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:05.525 17:32:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:05.525 17:32:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:05.525 17:32:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:05.784 17:32:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:05.784 17:32:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:05.784 17:32:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:05.784 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:05.784 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:13:05.784 00:13:05.784 --- 10.0.0.2 ping statistics --- 00:13:05.784 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:05.784 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:13:05.784 17:32:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:05.784 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:05.784 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:13:05.784 00:13:05.784 --- 10.0.0.1 ping statistics --- 00:13:05.784 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:05.784 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:13:05.784 17:32:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:05.784 17:32:43 -- nvmf/common.sh@410 -- # return 0 00:13:05.784 17:32:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:05.784 17:32:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:05.784 17:32:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:05.784 17:32:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:05.784 17:32:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:05.784 17:32:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:05.784 17:32:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:05.784 17:32:43 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:05.784 17:32:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:05.784 17:32:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:05.784 17:32:43 -- common/autotest_common.sh@10 -- # set +x 00:13:05.784 17:32:43 -- nvmf/common.sh@469 -- # nvmfpid=1525571 00:13:05.784 17:32:43 -- nvmf/common.sh@470 -- # waitforlisten 1525571 00:13:05.784 17:32:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:05.784 17:32:43 -- common/autotest_common.sh@829 -- # '[' -z 1525571 ']' 00:13:05.784 17:32:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:05.784 17:32:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:05.784 17:32:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:05.784 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:05.784 17:32:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:05.784 17:32:43 -- common/autotest_common.sh@10 -- # set +x 00:13:05.784 [2024-11-16 17:32:43.141218] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:05.784 [2024-11-16 17:32:43.141299] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:05.784 EAL: No free 2048 kB hugepages reported on node 1 00:13:05.784 [2024-11-16 17:32:43.212293] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:06.042 [2024-11-16 17:32:43.305976] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:06.042 [2024-11-16 17:32:43.306133] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:06.042 [2024-11-16 17:32:43.306152] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:06.042 [2024-11-16 17:32:43.306166] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:06.042 [2024-11-16 17:32:43.306231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:06.042 [2024-11-16 17:32:43.306263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:06.043 [2024-11-16 17:32:43.306321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:06.043 [2024-11-16 17:32:43.306324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:06.979 17:32:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:06.979 17:32:44 -- common/autotest_common.sh@862 -- # return 0 00:13:06.979 17:32:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:06.979 17:32:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:06.979 17:32:44 -- common/autotest_common.sh@10 -- # set +x 00:13:06.979 17:32:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:06.979 17:32:44 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:06.979 17:32:44 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:06.979 17:32:44 -- target/multitarget.sh@21 -- # jq length 00:13:06.979 17:32:44 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:06.979 17:32:44 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:06.979 "nvmf_tgt_1" 00:13:06.979 17:32:44 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:07.237 "nvmf_tgt_2" 00:13:07.237 17:32:44 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:07.237 17:32:44 -- target/multitarget.sh@28 -- # jq length 00:13:07.237 17:32:44 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:07.237 17:32:44 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:07.237 true 00:13:07.237 17:32:44 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:07.496 true 00:13:07.496 17:32:44 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:07.496 17:32:44 -- target/multitarget.sh@35 -- # jq length 00:13:07.496 17:32:44 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:07.496 17:32:44 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:07.496 17:32:44 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:07.496 17:32:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:07.496 17:32:44 -- nvmf/common.sh@116 -- # sync 00:13:07.497 17:32:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:07.497 17:32:44 -- nvmf/common.sh@119 -- # set +e 00:13:07.497 17:32:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:07.497 17:32:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:07.497 rmmod nvme_tcp 00:13:07.497 rmmod nvme_fabrics 00:13:07.757 rmmod nvme_keyring 00:13:07.757 17:32:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:07.757 17:32:45 -- nvmf/common.sh@123 -- # set -e 00:13:07.757 17:32:45 -- nvmf/common.sh@124 -- # return 0 00:13:07.757 17:32:45 -- nvmf/common.sh@477 -- # '[' -n 1525571 ']' 00:13:07.757 17:32:45 -- nvmf/common.sh@478 -- # killprocess 1525571 00:13:07.757 17:32:45 -- common/autotest_common.sh@936 -- # '[' -z 1525571 ']' 00:13:07.757 17:32:45 -- common/autotest_common.sh@940 -- # kill -0 1525571 00:13:07.757 17:32:45 -- common/autotest_common.sh@941 -- # uname 00:13:07.757 17:32:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:07.757 17:32:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1525571 00:13:07.757 17:32:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:07.757 17:32:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:07.757 17:32:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1525571' 00:13:07.757 killing process with pid 1525571 00:13:07.757 17:32:45 -- common/autotest_common.sh@955 -- # kill 1525571 00:13:07.757 17:32:45 -- common/autotest_common.sh@960 -- # wait 1525571 00:13:08.017 17:32:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:08.017 17:32:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:08.017 17:32:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:08.017 17:32:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:08.017 17:32:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:08.017 17:32:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:08.017 17:32:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:08.017 17:32:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.922 17:32:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:09.922 00:13:09.922 real 0m6.567s 00:13:09.922 user 0m9.667s 00:13:09.922 sys 0m1.986s 00:13:09.922 17:32:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:09.922 17:32:47 -- common/autotest_common.sh@10 -- # set +x 00:13:09.922 ************************************ 00:13:09.922 END TEST nvmf_multitarget 00:13:09.922 ************************************ 00:13:09.922 17:32:47 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:09.922 17:32:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:09.922 17:32:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:09.922 17:32:47 -- common/autotest_common.sh@10 -- # set +x 00:13:09.922 ************************************ 00:13:09.922 START TEST nvmf_rpc 00:13:09.922 ************************************ 00:13:09.922 17:32:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:09.922 * Looking for test storage... 00:13:09.922 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:09.922 17:32:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:09.922 17:32:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:09.922 17:32:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:10.181 17:32:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:10.181 17:32:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:10.181 17:32:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:10.181 17:32:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:10.181 17:32:47 -- scripts/common.sh@335 -- # IFS=.-: 00:13:10.181 17:32:47 -- scripts/common.sh@335 -- # read -ra ver1 00:13:10.181 17:32:47 -- scripts/common.sh@336 -- # IFS=.-: 00:13:10.181 17:32:47 -- scripts/common.sh@336 -- # read -ra ver2 00:13:10.181 17:32:47 -- scripts/common.sh@337 -- # local 'op=<' 00:13:10.181 17:32:47 -- scripts/common.sh@339 -- # ver1_l=2 00:13:10.181 17:32:47 -- scripts/common.sh@340 -- # ver2_l=1 00:13:10.181 17:32:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:10.181 17:32:47 -- scripts/common.sh@343 -- # case "$op" in 00:13:10.181 17:32:47 -- scripts/common.sh@344 -- # : 1 00:13:10.181 17:32:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:10.181 17:32:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:10.181 17:32:47 -- scripts/common.sh@364 -- # decimal 1 00:13:10.181 17:32:47 -- scripts/common.sh@352 -- # local d=1 00:13:10.181 17:32:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:10.181 17:32:47 -- scripts/common.sh@354 -- # echo 1 00:13:10.181 17:32:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:10.181 17:32:47 -- scripts/common.sh@365 -- # decimal 2 00:13:10.181 17:32:47 -- scripts/common.sh@352 -- # local d=2 00:13:10.181 17:32:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:10.181 17:32:47 -- scripts/common.sh@354 -- # echo 2 00:13:10.181 17:32:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:10.181 17:32:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:10.181 17:32:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:10.182 17:32:47 -- scripts/common.sh@367 -- # return 0 00:13:10.182 17:32:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:10.182 17:32:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:10.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:10.182 --rc genhtml_branch_coverage=1 00:13:10.182 --rc genhtml_function_coverage=1 00:13:10.182 --rc genhtml_legend=1 00:13:10.182 --rc geninfo_all_blocks=1 00:13:10.182 --rc geninfo_unexecuted_blocks=1 00:13:10.182 00:13:10.182 ' 00:13:10.182 17:32:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:10.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:10.182 --rc genhtml_branch_coverage=1 00:13:10.182 --rc genhtml_function_coverage=1 00:13:10.182 --rc genhtml_legend=1 00:13:10.182 --rc geninfo_all_blocks=1 00:13:10.182 --rc geninfo_unexecuted_blocks=1 00:13:10.182 00:13:10.182 ' 00:13:10.182 17:32:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:10.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:10.182 --rc genhtml_branch_coverage=1 00:13:10.182 --rc genhtml_function_coverage=1 00:13:10.182 --rc genhtml_legend=1 00:13:10.182 --rc geninfo_all_blocks=1 00:13:10.182 --rc geninfo_unexecuted_blocks=1 00:13:10.182 00:13:10.182 ' 00:13:10.182 17:32:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:10.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:10.182 --rc genhtml_branch_coverage=1 00:13:10.182 --rc genhtml_function_coverage=1 00:13:10.182 --rc genhtml_legend=1 00:13:10.182 --rc geninfo_all_blocks=1 00:13:10.182 --rc geninfo_unexecuted_blocks=1 00:13:10.182 00:13:10.182 ' 00:13:10.182 17:32:47 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:10.182 17:32:47 -- nvmf/common.sh@7 -- # uname -s 00:13:10.182 17:32:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:10.182 17:32:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:10.182 17:32:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:10.182 17:32:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:10.182 17:32:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:10.182 17:32:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:10.182 17:32:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:10.182 17:32:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:10.182 17:32:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:10.182 17:32:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:10.182 17:32:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:10.182 17:32:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:10.182 17:32:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:10.182 17:32:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:10.182 17:32:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:10.182 17:32:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:10.182 17:32:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:10.182 17:32:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:10.182 17:32:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:10.182 17:32:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.182 17:32:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.182 17:32:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.182 17:32:47 -- paths/export.sh@5 -- # export PATH 00:13:10.182 17:32:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:10.182 17:32:47 -- nvmf/common.sh@46 -- # : 0 00:13:10.182 17:32:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:10.182 17:32:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:10.182 17:32:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:10.182 17:32:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:10.182 17:32:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:10.182 17:32:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:10.182 17:32:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:10.182 17:32:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:10.182 17:32:47 -- target/rpc.sh@11 -- # loops=5 00:13:10.182 17:32:47 -- target/rpc.sh@23 -- # nvmftestinit 00:13:10.182 17:32:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:10.182 17:32:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:10.182 17:32:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:10.182 17:32:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:10.182 17:32:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:10.182 17:32:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:10.182 17:32:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:10.182 17:32:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:10.182 17:32:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:10.182 17:32:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:10.182 17:32:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:10.182 17:32:47 -- common/autotest_common.sh@10 -- # set +x 00:13:12.093 17:32:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:12.093 17:32:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:12.093 17:32:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:12.093 17:32:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:12.093 17:32:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:12.093 17:32:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:12.093 17:32:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:12.093 17:32:49 -- nvmf/common.sh@294 -- # net_devs=() 00:13:12.093 17:32:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:12.093 17:32:49 -- nvmf/common.sh@295 -- # e810=() 00:13:12.093 17:32:49 -- nvmf/common.sh@295 -- # local -ga e810 00:13:12.093 17:32:49 -- nvmf/common.sh@296 -- # x722=() 00:13:12.093 17:32:49 -- nvmf/common.sh@296 -- # local -ga x722 00:13:12.093 17:32:49 -- nvmf/common.sh@297 -- # mlx=() 00:13:12.093 17:32:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:12.093 17:32:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:12.093 17:32:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:12.093 17:32:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:12.093 17:32:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:12.093 17:32:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:12.093 17:32:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:12.093 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:12.093 17:32:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:12.093 17:32:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:12.093 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:12.093 17:32:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:12.093 17:32:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:12.093 17:32:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:12.093 17:32:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:12.093 17:32:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:12.093 17:32:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:12.093 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:12.093 17:32:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:12.093 17:32:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:12.093 17:32:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:12.093 17:32:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:12.093 17:32:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:12.093 17:32:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:12.093 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:12.093 17:32:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:12.093 17:32:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:12.093 17:32:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:12.093 17:32:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:12.093 17:32:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:12.093 17:32:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:12.093 17:32:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:12.093 17:32:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:12.093 17:32:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:12.093 17:32:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:12.093 17:32:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:12.093 17:32:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:12.093 17:32:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:12.093 17:32:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:12.093 17:32:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:12.093 17:32:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:12.093 17:32:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:12.093 17:32:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:12.093 17:32:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:12.353 17:32:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:12.353 17:32:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:12.353 17:32:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:12.353 17:32:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:12.353 17:32:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:12.353 17:32:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:12.353 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:12.353 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:13:12.353 00:13:12.353 --- 10.0.0.2 ping statistics --- 00:13:12.353 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.353 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:13:12.353 17:32:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:12.353 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:12.353 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:13:12.353 00:13:12.353 --- 10.0.0.1 ping statistics --- 00:13:12.353 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:12.353 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:13:12.353 17:32:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:12.353 17:32:49 -- nvmf/common.sh@410 -- # return 0 00:13:12.353 17:32:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:12.353 17:32:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:12.353 17:32:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:12.353 17:32:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:12.353 17:32:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:12.353 17:32:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:12.353 17:32:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:12.353 17:32:49 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:12.353 17:32:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:12.353 17:32:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:12.353 17:32:49 -- common/autotest_common.sh@10 -- # set +x 00:13:12.353 17:32:49 -- nvmf/common.sh@469 -- # nvmfpid=1527818 00:13:12.353 17:32:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:12.353 17:32:49 -- nvmf/common.sh@470 -- # waitforlisten 1527818 00:13:12.353 17:32:49 -- common/autotest_common.sh@829 -- # '[' -z 1527818 ']' 00:13:12.353 17:32:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:12.353 17:32:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:12.353 17:32:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:12.353 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:12.353 17:32:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:12.353 17:32:49 -- common/autotest_common.sh@10 -- # set +x 00:13:12.353 [2024-11-16 17:32:49.731711] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:12.353 [2024-11-16 17:32:49.731811] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:12.353 EAL: No free 2048 kB hugepages reported on node 1 00:13:12.353 [2024-11-16 17:32:49.809283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:12.612 [2024-11-16 17:32:49.908397] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:12.612 [2024-11-16 17:32:49.908555] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:12.612 [2024-11-16 17:32:49.908574] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:12.612 [2024-11-16 17:32:49.908589] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:12.612 [2024-11-16 17:32:49.908656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:12.612 [2024-11-16 17:32:49.908714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:12.612 [2024-11-16 17:32:49.908769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:12.612 [2024-11-16 17:32:49.908772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:13.548 17:32:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:13.548 17:32:50 -- common/autotest_common.sh@862 -- # return 0 00:13:13.548 17:32:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:13.548 17:32:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:13.548 17:32:50 -- common/autotest_common.sh@10 -- # set +x 00:13:13.548 17:32:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:13.548 17:32:50 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:13.548 17:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.548 17:32:50 -- common/autotest_common.sh@10 -- # set +x 00:13:13.548 17:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.548 17:32:50 -- target/rpc.sh@26 -- # stats='{ 00:13:13.548 "tick_rate": 2700000000, 00:13:13.548 "poll_groups": [ 00:13:13.548 { 00:13:13.548 "name": "nvmf_tgt_poll_group_0", 00:13:13.548 "admin_qpairs": 0, 00:13:13.548 "io_qpairs": 0, 00:13:13.548 "current_admin_qpairs": 0, 00:13:13.548 "current_io_qpairs": 0, 00:13:13.548 "pending_bdev_io": 0, 00:13:13.548 "completed_nvme_io": 0, 00:13:13.548 "transports": [] 00:13:13.548 }, 00:13:13.548 { 00:13:13.548 "name": "nvmf_tgt_poll_group_1", 00:13:13.548 "admin_qpairs": 0, 00:13:13.548 "io_qpairs": 0, 00:13:13.548 "current_admin_qpairs": 0, 00:13:13.548 "current_io_qpairs": 0, 00:13:13.548 "pending_bdev_io": 0, 00:13:13.548 "completed_nvme_io": 0, 00:13:13.548 "transports": [] 00:13:13.548 }, 00:13:13.548 { 00:13:13.548 "name": "nvmf_tgt_poll_group_2", 00:13:13.548 "admin_qpairs": 0, 00:13:13.548 "io_qpairs": 0, 00:13:13.548 "current_admin_qpairs": 0, 00:13:13.548 "current_io_qpairs": 0, 00:13:13.548 "pending_bdev_io": 0, 00:13:13.548 "completed_nvme_io": 0, 00:13:13.548 "transports": [] 00:13:13.548 }, 00:13:13.548 { 00:13:13.548 "name": "nvmf_tgt_poll_group_3", 00:13:13.548 "admin_qpairs": 0, 00:13:13.548 "io_qpairs": 0, 00:13:13.548 "current_admin_qpairs": 0, 00:13:13.548 "current_io_qpairs": 0, 00:13:13.548 "pending_bdev_io": 0, 00:13:13.548 "completed_nvme_io": 0, 00:13:13.548 "transports": [] 00:13:13.548 } 00:13:13.548 ] 00:13:13.548 }' 00:13:13.548 17:32:50 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:13.548 17:32:50 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:13.548 17:32:50 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:13.548 17:32:50 -- target/rpc.sh@15 -- # wc -l 00:13:13.548 17:32:50 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:13.548 17:32:50 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:13.548 17:32:50 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:13.548 17:32:50 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:13.548 17:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.548 17:32:50 -- common/autotest_common.sh@10 -- # set +x 00:13:13.548 [2024-11-16 17:32:50.906872] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:13.548 17:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.548 17:32:50 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:13.548 17:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.548 17:32:50 -- common/autotest_common.sh@10 -- # set +x 00:13:13.548 17:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.548 17:32:50 -- target/rpc.sh@33 -- # stats='{ 00:13:13.548 "tick_rate": 2700000000, 00:13:13.548 "poll_groups": [ 00:13:13.548 { 00:13:13.548 "name": "nvmf_tgt_poll_group_0", 00:13:13.548 "admin_qpairs": 0, 00:13:13.548 "io_qpairs": 0, 00:13:13.548 "current_admin_qpairs": 0, 00:13:13.548 "current_io_qpairs": 0, 00:13:13.548 "pending_bdev_io": 0, 00:13:13.548 "completed_nvme_io": 0, 00:13:13.548 "transports": [ 00:13:13.548 { 00:13:13.548 "trtype": "TCP" 00:13:13.548 } 00:13:13.548 ] 00:13:13.548 }, 00:13:13.548 { 00:13:13.548 "name": "nvmf_tgt_poll_group_1", 00:13:13.548 "admin_qpairs": 0, 00:13:13.548 "io_qpairs": 0, 00:13:13.548 "current_admin_qpairs": 0, 00:13:13.548 "current_io_qpairs": 0, 00:13:13.548 "pending_bdev_io": 0, 00:13:13.548 "completed_nvme_io": 0, 00:13:13.548 "transports": [ 00:13:13.548 { 00:13:13.548 "trtype": "TCP" 00:13:13.548 } 00:13:13.548 ] 00:13:13.548 }, 00:13:13.548 { 00:13:13.548 "name": "nvmf_tgt_poll_group_2", 00:13:13.548 "admin_qpairs": 0, 00:13:13.548 "io_qpairs": 0, 00:13:13.548 "current_admin_qpairs": 0, 00:13:13.548 "current_io_qpairs": 0, 00:13:13.548 "pending_bdev_io": 0, 00:13:13.548 "completed_nvme_io": 0, 00:13:13.548 "transports": [ 00:13:13.548 { 00:13:13.548 "trtype": "TCP" 00:13:13.548 } 00:13:13.548 ] 00:13:13.548 }, 00:13:13.548 { 00:13:13.548 "name": "nvmf_tgt_poll_group_3", 00:13:13.548 "admin_qpairs": 0, 00:13:13.548 "io_qpairs": 0, 00:13:13.548 "current_admin_qpairs": 0, 00:13:13.548 "current_io_qpairs": 0, 00:13:13.548 "pending_bdev_io": 0, 00:13:13.548 "completed_nvme_io": 0, 00:13:13.548 "transports": [ 00:13:13.548 { 00:13:13.548 "trtype": "TCP" 00:13:13.548 } 00:13:13.548 ] 00:13:13.548 } 00:13:13.548 ] 00:13:13.548 }' 00:13:13.548 17:32:50 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:13.548 17:32:50 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:13.548 17:32:50 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:13.548 17:32:50 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:13.548 17:32:50 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:13.548 17:32:50 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:13.548 17:32:50 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:13.548 17:32:50 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:13.548 17:32:50 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:13.548 17:32:51 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:13.548 17:32:51 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:13.548 17:32:51 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:13.548 17:32:51 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:13.548 17:32:51 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:13.548 17:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.548 17:32:51 -- common/autotest_common.sh@10 -- # set +x 00:13:13.810 Malloc1 00:13:13.810 17:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.810 17:32:51 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:13.810 17:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.810 17:32:51 -- common/autotest_common.sh@10 -- # set +x 00:13:13.810 17:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.810 17:32:51 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:13.810 17:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.810 17:32:51 -- common/autotest_common.sh@10 -- # set +x 00:13:13.810 17:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.810 17:32:51 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:13.810 17:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.810 17:32:51 -- common/autotest_common.sh@10 -- # set +x 00:13:13.810 17:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.810 17:32:51 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:13.810 17:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.810 17:32:51 -- common/autotest_common.sh@10 -- # set +x 00:13:13.810 [2024-11-16 17:32:51.069353] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:13.810 17:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.810 17:32:51 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:13.810 17:32:51 -- common/autotest_common.sh@650 -- # local es=0 00:13:13.810 17:32:51 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:13.810 17:32:51 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:13.810 17:32:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.810 17:32:51 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:13.810 17:32:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.810 17:32:51 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:13.810 17:32:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.810 17:32:51 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:13.810 17:32:51 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:13.810 17:32:51 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:13.810 [2024-11-16 17:32:51.091700] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:13.810 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:13.810 could not add new controller: failed to write to nvme-fabrics device 00:13:13.810 17:32:51 -- common/autotest_common.sh@653 -- # es=1 00:13:13.810 17:32:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:13.810 17:32:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:13.810 17:32:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:13.810 17:32:51 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:13.810 17:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.810 17:32:51 -- common/autotest_common.sh@10 -- # set +x 00:13:13.810 17:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.810 17:32:51 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:14.379 17:32:51 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:14.379 17:32:51 -- common/autotest_common.sh@1187 -- # local i=0 00:13:14.379 17:32:51 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:14.379 17:32:51 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:14.379 17:32:51 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:16.283 17:32:53 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:16.283 17:32:53 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:16.283 17:32:53 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:16.283 17:32:53 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:16.283 17:32:53 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:16.283 17:32:53 -- common/autotest_common.sh@1197 -- # return 0 00:13:16.283 17:32:53 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:16.543 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.543 17:32:53 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:16.543 17:32:53 -- common/autotest_common.sh@1208 -- # local i=0 00:13:16.543 17:32:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:16.543 17:32:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.543 17:32:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:16.543 17:32:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.543 17:32:53 -- common/autotest_common.sh@1220 -- # return 0 00:13:16.543 17:32:53 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:16.543 17:32:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.543 17:32:53 -- common/autotest_common.sh@10 -- # set +x 00:13:16.543 17:32:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.543 17:32:53 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:16.543 17:32:53 -- common/autotest_common.sh@650 -- # local es=0 00:13:16.543 17:32:53 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:16.543 17:32:53 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:16.543 17:32:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:16.543 17:32:53 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:16.543 17:32:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:16.543 17:32:53 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:16.543 17:32:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:16.543 17:32:53 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:16.543 17:32:53 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:16.543 17:32:53 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:16.543 [2024-11-16 17:32:53.891761] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:16.543 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:16.543 could not add new controller: failed to write to nvme-fabrics device 00:13:16.543 17:32:53 -- common/autotest_common.sh@653 -- # es=1 00:13:16.543 17:32:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:16.543 17:32:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:16.543 17:32:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:16.543 17:32:53 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:16.543 17:32:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.543 17:32:53 -- common/autotest_common.sh@10 -- # set +x 00:13:16.543 17:32:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.543 17:32:53 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:17.478 17:32:54 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:17.478 17:32:54 -- common/autotest_common.sh@1187 -- # local i=0 00:13:17.478 17:32:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:17.478 17:32:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:17.478 17:32:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:19.375 17:32:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:19.375 17:32:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:19.375 17:32:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:19.375 17:32:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:19.375 17:32:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:19.375 17:32:56 -- common/autotest_common.sh@1197 -- # return 0 00:13:19.375 17:32:56 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:19.375 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:19.375 17:32:56 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:19.375 17:32:56 -- common/autotest_common.sh@1208 -- # local i=0 00:13:19.375 17:32:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:19.375 17:32:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:19.375 17:32:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:19.375 17:32:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:19.375 17:32:56 -- common/autotest_common.sh@1220 -- # return 0 00:13:19.375 17:32:56 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:19.375 17:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.375 17:32:56 -- common/autotest_common.sh@10 -- # set +x 00:13:19.375 17:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.375 17:32:56 -- target/rpc.sh@81 -- # seq 1 5 00:13:19.375 17:32:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:19.375 17:32:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:19.375 17:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.375 17:32:56 -- common/autotest_common.sh@10 -- # set +x 00:13:19.375 17:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.375 17:32:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:19.375 17:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.375 17:32:56 -- common/autotest_common.sh@10 -- # set +x 00:13:19.375 [2024-11-16 17:32:56.746766] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:19.375 17:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.375 17:32:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:19.375 17:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.375 17:32:56 -- common/autotest_common.sh@10 -- # set +x 00:13:19.375 17:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.375 17:32:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:19.375 17:32:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.375 17:32:56 -- common/autotest_common.sh@10 -- # set +x 00:13:19.375 17:32:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.375 17:32:56 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:19.940 17:32:57 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:19.940 17:32:57 -- common/autotest_common.sh@1187 -- # local i=0 00:13:19.940 17:32:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:19.940 17:32:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:19.940 17:32:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:22.466 17:32:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:22.466 17:32:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:22.466 17:32:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:22.466 17:32:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:22.466 17:32:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:22.466 17:32:59 -- common/autotest_common.sh@1197 -- # return 0 00:13:22.466 17:32:59 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:22.466 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:22.466 17:32:59 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:22.466 17:32:59 -- common/autotest_common.sh@1208 -- # local i=0 00:13:22.466 17:32:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:22.466 17:32:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:22.466 17:32:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:22.466 17:32:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:22.466 17:32:59 -- common/autotest_common.sh@1220 -- # return 0 00:13:22.466 17:32:59 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.466 17:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.466 17:32:59 -- common/autotest_common.sh@10 -- # set +x 00:13:22.466 17:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.466 17:32:59 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:22.466 17:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.466 17:32:59 -- common/autotest_common.sh@10 -- # set +x 00:13:22.466 17:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.466 17:32:59 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:22.466 17:32:59 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:22.466 17:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.466 17:32:59 -- common/autotest_common.sh@10 -- # set +x 00:13:22.466 17:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.466 17:32:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:22.466 17:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.466 17:32:59 -- common/autotest_common.sh@10 -- # set +x 00:13:22.466 [2024-11-16 17:32:59.541381] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:22.466 17:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.466 17:32:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:22.466 17:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.466 17:32:59 -- common/autotest_common.sh@10 -- # set +x 00:13:22.466 17:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.466 17:32:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:22.466 17:32:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.466 17:32:59 -- common/autotest_common.sh@10 -- # set +x 00:13:22.466 17:32:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.466 17:32:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:23.031 17:33:00 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:23.031 17:33:00 -- common/autotest_common.sh@1187 -- # local i=0 00:13:23.031 17:33:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:23.031 17:33:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:23.031 17:33:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:24.932 17:33:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:24.932 17:33:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:24.932 17:33:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:24.932 17:33:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:24.932 17:33:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:24.932 17:33:02 -- common/autotest_common.sh@1197 -- # return 0 00:13:24.932 17:33:02 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:24.932 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:24.932 17:33:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:24.932 17:33:02 -- common/autotest_common.sh@1208 -- # local i=0 00:13:24.932 17:33:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:24.932 17:33:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.932 17:33:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:24.932 17:33:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:24.932 17:33:02 -- common/autotest_common.sh@1220 -- # return 0 00:13:24.932 17:33:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.932 17:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.932 17:33:02 -- common/autotest_common.sh@10 -- # set +x 00:13:24.932 17:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.932 17:33:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:24.932 17:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.932 17:33:02 -- common/autotest_common.sh@10 -- # set +x 00:13:24.932 17:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.932 17:33:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:24.932 17:33:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:24.932 17:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.932 17:33:02 -- common/autotest_common.sh@10 -- # set +x 00:13:24.932 17:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.932 17:33:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:24.932 17:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.932 17:33:02 -- common/autotest_common.sh@10 -- # set +x 00:13:24.932 [2024-11-16 17:33:02.405613] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:24.932 17:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.932 17:33:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:24.932 17:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.932 17:33:02 -- common/autotest_common.sh@10 -- # set +x 00:13:24.932 17:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.932 17:33:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:24.932 17:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.932 17:33:02 -- common/autotest_common.sh@10 -- # set +x 00:13:25.190 17:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.190 17:33:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:25.755 17:33:03 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:25.755 17:33:03 -- common/autotest_common.sh@1187 -- # local i=0 00:13:25.755 17:33:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:25.755 17:33:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:25.755 17:33:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:27.719 17:33:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:27.719 17:33:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:27.719 17:33:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:27.719 17:33:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:27.719 17:33:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:27.719 17:33:05 -- common/autotest_common.sh@1197 -- # return 0 00:13:27.719 17:33:05 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:27.719 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:27.719 17:33:05 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:27.719 17:33:05 -- common/autotest_common.sh@1208 -- # local i=0 00:13:27.719 17:33:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:27.719 17:33:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:27.719 17:33:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:27.719 17:33:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:27.719 17:33:05 -- common/autotest_common.sh@1220 -- # return 0 00:13:27.719 17:33:05 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:27.719 17:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.719 17:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:27.719 17:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.719 17:33:05 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:27.719 17:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.719 17:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:27.980 17:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.980 17:33:05 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:27.980 17:33:05 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:27.980 17:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.980 17:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:27.980 17:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.980 17:33:05 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:27.980 17:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.980 17:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:27.980 [2024-11-16 17:33:05.221223] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:27.980 17:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.980 17:33:05 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:27.980 17:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.980 17:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:27.980 17:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.980 17:33:05 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:27.980 17:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.980 17:33:05 -- common/autotest_common.sh@10 -- # set +x 00:13:27.980 17:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.980 17:33:05 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:28.545 17:33:05 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:28.545 17:33:05 -- common/autotest_common.sh@1187 -- # local i=0 00:13:28.545 17:33:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:28.545 17:33:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:28.545 17:33:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:30.442 17:33:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:30.442 17:33:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:30.442 17:33:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:30.701 17:33:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:30.701 17:33:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:30.701 17:33:07 -- common/autotest_common.sh@1197 -- # return 0 00:13:30.701 17:33:07 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:30.701 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:30.701 17:33:07 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:30.701 17:33:07 -- common/autotest_common.sh@1208 -- # local i=0 00:13:30.701 17:33:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:30.701 17:33:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.701 17:33:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:30.701 17:33:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.701 17:33:08 -- common/autotest_common.sh@1220 -- # return 0 00:13:30.701 17:33:08 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:30.701 17:33:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.701 17:33:08 -- common/autotest_common.sh@10 -- # set +x 00:13:30.701 17:33:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.701 17:33:08 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:30.701 17:33:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.701 17:33:08 -- common/autotest_common.sh@10 -- # set +x 00:13:30.701 17:33:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.701 17:33:08 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:30.701 17:33:08 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:30.701 17:33:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.701 17:33:08 -- common/autotest_common.sh@10 -- # set +x 00:13:30.701 17:33:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.701 17:33:08 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:30.701 17:33:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.701 17:33:08 -- common/autotest_common.sh@10 -- # set +x 00:13:30.701 [2024-11-16 17:33:08.035750] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:30.701 17:33:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.701 17:33:08 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:30.701 17:33:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.701 17:33:08 -- common/autotest_common.sh@10 -- # set +x 00:13:30.701 17:33:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.701 17:33:08 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:30.701 17:33:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.701 17:33:08 -- common/autotest_common.sh@10 -- # set +x 00:13:30.701 17:33:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.701 17:33:08 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:31.267 17:33:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:31.267 17:33:08 -- common/autotest_common.sh@1187 -- # local i=0 00:13:31.267 17:33:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:31.267 17:33:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:31.267 17:33:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:33.795 17:33:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:33.795 17:33:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:33.795 17:33:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:33.795 17:33:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:33.795 17:33:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:33.795 17:33:10 -- common/autotest_common.sh@1197 -- # return 0 00:13:33.795 17:33:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:33.795 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:33.795 17:33:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:33.795 17:33:10 -- common/autotest_common.sh@1208 -- # local i=0 00:13:33.795 17:33:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:33.795 17:33:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:33.795 17:33:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:33.795 17:33:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:33.795 17:33:10 -- common/autotest_common.sh@1220 -- # return 0 00:13:33.795 17:33:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@99 -- # seq 1 5 00:13:33.795 17:33:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:33.795 17:33:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 [2024-11-16 17:33:10.819952] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:33.795 17:33:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.795 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.795 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.795 [2024-11-16 17:33:10.868025] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.795 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.795 17:33:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:33.796 17:33:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 [2024-11-16 17:33:10.916210] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:33.796 17:33:10 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 [2024-11-16 17:33:10.964361] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:10 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.796 17:33:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:10 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:11 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:33.796 17:33:11 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:33.796 17:33:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:11 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:11 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.796 17:33:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:11 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 [2024-11-16 17:33:11.012516] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.796 17:33:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:11 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:33.796 17:33:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:11 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:11 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:33.796 17:33:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:11 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:11 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.796 17:33:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:11 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:11 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:33.796 17:33:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:11 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:11 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:33.796 17:33:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.796 17:33:11 -- common/autotest_common.sh@10 -- # set +x 00:13:33.796 17:33:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.796 17:33:11 -- target/rpc.sh@110 -- # stats='{ 00:13:33.796 "tick_rate": 2700000000, 00:13:33.796 "poll_groups": [ 00:13:33.796 { 00:13:33.796 "name": "nvmf_tgt_poll_group_0", 00:13:33.796 "admin_qpairs": 2, 00:13:33.796 "io_qpairs": 84, 00:13:33.796 "current_admin_qpairs": 0, 00:13:33.796 "current_io_qpairs": 0, 00:13:33.796 "pending_bdev_io": 0, 00:13:33.796 "completed_nvme_io": 185, 00:13:33.796 "transports": [ 00:13:33.796 { 00:13:33.796 "trtype": "TCP" 00:13:33.796 } 00:13:33.796 ] 00:13:33.796 }, 00:13:33.796 { 00:13:33.796 "name": "nvmf_tgt_poll_group_1", 00:13:33.796 "admin_qpairs": 2, 00:13:33.796 "io_qpairs": 84, 00:13:33.796 "current_admin_qpairs": 0, 00:13:33.796 "current_io_qpairs": 0, 00:13:33.796 "pending_bdev_io": 0, 00:13:33.796 "completed_nvme_io": 184, 00:13:33.796 "transports": [ 00:13:33.796 { 00:13:33.796 "trtype": "TCP" 00:13:33.796 } 00:13:33.796 ] 00:13:33.796 }, 00:13:33.796 { 00:13:33.796 "name": "nvmf_tgt_poll_group_2", 00:13:33.796 "admin_qpairs": 1, 00:13:33.796 "io_qpairs": 84, 00:13:33.796 "current_admin_qpairs": 0, 00:13:33.796 "current_io_qpairs": 0, 00:13:33.796 "pending_bdev_io": 0, 00:13:33.796 "completed_nvme_io": 182, 00:13:33.796 "transports": [ 00:13:33.796 { 00:13:33.796 "trtype": "TCP" 00:13:33.796 } 00:13:33.796 ] 00:13:33.796 }, 00:13:33.796 { 00:13:33.796 "name": "nvmf_tgt_poll_group_3", 00:13:33.796 "admin_qpairs": 2, 00:13:33.796 "io_qpairs": 84, 00:13:33.796 "current_admin_qpairs": 0, 00:13:33.796 "current_io_qpairs": 0, 00:13:33.796 "pending_bdev_io": 0, 00:13:33.796 "completed_nvme_io": 135, 00:13:33.796 "transports": [ 00:13:33.796 { 00:13:33.796 "trtype": "TCP" 00:13:33.796 } 00:13:33.796 ] 00:13:33.796 } 00:13:33.796 ] 00:13:33.796 }' 00:13:33.796 17:33:11 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:33.796 17:33:11 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:33.796 17:33:11 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:33.796 17:33:11 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:33.796 17:33:11 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:33.796 17:33:11 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:33.796 17:33:11 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:33.796 17:33:11 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:33.796 17:33:11 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:33.796 17:33:11 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:33.796 17:33:11 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:33.796 17:33:11 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:33.796 17:33:11 -- target/rpc.sh@123 -- # nvmftestfini 00:13:33.796 17:33:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:33.796 17:33:11 -- nvmf/common.sh@116 -- # sync 00:13:33.796 17:33:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:33.796 17:33:11 -- nvmf/common.sh@119 -- # set +e 00:13:33.796 17:33:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:33.796 17:33:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:33.796 rmmod nvme_tcp 00:13:33.797 rmmod nvme_fabrics 00:13:33.797 rmmod nvme_keyring 00:13:33.797 17:33:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:33.797 17:33:11 -- nvmf/common.sh@123 -- # set -e 00:13:33.797 17:33:11 -- nvmf/common.sh@124 -- # return 0 00:13:33.797 17:33:11 -- nvmf/common.sh@477 -- # '[' -n 1527818 ']' 00:13:33.797 17:33:11 -- nvmf/common.sh@478 -- # killprocess 1527818 00:13:33.797 17:33:11 -- common/autotest_common.sh@936 -- # '[' -z 1527818 ']' 00:13:33.797 17:33:11 -- common/autotest_common.sh@940 -- # kill -0 1527818 00:13:33.797 17:33:11 -- common/autotest_common.sh@941 -- # uname 00:13:33.797 17:33:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:33.797 17:33:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1527818 00:13:33.797 17:33:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:33.797 17:33:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:33.797 17:33:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1527818' 00:13:33.797 killing process with pid 1527818 00:13:33.797 17:33:11 -- common/autotest_common.sh@955 -- # kill 1527818 00:13:33.797 17:33:11 -- common/autotest_common.sh@960 -- # wait 1527818 00:13:34.056 17:33:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:34.056 17:33:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:34.056 17:33:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:34.056 17:33:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:34.056 17:33:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:34.056 17:33:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:34.056 17:33:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:34.056 17:33:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:36.593 17:33:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:36.593 00:13:36.593 real 0m26.209s 00:13:36.593 user 1m25.915s 00:13:36.593 sys 0m4.218s 00:13:36.593 17:33:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:36.593 17:33:13 -- common/autotest_common.sh@10 -- # set +x 00:13:36.593 ************************************ 00:13:36.593 END TEST nvmf_rpc 00:13:36.593 ************************************ 00:13:36.593 17:33:13 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:36.593 17:33:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:36.593 17:33:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:36.593 17:33:13 -- common/autotest_common.sh@10 -- # set +x 00:13:36.593 ************************************ 00:13:36.593 START TEST nvmf_invalid 00:13:36.593 ************************************ 00:13:36.593 17:33:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:36.593 * Looking for test storage... 00:13:36.593 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:36.593 17:33:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:36.593 17:33:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:36.593 17:33:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:36.593 17:33:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:36.593 17:33:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:36.593 17:33:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:36.593 17:33:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:36.593 17:33:13 -- scripts/common.sh@335 -- # IFS=.-: 00:13:36.593 17:33:13 -- scripts/common.sh@335 -- # read -ra ver1 00:13:36.593 17:33:13 -- scripts/common.sh@336 -- # IFS=.-: 00:13:36.593 17:33:13 -- scripts/common.sh@336 -- # read -ra ver2 00:13:36.593 17:33:13 -- scripts/common.sh@337 -- # local 'op=<' 00:13:36.593 17:33:13 -- scripts/common.sh@339 -- # ver1_l=2 00:13:36.593 17:33:13 -- scripts/common.sh@340 -- # ver2_l=1 00:13:36.593 17:33:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:36.593 17:33:13 -- scripts/common.sh@343 -- # case "$op" in 00:13:36.593 17:33:13 -- scripts/common.sh@344 -- # : 1 00:13:36.593 17:33:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:36.593 17:33:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:36.593 17:33:13 -- scripts/common.sh@364 -- # decimal 1 00:13:36.593 17:33:13 -- scripts/common.sh@352 -- # local d=1 00:13:36.593 17:33:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:36.593 17:33:13 -- scripts/common.sh@354 -- # echo 1 00:13:36.593 17:33:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:36.593 17:33:13 -- scripts/common.sh@365 -- # decimal 2 00:13:36.593 17:33:13 -- scripts/common.sh@352 -- # local d=2 00:13:36.593 17:33:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:36.593 17:33:13 -- scripts/common.sh@354 -- # echo 2 00:13:36.593 17:33:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:36.593 17:33:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:36.593 17:33:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:36.593 17:33:13 -- scripts/common.sh@367 -- # return 0 00:13:36.593 17:33:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:36.593 17:33:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:36.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:36.593 --rc genhtml_branch_coverage=1 00:13:36.593 --rc genhtml_function_coverage=1 00:13:36.593 --rc genhtml_legend=1 00:13:36.593 --rc geninfo_all_blocks=1 00:13:36.593 --rc geninfo_unexecuted_blocks=1 00:13:36.593 00:13:36.593 ' 00:13:36.593 17:33:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:36.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:36.593 --rc genhtml_branch_coverage=1 00:13:36.593 --rc genhtml_function_coverage=1 00:13:36.593 --rc genhtml_legend=1 00:13:36.593 --rc geninfo_all_blocks=1 00:13:36.593 --rc geninfo_unexecuted_blocks=1 00:13:36.593 00:13:36.593 ' 00:13:36.593 17:33:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:36.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:36.593 --rc genhtml_branch_coverage=1 00:13:36.593 --rc genhtml_function_coverage=1 00:13:36.593 --rc genhtml_legend=1 00:13:36.593 --rc geninfo_all_blocks=1 00:13:36.593 --rc geninfo_unexecuted_blocks=1 00:13:36.593 00:13:36.593 ' 00:13:36.593 17:33:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:36.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:36.593 --rc genhtml_branch_coverage=1 00:13:36.593 --rc genhtml_function_coverage=1 00:13:36.593 --rc genhtml_legend=1 00:13:36.593 --rc geninfo_all_blocks=1 00:13:36.593 --rc geninfo_unexecuted_blocks=1 00:13:36.593 00:13:36.593 ' 00:13:36.593 17:33:13 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:36.593 17:33:13 -- nvmf/common.sh@7 -- # uname -s 00:13:36.593 17:33:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:36.593 17:33:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:36.593 17:33:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:36.593 17:33:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:36.593 17:33:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:36.593 17:33:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:36.593 17:33:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:36.593 17:33:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:36.593 17:33:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:36.593 17:33:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:36.593 17:33:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:36.593 17:33:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:36.593 17:33:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:36.593 17:33:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:36.593 17:33:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:36.593 17:33:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:36.593 17:33:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:36.593 17:33:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:36.593 17:33:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:36.593 17:33:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.593 17:33:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.593 17:33:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.593 17:33:13 -- paths/export.sh@5 -- # export PATH 00:13:36.593 17:33:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:36.593 17:33:13 -- nvmf/common.sh@46 -- # : 0 00:13:36.593 17:33:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:36.593 17:33:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:36.593 17:33:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:36.593 17:33:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:36.593 17:33:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:36.593 17:33:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:36.593 17:33:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:36.593 17:33:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:36.593 17:33:13 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:36.593 17:33:13 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:36.593 17:33:13 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:36.593 17:33:13 -- target/invalid.sh@14 -- # target=foobar 00:13:36.593 17:33:13 -- target/invalid.sh@16 -- # RANDOM=0 00:13:36.593 17:33:13 -- target/invalid.sh@34 -- # nvmftestinit 00:13:36.593 17:33:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:36.593 17:33:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:36.593 17:33:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:36.593 17:33:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:36.593 17:33:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:36.594 17:33:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:36.594 17:33:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:36.594 17:33:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:36.594 17:33:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:36.594 17:33:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:36.594 17:33:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:36.594 17:33:13 -- common/autotest_common.sh@10 -- # set +x 00:13:38.496 17:33:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:38.496 17:33:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:38.496 17:33:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:38.496 17:33:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:38.496 17:33:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:38.496 17:33:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:38.496 17:33:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:38.496 17:33:15 -- nvmf/common.sh@294 -- # net_devs=() 00:13:38.496 17:33:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:38.496 17:33:15 -- nvmf/common.sh@295 -- # e810=() 00:13:38.496 17:33:15 -- nvmf/common.sh@295 -- # local -ga e810 00:13:38.496 17:33:15 -- nvmf/common.sh@296 -- # x722=() 00:13:38.496 17:33:15 -- nvmf/common.sh@296 -- # local -ga x722 00:13:38.496 17:33:15 -- nvmf/common.sh@297 -- # mlx=() 00:13:38.496 17:33:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:38.497 17:33:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:38.497 17:33:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:38.497 17:33:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:38.497 17:33:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:38.497 17:33:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:38.497 17:33:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:38.497 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:38.497 17:33:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:38.497 17:33:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:38.497 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:38.497 17:33:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:38.497 17:33:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:38.497 17:33:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:38.497 17:33:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:38.497 17:33:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:38.497 17:33:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:38.497 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:38.497 17:33:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:38.497 17:33:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:38.497 17:33:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:38.497 17:33:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:38.497 17:33:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:38.497 17:33:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:38.497 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:38.497 17:33:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:38.497 17:33:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:38.497 17:33:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:38.497 17:33:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:38.497 17:33:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:38.497 17:33:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:38.497 17:33:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:38.497 17:33:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:38.497 17:33:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:38.497 17:33:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:38.497 17:33:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:38.497 17:33:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:38.497 17:33:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:38.497 17:33:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:38.497 17:33:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:38.497 17:33:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:38.497 17:33:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:38.497 17:33:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:38.497 17:33:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:38.497 17:33:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:38.497 17:33:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:38.497 17:33:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:38.497 17:33:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:38.497 17:33:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:38.497 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:38.497 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.274 ms 00:13:38.497 00:13:38.497 --- 10.0.0.2 ping statistics --- 00:13:38.497 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:38.497 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:13:38.497 17:33:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:38.497 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:38.497 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:13:38.497 00:13:38.497 --- 10.0.0.1 ping statistics --- 00:13:38.497 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:38.497 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:13:38.497 17:33:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:38.497 17:33:15 -- nvmf/common.sh@410 -- # return 0 00:13:38.497 17:33:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:38.497 17:33:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:38.497 17:33:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:38.497 17:33:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:38.497 17:33:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:38.497 17:33:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:38.497 17:33:15 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:38.497 17:33:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:38.497 17:33:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:38.497 17:33:15 -- common/autotest_common.sh@10 -- # set +x 00:13:38.497 17:33:15 -- nvmf/common.sh@469 -- # nvmfpid=1533152 00:13:38.497 17:33:15 -- nvmf/common.sh@470 -- # waitforlisten 1533152 00:13:38.497 17:33:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:38.497 17:33:15 -- common/autotest_common.sh@829 -- # '[' -z 1533152 ']' 00:13:38.497 17:33:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:38.497 17:33:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:38.497 17:33:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:38.497 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:38.497 17:33:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:38.497 17:33:15 -- common/autotest_common.sh@10 -- # set +x 00:13:38.756 [2024-11-16 17:33:15.991929] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:38.756 [2024-11-16 17:33:15.992024] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:38.756 EAL: No free 2048 kB hugepages reported on node 1 00:13:38.756 [2024-11-16 17:33:16.072091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:38.756 [2024-11-16 17:33:16.169295] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:38.756 [2024-11-16 17:33:16.169447] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:38.756 [2024-11-16 17:33:16.169467] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:38.756 [2024-11-16 17:33:16.169482] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:38.756 [2024-11-16 17:33:16.169574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:38.756 [2024-11-16 17:33:16.169640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:38.756 [2024-11-16 17:33:16.172640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:38.756 [2024-11-16 17:33:16.172644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:39.689 17:33:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:39.689 17:33:17 -- common/autotest_common.sh@862 -- # return 0 00:13:39.689 17:33:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:39.689 17:33:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:39.689 17:33:17 -- common/autotest_common.sh@10 -- # set +x 00:13:39.689 17:33:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:39.689 17:33:17 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:39.689 17:33:17 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode532 00:13:39.946 [2024-11-16 17:33:17.355451] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:39.946 17:33:17 -- target/invalid.sh@40 -- # out='request: 00:13:39.946 { 00:13:39.946 "nqn": "nqn.2016-06.io.spdk:cnode532", 00:13:39.946 "tgt_name": "foobar", 00:13:39.946 "method": "nvmf_create_subsystem", 00:13:39.946 "req_id": 1 00:13:39.946 } 00:13:39.946 Got JSON-RPC error response 00:13:39.946 response: 00:13:39.946 { 00:13:39.946 "code": -32603, 00:13:39.946 "message": "Unable to find target foobar" 00:13:39.946 }' 00:13:39.946 17:33:17 -- target/invalid.sh@41 -- # [[ request: 00:13:39.946 { 00:13:39.947 "nqn": "nqn.2016-06.io.spdk:cnode532", 00:13:39.947 "tgt_name": "foobar", 00:13:39.947 "method": "nvmf_create_subsystem", 00:13:39.947 "req_id": 1 00:13:39.947 } 00:13:39.947 Got JSON-RPC error response 00:13:39.947 response: 00:13:39.947 { 00:13:39.947 "code": -32603, 00:13:39.947 "message": "Unable to find target foobar" 00:13:39.947 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:39.947 17:33:17 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:39.947 17:33:17 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode13800 00:13:40.205 [2024-11-16 17:33:17.636415] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13800: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:40.205 17:33:17 -- target/invalid.sh@45 -- # out='request: 00:13:40.205 { 00:13:40.205 "nqn": "nqn.2016-06.io.spdk:cnode13800", 00:13:40.205 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:40.205 "method": "nvmf_create_subsystem", 00:13:40.205 "req_id": 1 00:13:40.205 } 00:13:40.205 Got JSON-RPC error response 00:13:40.205 response: 00:13:40.205 { 00:13:40.205 "code": -32602, 00:13:40.205 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:40.205 }' 00:13:40.205 17:33:17 -- target/invalid.sh@46 -- # [[ request: 00:13:40.205 { 00:13:40.205 "nqn": "nqn.2016-06.io.spdk:cnode13800", 00:13:40.205 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:40.205 "method": "nvmf_create_subsystem", 00:13:40.205 "req_id": 1 00:13:40.205 } 00:13:40.205 Got JSON-RPC error response 00:13:40.205 response: 00:13:40.205 { 00:13:40.205 "code": -32602, 00:13:40.205 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:40.205 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:40.205 17:33:17 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:40.205 17:33:17 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode9487 00:13:40.463 [2024-11-16 17:33:17.909304] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9487: invalid model number 'SPDK_Controller' 00:13:40.463 17:33:17 -- target/invalid.sh@50 -- # out='request: 00:13:40.463 { 00:13:40.463 "nqn": "nqn.2016-06.io.spdk:cnode9487", 00:13:40.463 "model_number": "SPDK_Controller\u001f", 00:13:40.463 "method": "nvmf_create_subsystem", 00:13:40.463 "req_id": 1 00:13:40.463 } 00:13:40.463 Got JSON-RPC error response 00:13:40.463 response: 00:13:40.463 { 00:13:40.463 "code": -32602, 00:13:40.463 "message": "Invalid MN SPDK_Controller\u001f" 00:13:40.463 }' 00:13:40.463 17:33:17 -- target/invalid.sh@51 -- # [[ request: 00:13:40.463 { 00:13:40.463 "nqn": "nqn.2016-06.io.spdk:cnode9487", 00:13:40.463 "model_number": "SPDK_Controller\u001f", 00:13:40.463 "method": "nvmf_create_subsystem", 00:13:40.463 "req_id": 1 00:13:40.463 } 00:13:40.463 Got JSON-RPC error response 00:13:40.463 response: 00:13:40.463 { 00:13:40.463 "code": -32602, 00:13:40.463 "message": "Invalid MN SPDK_Controller\u001f" 00:13:40.463 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:40.463 17:33:17 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:40.463 17:33:17 -- target/invalid.sh@19 -- # local length=21 ll 00:13:40.463 17:33:17 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:40.463 17:33:17 -- target/invalid.sh@21 -- # local chars 00:13:40.463 17:33:17 -- target/invalid.sh@22 -- # local string 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # printf %x 99 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # string+=c 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # printf %x 32 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # string+=' ' 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # printf %x 95 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # string+=_ 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # printf %x 88 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x58' 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # string+=X 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # printf %x 123 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # string+='{' 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.463 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.463 17:33:17 -- target/invalid.sh@25 -- # printf %x 36 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x24' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+='$' 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 63 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+='?' 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 100 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=d 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 87 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=W 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 119 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=w 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 50 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=2 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 85 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=U 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 64 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=@ 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 99 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=c 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 111 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=o 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 58 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+=: 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 61 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+== 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 33 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # string+='!' 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:17 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # printf %x 78 00:13:40.721 17:33:17 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:40.721 17:33:18 -- target/invalid.sh@25 -- # string+=N 00:13:40.721 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:18 -- target/invalid.sh@25 -- # printf %x 107 00:13:40.721 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:40.721 17:33:18 -- target/invalid.sh@25 -- # string+=k 00:13:40.721 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:18 -- target/invalid.sh@25 -- # printf %x 123 00:13:40.721 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:40.721 17:33:18 -- target/invalid.sh@25 -- # string+='{' 00:13:40.721 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.721 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.721 17:33:18 -- target/invalid.sh@28 -- # [[ c == \- ]] 00:13:40.721 17:33:18 -- target/invalid.sh@31 -- # echo 'c _X{$?dWw2U@co:=!Nk{' 00:13:40.721 17:33:18 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'c _X{$?dWw2U@co:=!Nk{' nqn.2016-06.io.spdk:cnode7690 00:13:40.980 [2024-11-16 17:33:18.234359] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode7690: invalid serial number 'c _X{$?dWw2U@co:=!Nk{' 00:13:40.980 17:33:18 -- target/invalid.sh@54 -- # out='request: 00:13:40.980 { 00:13:40.980 "nqn": "nqn.2016-06.io.spdk:cnode7690", 00:13:40.980 "serial_number": "c _X{$?dWw2U@co:=!Nk{", 00:13:40.980 "method": "nvmf_create_subsystem", 00:13:40.980 "req_id": 1 00:13:40.980 } 00:13:40.980 Got JSON-RPC error response 00:13:40.980 response: 00:13:40.980 { 00:13:40.980 "code": -32602, 00:13:40.980 "message": "Invalid SN c _X{$?dWw2U@co:=!Nk{" 00:13:40.980 }' 00:13:40.980 17:33:18 -- target/invalid.sh@55 -- # [[ request: 00:13:40.980 { 00:13:40.980 "nqn": "nqn.2016-06.io.spdk:cnode7690", 00:13:40.980 "serial_number": "c _X{$?dWw2U@co:=!Nk{", 00:13:40.980 "method": "nvmf_create_subsystem", 00:13:40.980 "req_id": 1 00:13:40.980 } 00:13:40.980 Got JSON-RPC error response 00:13:40.980 response: 00:13:40.980 { 00:13:40.980 "code": -32602, 00:13:40.980 "message": "Invalid SN c _X{$?dWw2U@co:=!Nk{" 00:13:40.980 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:40.980 17:33:18 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:40.980 17:33:18 -- target/invalid.sh@19 -- # local length=41 ll 00:13:40.981 17:33:18 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:40.981 17:33:18 -- target/invalid.sh@21 -- # local chars 00:13:40.981 17:33:18 -- target/invalid.sh@22 -- # local string 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 102 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=f 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 66 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=B 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 60 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+='<' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 94 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+='^' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 60 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+='<' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 96 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+='`' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 66 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=B 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 70 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=F 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 98 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=b 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 41 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x29' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=')' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 61 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+== 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 84 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x54' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=T 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 90 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=Z 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 78 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=N 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 38 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+='&' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 46 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=. 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 96 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+='`' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 115 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=s 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 119 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=w 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 43 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=+ 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 64 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=@ 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 50 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=2 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 85 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=U 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 114 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=r 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 93 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=']' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 106 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=j 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 56 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=8 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 94 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+='^' 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 65 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=A 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 77 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=M 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 111 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=o 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # printf %x 112 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x70' 00:13:40.981 17:33:18 -- target/invalid.sh@25 -- # string+=p 00:13:40.981 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 40 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+='(' 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 71 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+=G 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 126 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+='~' 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 68 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+=D 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 54 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+=6 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 41 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x29' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+=')' 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 111 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+=o 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 102 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+=f 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # printf %x 75 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:40.982 17:33:18 -- target/invalid.sh@25 -- # string+=K 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:40.982 17:33:18 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:40.982 17:33:18 -- target/invalid.sh@28 -- # [[ f == \- ]] 00:13:40.982 17:33:18 -- target/invalid.sh@31 -- # echo 'fB<^<`BFb)=TZN&.`sw+@2Ur]j8^AMop(G~D6)ofK' 00:13:40.982 17:33:18 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'fB<^<`BFb)=TZN&.`sw+@2Ur]j8^AMop(G~D6)ofK' nqn.2016-06.io.spdk:cnode22882 00:13:41.240 [2024-11-16 17:33:18.643750] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22882: invalid model number 'fB<^<`BFb)=TZN&.`sw+@2Ur]j8^AMop(G~D6)ofK' 00:13:41.240 17:33:18 -- target/invalid.sh@58 -- # out='request: 00:13:41.240 { 00:13:41.240 "nqn": "nqn.2016-06.io.spdk:cnode22882", 00:13:41.240 "model_number": "fB<^<`BFb)=TZN&.`sw+@2Ur]j8^AMop(G~D6)ofK", 00:13:41.240 "method": "nvmf_create_subsystem", 00:13:41.240 "req_id": 1 00:13:41.240 } 00:13:41.240 Got JSON-RPC error response 00:13:41.240 response: 00:13:41.240 { 00:13:41.240 "code": -32602, 00:13:41.240 "message": "Invalid MN fB<^<`BFb)=TZN&.`sw+@2Ur]j8^AMop(G~D6)ofK" 00:13:41.240 }' 00:13:41.240 17:33:18 -- target/invalid.sh@59 -- # [[ request: 00:13:41.240 { 00:13:41.240 "nqn": "nqn.2016-06.io.spdk:cnode22882", 00:13:41.240 "model_number": "fB<^<`BFb)=TZN&.`sw+@2Ur]j8^AMop(G~D6)ofK", 00:13:41.240 "method": "nvmf_create_subsystem", 00:13:41.240 "req_id": 1 00:13:41.240 } 00:13:41.240 Got JSON-RPC error response 00:13:41.240 response: 00:13:41.240 { 00:13:41.240 "code": -32602, 00:13:41.240 "message": "Invalid MN fB<^<`BFb)=TZN&.`sw+@2Ur]j8^AMop(G~D6)ofK" 00:13:41.240 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:41.240 17:33:18 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:41.498 [2024-11-16 17:33:18.896669] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:41.498 17:33:18 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:41.756 17:33:19 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:41.756 17:33:19 -- target/invalid.sh@67 -- # echo '' 00:13:41.756 17:33:19 -- target/invalid.sh@67 -- # head -n 1 00:13:41.756 17:33:19 -- target/invalid.sh@67 -- # IP= 00:13:41.756 17:33:19 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:42.013 [2024-11-16 17:33:19.406424] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:42.013 17:33:19 -- target/invalid.sh@69 -- # out='request: 00:13:42.013 { 00:13:42.013 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:42.013 "listen_address": { 00:13:42.013 "trtype": "tcp", 00:13:42.013 "traddr": "", 00:13:42.013 "trsvcid": "4421" 00:13:42.013 }, 00:13:42.013 "method": "nvmf_subsystem_remove_listener", 00:13:42.013 "req_id": 1 00:13:42.013 } 00:13:42.013 Got JSON-RPC error response 00:13:42.013 response: 00:13:42.013 { 00:13:42.013 "code": -32602, 00:13:42.013 "message": "Invalid parameters" 00:13:42.013 }' 00:13:42.013 17:33:19 -- target/invalid.sh@70 -- # [[ request: 00:13:42.013 { 00:13:42.013 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:42.013 "listen_address": { 00:13:42.013 "trtype": "tcp", 00:13:42.013 "traddr": "", 00:13:42.013 "trsvcid": "4421" 00:13:42.013 }, 00:13:42.013 "method": "nvmf_subsystem_remove_listener", 00:13:42.013 "req_id": 1 00:13:42.013 } 00:13:42.013 Got JSON-RPC error response 00:13:42.013 response: 00:13:42.013 { 00:13:42.013 "code": -32602, 00:13:42.013 "message": "Invalid parameters" 00:13:42.013 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:42.013 17:33:19 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1266 -i 0 00:13:42.271 [2024-11-16 17:33:19.655173] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1266: invalid cntlid range [0-65519] 00:13:42.271 17:33:19 -- target/invalid.sh@73 -- # out='request: 00:13:42.271 { 00:13:42.271 "nqn": "nqn.2016-06.io.spdk:cnode1266", 00:13:42.271 "min_cntlid": 0, 00:13:42.271 "method": "nvmf_create_subsystem", 00:13:42.271 "req_id": 1 00:13:42.271 } 00:13:42.271 Got JSON-RPC error response 00:13:42.271 response: 00:13:42.271 { 00:13:42.271 "code": -32602, 00:13:42.271 "message": "Invalid cntlid range [0-65519]" 00:13:42.271 }' 00:13:42.271 17:33:19 -- target/invalid.sh@74 -- # [[ request: 00:13:42.271 { 00:13:42.271 "nqn": "nqn.2016-06.io.spdk:cnode1266", 00:13:42.271 "min_cntlid": 0, 00:13:42.271 "method": "nvmf_create_subsystem", 00:13:42.271 "req_id": 1 00:13:42.271 } 00:13:42.271 Got JSON-RPC error response 00:13:42.271 response: 00:13:42.271 { 00:13:42.271 "code": -32602, 00:13:42.271 "message": "Invalid cntlid range [0-65519]" 00:13:42.271 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:42.271 17:33:19 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14804 -i 65520 00:13:42.529 [2024-11-16 17:33:19.904031] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14804: invalid cntlid range [65520-65519] 00:13:42.529 17:33:19 -- target/invalid.sh@75 -- # out='request: 00:13:42.529 { 00:13:42.529 "nqn": "nqn.2016-06.io.spdk:cnode14804", 00:13:42.529 "min_cntlid": 65520, 00:13:42.529 "method": "nvmf_create_subsystem", 00:13:42.529 "req_id": 1 00:13:42.529 } 00:13:42.529 Got JSON-RPC error response 00:13:42.529 response: 00:13:42.529 { 00:13:42.529 "code": -32602, 00:13:42.529 "message": "Invalid cntlid range [65520-65519]" 00:13:42.529 }' 00:13:42.529 17:33:19 -- target/invalid.sh@76 -- # [[ request: 00:13:42.529 { 00:13:42.529 "nqn": "nqn.2016-06.io.spdk:cnode14804", 00:13:42.529 "min_cntlid": 65520, 00:13:42.529 "method": "nvmf_create_subsystem", 00:13:42.529 "req_id": 1 00:13:42.529 } 00:13:42.529 Got JSON-RPC error response 00:13:42.529 response: 00:13:42.529 { 00:13:42.529 "code": -32602, 00:13:42.529 "message": "Invalid cntlid range [65520-65519]" 00:13:42.529 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:42.529 17:33:19 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24997 -I 0 00:13:42.787 [2024-11-16 17:33:20.189036] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24997: invalid cntlid range [1-0] 00:13:42.787 17:33:20 -- target/invalid.sh@77 -- # out='request: 00:13:42.787 { 00:13:42.787 "nqn": "nqn.2016-06.io.spdk:cnode24997", 00:13:42.787 "max_cntlid": 0, 00:13:42.787 "method": "nvmf_create_subsystem", 00:13:42.787 "req_id": 1 00:13:42.787 } 00:13:42.787 Got JSON-RPC error response 00:13:42.787 response: 00:13:42.787 { 00:13:42.787 "code": -32602, 00:13:42.787 "message": "Invalid cntlid range [1-0]" 00:13:42.787 }' 00:13:42.787 17:33:20 -- target/invalid.sh@78 -- # [[ request: 00:13:42.787 { 00:13:42.787 "nqn": "nqn.2016-06.io.spdk:cnode24997", 00:13:42.787 "max_cntlid": 0, 00:13:42.787 "method": "nvmf_create_subsystem", 00:13:42.787 "req_id": 1 00:13:42.787 } 00:13:42.787 Got JSON-RPC error response 00:13:42.787 response: 00:13:42.787 { 00:13:42.787 "code": -32602, 00:13:42.787 "message": "Invalid cntlid range [1-0]" 00:13:42.787 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:42.787 17:33:20 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode29811 -I 65520 00:13:43.045 [2024-11-16 17:33:20.445899] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29811: invalid cntlid range [1-65520] 00:13:43.045 17:33:20 -- target/invalid.sh@79 -- # out='request: 00:13:43.045 { 00:13:43.045 "nqn": "nqn.2016-06.io.spdk:cnode29811", 00:13:43.045 "max_cntlid": 65520, 00:13:43.045 "method": "nvmf_create_subsystem", 00:13:43.045 "req_id": 1 00:13:43.045 } 00:13:43.045 Got JSON-RPC error response 00:13:43.045 response: 00:13:43.045 { 00:13:43.045 "code": -32602, 00:13:43.045 "message": "Invalid cntlid range [1-65520]" 00:13:43.045 }' 00:13:43.045 17:33:20 -- target/invalid.sh@80 -- # [[ request: 00:13:43.045 { 00:13:43.045 "nqn": "nqn.2016-06.io.spdk:cnode29811", 00:13:43.045 "max_cntlid": 65520, 00:13:43.045 "method": "nvmf_create_subsystem", 00:13:43.045 "req_id": 1 00:13:43.045 } 00:13:43.045 Got JSON-RPC error response 00:13:43.045 response: 00:13:43.045 { 00:13:43.045 "code": -32602, 00:13:43.045 "message": "Invalid cntlid range [1-65520]" 00:13:43.045 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:43.045 17:33:20 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode26443 -i 6 -I 5 00:13:43.303 [2024-11-16 17:33:20.694770] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26443: invalid cntlid range [6-5] 00:13:43.303 17:33:20 -- target/invalid.sh@83 -- # out='request: 00:13:43.303 { 00:13:43.303 "nqn": "nqn.2016-06.io.spdk:cnode26443", 00:13:43.303 "min_cntlid": 6, 00:13:43.303 "max_cntlid": 5, 00:13:43.303 "method": "nvmf_create_subsystem", 00:13:43.303 "req_id": 1 00:13:43.303 } 00:13:43.303 Got JSON-RPC error response 00:13:43.303 response: 00:13:43.303 { 00:13:43.303 "code": -32602, 00:13:43.303 "message": "Invalid cntlid range [6-5]" 00:13:43.303 }' 00:13:43.303 17:33:20 -- target/invalid.sh@84 -- # [[ request: 00:13:43.303 { 00:13:43.303 "nqn": "nqn.2016-06.io.spdk:cnode26443", 00:13:43.303 "min_cntlid": 6, 00:13:43.303 "max_cntlid": 5, 00:13:43.303 "method": "nvmf_create_subsystem", 00:13:43.303 "req_id": 1 00:13:43.303 } 00:13:43.303 Got JSON-RPC error response 00:13:43.303 response: 00:13:43.303 { 00:13:43.303 "code": -32602, 00:13:43.303 "message": "Invalid cntlid range [6-5]" 00:13:43.303 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:43.303 17:33:20 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:43.561 17:33:20 -- target/invalid.sh@87 -- # out='request: 00:13:43.561 { 00:13:43.561 "name": "foobar", 00:13:43.561 "method": "nvmf_delete_target", 00:13:43.561 "req_id": 1 00:13:43.561 } 00:13:43.561 Got JSON-RPC error response 00:13:43.561 response: 00:13:43.561 { 00:13:43.561 "code": -32602, 00:13:43.561 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:43.561 }' 00:13:43.561 17:33:20 -- target/invalid.sh@88 -- # [[ request: 00:13:43.561 { 00:13:43.561 "name": "foobar", 00:13:43.561 "method": "nvmf_delete_target", 00:13:43.561 "req_id": 1 00:13:43.561 } 00:13:43.561 Got JSON-RPC error response 00:13:43.561 response: 00:13:43.561 { 00:13:43.561 "code": -32602, 00:13:43.561 "message": "The specified target doesn't exist, cannot delete it." 00:13:43.561 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:43.561 17:33:20 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:43.561 17:33:20 -- target/invalid.sh@91 -- # nvmftestfini 00:13:43.561 17:33:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:43.561 17:33:20 -- nvmf/common.sh@116 -- # sync 00:13:43.561 17:33:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:43.561 17:33:20 -- nvmf/common.sh@119 -- # set +e 00:13:43.561 17:33:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:43.561 17:33:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:43.561 rmmod nvme_tcp 00:13:43.561 rmmod nvme_fabrics 00:13:43.561 rmmod nvme_keyring 00:13:43.561 17:33:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:43.561 17:33:20 -- nvmf/common.sh@123 -- # set -e 00:13:43.561 17:33:20 -- nvmf/common.sh@124 -- # return 0 00:13:43.561 17:33:20 -- nvmf/common.sh@477 -- # '[' -n 1533152 ']' 00:13:43.561 17:33:20 -- nvmf/common.sh@478 -- # killprocess 1533152 00:13:43.561 17:33:20 -- common/autotest_common.sh@936 -- # '[' -z 1533152 ']' 00:13:43.561 17:33:20 -- common/autotest_common.sh@940 -- # kill -0 1533152 00:13:43.561 17:33:20 -- common/autotest_common.sh@941 -- # uname 00:13:43.561 17:33:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:43.561 17:33:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1533152 00:13:43.561 17:33:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:43.561 17:33:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:43.561 17:33:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1533152' 00:13:43.561 killing process with pid 1533152 00:13:43.561 17:33:20 -- common/autotest_common.sh@955 -- # kill 1533152 00:13:43.561 17:33:20 -- common/autotest_common.sh@960 -- # wait 1533152 00:13:43.821 17:33:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:43.821 17:33:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:43.821 17:33:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:43.821 17:33:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:43.821 17:33:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:43.821 17:33:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.821 17:33:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.821 17:33:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:45.727 17:33:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:45.727 00:13:45.727 real 0m9.596s 00:13:45.727 user 0m23.985s 00:13:45.727 sys 0m2.534s 00:13:45.727 17:33:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:45.727 17:33:23 -- common/autotest_common.sh@10 -- # set +x 00:13:45.727 ************************************ 00:13:45.727 END TEST nvmf_invalid 00:13:45.727 ************************************ 00:13:45.727 17:33:23 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:45.727 17:33:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:45.727 17:33:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:45.727 17:33:23 -- common/autotest_common.sh@10 -- # set +x 00:13:45.727 ************************************ 00:13:45.727 START TEST nvmf_abort 00:13:45.727 ************************************ 00:13:45.727 17:33:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:45.987 * Looking for test storage... 00:13:45.987 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:45.987 17:33:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:45.987 17:33:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:45.987 17:33:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:45.987 17:33:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:45.987 17:33:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:45.987 17:33:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:45.987 17:33:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:45.987 17:33:23 -- scripts/common.sh@335 -- # IFS=.-: 00:13:45.987 17:33:23 -- scripts/common.sh@335 -- # read -ra ver1 00:13:45.987 17:33:23 -- scripts/common.sh@336 -- # IFS=.-: 00:13:45.987 17:33:23 -- scripts/common.sh@336 -- # read -ra ver2 00:13:45.987 17:33:23 -- scripts/common.sh@337 -- # local 'op=<' 00:13:45.987 17:33:23 -- scripts/common.sh@339 -- # ver1_l=2 00:13:45.987 17:33:23 -- scripts/common.sh@340 -- # ver2_l=1 00:13:45.987 17:33:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:45.987 17:33:23 -- scripts/common.sh@343 -- # case "$op" in 00:13:45.987 17:33:23 -- scripts/common.sh@344 -- # : 1 00:13:45.987 17:33:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:45.987 17:33:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:45.987 17:33:23 -- scripts/common.sh@364 -- # decimal 1 00:13:45.987 17:33:23 -- scripts/common.sh@352 -- # local d=1 00:13:45.987 17:33:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:45.987 17:33:23 -- scripts/common.sh@354 -- # echo 1 00:13:45.987 17:33:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:45.987 17:33:23 -- scripts/common.sh@365 -- # decimal 2 00:13:45.987 17:33:23 -- scripts/common.sh@352 -- # local d=2 00:13:45.987 17:33:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:45.987 17:33:23 -- scripts/common.sh@354 -- # echo 2 00:13:45.987 17:33:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:45.987 17:33:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:45.987 17:33:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:45.987 17:33:23 -- scripts/common.sh@367 -- # return 0 00:13:45.987 17:33:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:45.987 17:33:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:45.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.987 --rc genhtml_branch_coverage=1 00:13:45.987 --rc genhtml_function_coverage=1 00:13:45.987 --rc genhtml_legend=1 00:13:45.987 --rc geninfo_all_blocks=1 00:13:45.987 --rc geninfo_unexecuted_blocks=1 00:13:45.987 00:13:45.987 ' 00:13:45.987 17:33:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:45.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.987 --rc genhtml_branch_coverage=1 00:13:45.987 --rc genhtml_function_coverage=1 00:13:45.987 --rc genhtml_legend=1 00:13:45.987 --rc geninfo_all_blocks=1 00:13:45.987 --rc geninfo_unexecuted_blocks=1 00:13:45.987 00:13:45.987 ' 00:13:45.987 17:33:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:45.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.987 --rc genhtml_branch_coverage=1 00:13:45.987 --rc genhtml_function_coverage=1 00:13:45.987 --rc genhtml_legend=1 00:13:45.987 --rc geninfo_all_blocks=1 00:13:45.987 --rc geninfo_unexecuted_blocks=1 00:13:45.987 00:13:45.987 ' 00:13:45.987 17:33:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:45.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:45.987 --rc genhtml_branch_coverage=1 00:13:45.987 --rc genhtml_function_coverage=1 00:13:45.987 --rc genhtml_legend=1 00:13:45.987 --rc geninfo_all_blocks=1 00:13:45.987 --rc geninfo_unexecuted_blocks=1 00:13:45.987 00:13:45.987 ' 00:13:45.987 17:33:23 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:45.987 17:33:23 -- nvmf/common.sh@7 -- # uname -s 00:13:45.987 17:33:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:45.987 17:33:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:45.987 17:33:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:45.987 17:33:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:45.987 17:33:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:45.987 17:33:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:45.987 17:33:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:45.987 17:33:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:45.987 17:33:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:45.987 17:33:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:45.987 17:33:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:45.987 17:33:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:45.987 17:33:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:45.987 17:33:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:45.987 17:33:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:45.987 17:33:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:45.987 17:33:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:45.987 17:33:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:45.987 17:33:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:45.987 17:33:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.987 17:33:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.987 17:33:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.987 17:33:23 -- paths/export.sh@5 -- # export PATH 00:13:45.987 17:33:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:45.987 17:33:23 -- nvmf/common.sh@46 -- # : 0 00:13:45.987 17:33:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:45.987 17:33:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:45.987 17:33:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:45.987 17:33:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:45.987 17:33:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:45.987 17:33:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:45.987 17:33:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:45.987 17:33:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:45.987 17:33:23 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:45.987 17:33:23 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:45.987 17:33:23 -- target/abort.sh@14 -- # nvmftestinit 00:13:45.988 17:33:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:45.988 17:33:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:45.988 17:33:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:45.988 17:33:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:45.988 17:33:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:45.988 17:33:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:45.988 17:33:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:45.988 17:33:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:45.988 17:33:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:45.988 17:33:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:45.988 17:33:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:45.988 17:33:23 -- common/autotest_common.sh@10 -- # set +x 00:13:48.516 17:33:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:48.516 17:33:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:48.516 17:33:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:48.516 17:33:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:48.516 17:33:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:48.516 17:33:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:48.516 17:33:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:48.516 17:33:25 -- nvmf/common.sh@294 -- # net_devs=() 00:13:48.516 17:33:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:48.516 17:33:25 -- nvmf/common.sh@295 -- # e810=() 00:13:48.516 17:33:25 -- nvmf/common.sh@295 -- # local -ga e810 00:13:48.516 17:33:25 -- nvmf/common.sh@296 -- # x722=() 00:13:48.516 17:33:25 -- nvmf/common.sh@296 -- # local -ga x722 00:13:48.516 17:33:25 -- nvmf/common.sh@297 -- # mlx=() 00:13:48.516 17:33:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:48.516 17:33:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:48.516 17:33:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:48.516 17:33:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:48.516 17:33:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:48.516 17:33:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.516 17:33:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:48.516 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:48.516 17:33:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.516 17:33:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:48.516 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:48.516 17:33:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:48.516 17:33:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.516 17:33:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.516 17:33:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.516 17:33:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.516 17:33:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:48.516 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:48.516 17:33:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.516 17:33:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.516 17:33:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.516 17:33:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.516 17:33:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.516 17:33:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:48.516 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:48.516 17:33:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.516 17:33:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:48.516 17:33:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:48.516 17:33:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:48.516 17:33:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:48.516 17:33:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:48.516 17:33:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:48.516 17:33:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:48.516 17:33:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:48.516 17:33:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:48.516 17:33:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:48.516 17:33:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:48.516 17:33:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:48.516 17:33:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:48.516 17:33:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:48.516 17:33:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:48.516 17:33:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:48.516 17:33:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:48.516 17:33:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:48.517 17:33:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:48.517 17:33:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:48.517 17:33:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:48.517 17:33:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:48.517 17:33:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:48.517 17:33:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:48.517 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:48.517 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:13:48.517 00:13:48.517 --- 10.0.0.2 ping statistics --- 00:13:48.517 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.517 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:13:48.517 17:33:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:48.517 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:48.517 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.158 ms 00:13:48.517 00:13:48.517 --- 10.0.0.1 ping statistics --- 00:13:48.517 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.517 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:13:48.517 17:33:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:48.517 17:33:25 -- nvmf/common.sh@410 -- # return 0 00:13:48.517 17:33:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:48.517 17:33:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:48.517 17:33:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:48.517 17:33:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:48.517 17:33:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:48.517 17:33:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:48.517 17:33:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:48.517 17:33:25 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:48.517 17:33:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:48.517 17:33:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:48.517 17:33:25 -- common/autotest_common.sh@10 -- # set +x 00:13:48.517 17:33:25 -- nvmf/common.sh@469 -- # nvmfpid=1535836 00:13:48.517 17:33:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:48.517 17:33:25 -- nvmf/common.sh@470 -- # waitforlisten 1535836 00:13:48.517 17:33:25 -- common/autotest_common.sh@829 -- # '[' -z 1535836 ']' 00:13:48.517 17:33:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:48.517 17:33:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:48.517 17:33:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:48.517 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:48.517 17:33:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:48.517 17:33:25 -- common/autotest_common.sh@10 -- # set +x 00:13:48.517 [2024-11-16 17:33:25.698210] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:48.517 [2024-11-16 17:33:25.698298] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:48.517 EAL: No free 2048 kB hugepages reported on node 1 00:13:48.517 [2024-11-16 17:33:25.766449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:48.517 [2024-11-16 17:33:25.852584] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:48.517 [2024-11-16 17:33:25.852794] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:48.517 [2024-11-16 17:33:25.852813] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:48.517 [2024-11-16 17:33:25.852826] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:48.517 [2024-11-16 17:33:25.852915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:48.517 [2024-11-16 17:33:25.852989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:48.517 [2024-11-16 17:33:25.852991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:49.450 17:33:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:49.450 17:33:26 -- common/autotest_common.sh@862 -- # return 0 00:13:49.450 17:33:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:49.450 17:33:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:49.450 17:33:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.450 17:33:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:49.450 17:33:26 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:49.450 17:33:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.450 17:33:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.450 [2024-11-16 17:33:26.755704] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:49.450 17:33:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.450 17:33:26 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:49.450 17:33:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.450 17:33:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.450 Malloc0 00:13:49.450 17:33:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.450 17:33:26 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:49.450 17:33:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.450 17:33:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.450 Delay0 00:13:49.450 17:33:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.450 17:33:26 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:49.450 17:33:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.450 17:33:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.450 17:33:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.450 17:33:26 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:49.450 17:33:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.450 17:33:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.450 17:33:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.450 17:33:26 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:49.450 17:33:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.450 17:33:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.450 [2024-11-16 17:33:26.823575] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:49.450 17:33:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.450 17:33:26 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:49.450 17:33:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.450 17:33:26 -- common/autotest_common.sh@10 -- # set +x 00:13:49.450 17:33:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.450 17:33:26 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:49.450 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.450 [2024-11-16 17:33:26.929455] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:51.981 Initializing NVMe Controllers 00:13:51.981 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:51.981 controller IO queue size 128 less than required 00:13:51.981 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:51.981 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:51.981 Initialization complete. Launching workers. 00:13:51.981 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 124, failed: 33291 00:13:51.981 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33353, failed to submit 62 00:13:51.981 success 33291, unsuccess 62, failed 0 00:13:51.981 17:33:28 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:51.981 17:33:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.981 17:33:28 -- common/autotest_common.sh@10 -- # set +x 00:13:51.981 17:33:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.981 17:33:28 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:51.981 17:33:28 -- target/abort.sh@38 -- # nvmftestfini 00:13:51.981 17:33:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:51.981 17:33:28 -- nvmf/common.sh@116 -- # sync 00:13:51.981 17:33:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:51.981 17:33:28 -- nvmf/common.sh@119 -- # set +e 00:13:51.981 17:33:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:51.981 17:33:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:51.981 rmmod nvme_tcp 00:13:51.981 rmmod nvme_fabrics 00:13:51.981 rmmod nvme_keyring 00:13:51.981 17:33:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:51.981 17:33:29 -- nvmf/common.sh@123 -- # set -e 00:13:51.981 17:33:29 -- nvmf/common.sh@124 -- # return 0 00:13:51.981 17:33:29 -- nvmf/common.sh@477 -- # '[' -n 1535836 ']' 00:13:51.981 17:33:29 -- nvmf/common.sh@478 -- # killprocess 1535836 00:13:51.981 17:33:29 -- common/autotest_common.sh@936 -- # '[' -z 1535836 ']' 00:13:51.981 17:33:29 -- common/autotest_common.sh@940 -- # kill -0 1535836 00:13:51.981 17:33:29 -- common/autotest_common.sh@941 -- # uname 00:13:51.981 17:33:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:51.981 17:33:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1535836 00:13:51.981 17:33:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:51.981 17:33:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:51.981 17:33:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1535836' 00:13:51.981 killing process with pid 1535836 00:13:51.981 17:33:29 -- common/autotest_common.sh@955 -- # kill 1535836 00:13:51.981 17:33:29 -- common/autotest_common.sh@960 -- # wait 1535836 00:13:51.981 17:33:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:51.981 17:33:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:51.981 17:33:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:51.981 17:33:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:51.981 17:33:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:51.981 17:33:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.981 17:33:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.981 17:33:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:53.884 17:33:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:53.884 00:13:53.884 real 0m8.133s 00:13:53.884 user 0m12.934s 00:13:53.884 sys 0m2.653s 00:13:53.884 17:33:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:53.884 17:33:31 -- common/autotest_common.sh@10 -- # set +x 00:13:53.884 ************************************ 00:13:53.884 END TEST nvmf_abort 00:13:53.884 ************************************ 00:13:53.884 17:33:31 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:53.884 17:33:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:53.884 17:33:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:53.884 17:33:31 -- common/autotest_common.sh@10 -- # set +x 00:13:53.884 ************************************ 00:13:53.884 START TEST nvmf_ns_hotplug_stress 00:13:53.884 ************************************ 00:13:54.143 17:33:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:54.143 * Looking for test storage... 00:13:54.143 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:54.143 17:33:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:54.143 17:33:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:54.143 17:33:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:54.143 17:33:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:54.143 17:33:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:54.143 17:33:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:54.143 17:33:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:54.143 17:33:31 -- scripts/common.sh@335 -- # IFS=.-: 00:13:54.143 17:33:31 -- scripts/common.sh@335 -- # read -ra ver1 00:13:54.143 17:33:31 -- scripts/common.sh@336 -- # IFS=.-: 00:13:54.143 17:33:31 -- scripts/common.sh@336 -- # read -ra ver2 00:13:54.143 17:33:31 -- scripts/common.sh@337 -- # local 'op=<' 00:13:54.143 17:33:31 -- scripts/common.sh@339 -- # ver1_l=2 00:13:54.143 17:33:31 -- scripts/common.sh@340 -- # ver2_l=1 00:13:54.143 17:33:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:54.143 17:33:31 -- scripts/common.sh@343 -- # case "$op" in 00:13:54.143 17:33:31 -- scripts/common.sh@344 -- # : 1 00:13:54.143 17:33:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:54.143 17:33:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:54.143 17:33:31 -- scripts/common.sh@364 -- # decimal 1 00:13:54.143 17:33:31 -- scripts/common.sh@352 -- # local d=1 00:13:54.143 17:33:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:54.143 17:33:31 -- scripts/common.sh@354 -- # echo 1 00:13:54.143 17:33:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:54.143 17:33:31 -- scripts/common.sh@365 -- # decimal 2 00:13:54.143 17:33:31 -- scripts/common.sh@352 -- # local d=2 00:13:54.143 17:33:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:54.143 17:33:31 -- scripts/common.sh@354 -- # echo 2 00:13:54.143 17:33:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:54.143 17:33:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:54.143 17:33:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:54.143 17:33:31 -- scripts/common.sh@367 -- # return 0 00:13:54.143 17:33:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:54.143 17:33:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:54.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:54.143 --rc genhtml_branch_coverage=1 00:13:54.143 --rc genhtml_function_coverage=1 00:13:54.143 --rc genhtml_legend=1 00:13:54.143 --rc geninfo_all_blocks=1 00:13:54.143 --rc geninfo_unexecuted_blocks=1 00:13:54.143 00:13:54.143 ' 00:13:54.143 17:33:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:54.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:54.143 --rc genhtml_branch_coverage=1 00:13:54.143 --rc genhtml_function_coverage=1 00:13:54.143 --rc genhtml_legend=1 00:13:54.143 --rc geninfo_all_blocks=1 00:13:54.143 --rc geninfo_unexecuted_blocks=1 00:13:54.143 00:13:54.143 ' 00:13:54.143 17:33:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:54.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:54.143 --rc genhtml_branch_coverage=1 00:13:54.143 --rc genhtml_function_coverage=1 00:13:54.143 --rc genhtml_legend=1 00:13:54.143 --rc geninfo_all_blocks=1 00:13:54.143 --rc geninfo_unexecuted_blocks=1 00:13:54.143 00:13:54.143 ' 00:13:54.143 17:33:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:54.143 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:54.143 --rc genhtml_branch_coverage=1 00:13:54.143 --rc genhtml_function_coverage=1 00:13:54.143 --rc genhtml_legend=1 00:13:54.143 --rc geninfo_all_blocks=1 00:13:54.143 --rc geninfo_unexecuted_blocks=1 00:13:54.143 00:13:54.143 ' 00:13:54.143 17:33:31 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:54.143 17:33:31 -- nvmf/common.sh@7 -- # uname -s 00:13:54.143 17:33:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:54.143 17:33:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:54.143 17:33:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:54.143 17:33:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:54.143 17:33:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:54.143 17:33:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:54.143 17:33:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:54.143 17:33:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:54.143 17:33:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:54.143 17:33:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:54.143 17:33:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:54.143 17:33:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:54.143 17:33:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:54.143 17:33:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:54.143 17:33:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:54.143 17:33:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:54.143 17:33:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:54.143 17:33:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:54.143 17:33:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:54.143 17:33:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:54.143 17:33:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:54.143 17:33:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:54.143 17:33:31 -- paths/export.sh@5 -- # export PATH 00:13:54.143 17:33:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:54.143 17:33:31 -- nvmf/common.sh@46 -- # : 0 00:13:54.143 17:33:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:54.143 17:33:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:54.143 17:33:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:54.143 17:33:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:54.143 17:33:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:54.143 17:33:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:54.143 17:33:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:54.143 17:33:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:54.143 17:33:31 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:54.143 17:33:31 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:54.143 17:33:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:54.143 17:33:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:54.143 17:33:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:54.143 17:33:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:54.143 17:33:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:54.143 17:33:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:54.143 17:33:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:54.143 17:33:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:54.143 17:33:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:54.143 17:33:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:54.143 17:33:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:54.143 17:33:31 -- common/autotest_common.sh@10 -- # set +x 00:13:56.045 17:33:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:56.045 17:33:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:56.045 17:33:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:56.045 17:33:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:56.045 17:33:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:56.045 17:33:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:56.045 17:33:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:56.045 17:33:33 -- nvmf/common.sh@294 -- # net_devs=() 00:13:56.045 17:33:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:56.045 17:33:33 -- nvmf/common.sh@295 -- # e810=() 00:13:56.045 17:33:33 -- nvmf/common.sh@295 -- # local -ga e810 00:13:56.045 17:33:33 -- nvmf/common.sh@296 -- # x722=() 00:13:56.045 17:33:33 -- nvmf/common.sh@296 -- # local -ga x722 00:13:56.045 17:33:33 -- nvmf/common.sh@297 -- # mlx=() 00:13:56.045 17:33:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:56.045 17:33:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:56.045 17:33:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:56.045 17:33:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:56.045 17:33:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:56.045 17:33:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:56.045 17:33:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:56.045 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:56.045 17:33:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:56.045 17:33:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:56.045 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:56.045 17:33:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:56.045 17:33:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:56.045 17:33:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.045 17:33:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:56.045 17:33:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.045 17:33:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:56.045 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:56.045 17:33:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.045 17:33:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:56.045 17:33:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.045 17:33:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:56.045 17:33:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.045 17:33:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:56.045 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:56.045 17:33:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.045 17:33:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:56.045 17:33:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:56.045 17:33:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:56.045 17:33:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:56.045 17:33:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:56.045 17:33:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:56.045 17:33:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:56.045 17:33:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:56.045 17:33:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:56.045 17:33:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:56.045 17:33:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:56.045 17:33:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:56.045 17:33:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:56.045 17:33:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:56.045 17:33:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:56.045 17:33:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:56.045 17:33:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:56.045 17:33:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:56.045 17:33:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:56.045 17:33:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:56.045 17:33:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:56.304 17:33:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:56.304 17:33:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:56.304 17:33:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:56.304 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:56.304 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:13:56.304 00:13:56.304 --- 10.0.0.2 ping statistics --- 00:13:56.304 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.304 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:13:56.304 17:33:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:56.304 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:56.304 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.067 ms 00:13:56.304 00:13:56.304 --- 10.0.0.1 ping statistics --- 00:13:56.304 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.304 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:13:56.304 17:33:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:56.304 17:33:33 -- nvmf/common.sh@410 -- # return 0 00:13:56.304 17:33:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:56.304 17:33:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:56.304 17:33:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:56.304 17:33:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:56.304 17:33:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:56.304 17:33:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:56.304 17:33:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:56.304 17:33:33 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:56.304 17:33:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:56.304 17:33:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:56.304 17:33:33 -- common/autotest_common.sh@10 -- # set +x 00:13:56.304 17:33:33 -- nvmf/common.sh@469 -- # nvmfpid=1538225 00:13:56.304 17:33:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:56.304 17:33:33 -- nvmf/common.sh@470 -- # waitforlisten 1538225 00:13:56.304 17:33:33 -- common/autotest_common.sh@829 -- # '[' -z 1538225 ']' 00:13:56.304 17:33:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:56.304 17:33:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:56.304 17:33:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:56.304 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:56.304 17:33:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:56.304 17:33:33 -- common/autotest_common.sh@10 -- # set +x 00:13:56.304 [2024-11-16 17:33:33.657158] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:56.304 [2024-11-16 17:33:33.657228] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:56.304 EAL: No free 2048 kB hugepages reported on node 1 00:13:56.304 [2024-11-16 17:33:33.726481] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:56.563 [2024-11-16 17:33:33.821147] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:56.563 [2024-11-16 17:33:33.821313] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:56.563 [2024-11-16 17:33:33.821333] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:56.563 [2024-11-16 17:33:33.821347] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:56.563 [2024-11-16 17:33:33.821437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:56.563 [2024-11-16 17:33:33.821502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:56.563 [2024-11-16 17:33:33.821499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:57.129 17:33:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:57.129 17:33:34 -- common/autotest_common.sh@862 -- # return 0 00:13:57.129 17:33:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:57.129 17:33:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:57.129 17:33:34 -- common/autotest_common.sh@10 -- # set +x 00:13:57.387 17:33:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:57.387 17:33:34 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:57.387 17:33:34 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:57.666 [2024-11-16 17:33:34.925364] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:57.666 17:33:34 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:57.965 17:33:35 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:58.224 [2024-11-16 17:33:35.464444] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:58.224 17:33:35 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:58.482 17:33:35 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:58.740 Malloc0 00:13:58.740 17:33:36 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:58.998 Delay0 00:13:58.998 17:33:36 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.255 17:33:36 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:59.513 NULL1 00:13:59.513 17:33:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:59.771 17:33:37 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1538734 00:13:59.771 17:33:37 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:59.771 17:33:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:13:59.771 17:33:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.771 EAL: No free 2048 kB hugepages reported on node 1 00:14:00.704 Read completed with error (sct=0, sc=11) 00:14:00.704 17:33:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.704 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:00.962 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:00.962 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:00.962 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:00.962 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:00.962 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:00.962 17:33:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:00.962 17:33:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:01.219 true 00:14:01.219 17:33:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:01.219 17:33:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:02.151 17:33:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.409 17:33:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:02.409 17:33:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:02.667 true 00:14:02.667 17:33:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:02.667 17:33:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:02.925 17:33:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.182 17:33:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:03.182 17:33:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:03.441 true 00:14:03.441 17:33:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:03.441 17:33:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.698 17:33:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.956 17:33:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:03.956 17:33:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:04.214 true 00:14:04.214 17:33:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:04.214 17:33:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:05.147 17:33:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.147 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:05.404 17:33:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:05.404 17:33:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:05.662 true 00:14:05.662 17:33:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:05.662 17:33:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.919 17:33:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.177 17:33:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:06.177 17:33:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:06.435 true 00:14:06.435 17:33:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:06.435 17:33:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.368 17:33:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.626 17:33:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:07.626 17:33:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:07.883 true 00:14:07.883 17:33:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:07.883 17:33:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.141 17:33:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.399 17:33:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:08.399 17:33:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:08.657 true 00:14:08.657 17:33:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:08.657 17:33:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.913 17:33:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.170 17:33:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:09.170 17:33:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:09.428 true 00:14:09.428 17:33:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:09.428 17:33:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.801 17:33:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.801 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.801 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.801 17:33:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:10.801 17:33:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:11.059 true 00:14:11.059 17:33:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:11.059 17:33:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.316 17:33:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.573 17:33:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:11.573 17:33:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:11.831 true 00:14:11.831 17:33:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:11.831 17:33:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.764 17:33:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.764 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.764 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.764 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:13.022 17:33:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:13.022 17:33:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:13.279 true 00:14:13.279 17:33:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:13.280 17:33:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.537 17:33:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.794 17:33:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:13.794 17:33:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:14.053 true 00:14:14.053 17:33:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:14.053 17:33:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.987 17:33:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.987 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:15.245 17:33:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:15.245 17:33:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:15.502 true 00:14:15.502 17:33:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:15.502 17:33:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.760 17:33:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.018 17:33:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:16.018 17:33:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:16.276 true 00:14:16.276 17:33:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:16.276 17:33:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.534 17:33:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.791 17:33:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:16.791 17:33:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:17.049 true 00:14:17.049 17:33:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:17.049 17:33:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.982 17:33:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.982 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:18.240 17:33:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:18.240 17:33:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:18.498 true 00:14:18.498 17:33:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:18.498 17:33:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.756 17:33:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.013 17:33:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:19.013 17:33:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:19.270 true 00:14:19.270 17:33:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:19.270 17:33:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.204 17:33:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.204 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:20.462 17:33:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:20.462 17:33:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:20.720 true 00:14:20.720 17:33:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:20.720 17:33:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.977 17:33:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.235 17:33:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:21.235 17:33:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:21.492 true 00:14:21.492 17:33:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:21.493 17:33:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.456 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.456 17:33:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.456 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.456 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:22.716 17:33:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:22.716 17:33:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:22.974 true 00:14:22.974 17:34:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:22.974 17:34:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.232 17:34:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.489 17:34:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:23.489 17:34:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:23.489 true 00:14:23.489 17:34:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:23.489 17:34:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.423 17:34:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.681 17:34:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:24.681 17:34:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:24.939 true 00:14:24.939 17:34:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:24.939 17:34:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.197 17:34:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.454 17:34:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:25.454 17:34:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:25.712 true 00:14:25.712 17:34:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:25.712 17:34:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.969 17:34:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.227 17:34:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:26.227 17:34:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:26.484 true 00:14:26.485 17:34:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:26.485 17:34:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.857 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.857 17:34:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:27.857 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.857 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.857 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.857 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.857 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.857 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:27.857 17:34:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:27.857 17:34:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:28.115 true 00:14:28.115 17:34:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:28.115 17:34:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.048 17:34:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.048 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:29.048 17:34:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:29.048 17:34:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:29.306 true 00:14:29.306 17:34:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:29.306 17:34:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.563 17:34:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.821 17:34:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:29.821 17:34:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:29.821 Initializing NVMe Controllers 00:14:29.821 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:29.821 Controller IO queue size 128, less than required. 00:14:29.821 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:29.821 Controller IO queue size 128, less than required. 00:14:29.821 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:29.821 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:29.821 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:29.821 Initialization complete. Launching workers. 00:14:29.821 ======================================================== 00:14:29.821 Latency(us) 00:14:29.821 Device Information : IOPS MiB/s Average min max 00:14:29.821 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 973.18 0.48 64911.27 2378.22 1033178.82 00:14:29.821 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11247.16 5.49 11381.54 1880.77 450428.95 00:14:29.821 ======================================================== 00:14:29.821 Total : 12220.35 5.97 15644.45 1880.77 1033178.82 00:14:29.821 00:14:30.079 true 00:14:30.079 17:34:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1538734 00:14:30.079 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1538734) - No such process 00:14:30.079 17:34:07 -- target/ns_hotplug_stress.sh@53 -- # wait 1538734 00:14:30.079 17:34:07 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.336 17:34:07 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:30.594 17:34:07 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:30.594 17:34:07 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:30.594 17:34:07 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:30.594 17:34:07 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:30.594 17:34:07 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:30.852 null0 00:14:30.852 17:34:08 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:30.852 17:34:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:30.852 17:34:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:31.110 null1 00:14:31.110 17:34:08 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:31.110 17:34:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:31.110 17:34:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:31.368 null2 00:14:31.368 17:34:08 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:31.368 17:34:08 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:31.368 17:34:08 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:31.626 null3 00:14:31.626 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:31.626 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:31.626 17:34:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:31.883 null4 00:14:31.883 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:31.883 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:31.883 17:34:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:32.140 null5 00:14:32.140 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.140 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.140 17:34:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:32.398 null6 00:14:32.398 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.398 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.398 17:34:09 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:32.656 null7 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:32.656 17:34:09 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:32.656 17:34:10 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:32.656 17:34:10 -- target/ns_hotplug_stress.sh@66 -- # wait 1542805 1542806 1542808 1542810 1542812 1542814 1542816 1542818 00:14:32.656 17:34:10 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:32.656 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:32.656 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.656 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:32.914 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:32.914 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:32.914 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:32.914 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:32.914 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:32.914 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:32.914 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:32.914 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.173 17:34:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:33.431 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:33.431 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:33.431 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:33.431 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:33.431 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:33.431 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.432 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:33.432 17:34:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.690 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:33.949 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:33.949 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:33.949 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:33.949 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:33.949 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:33.949 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.949 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:33.949 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.207 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.465 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.465 17:34:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.465 17:34:11 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.465 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.466 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.466 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.466 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.723 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.723 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.723 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.723 17:34:11 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.981 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.239 17:34:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.239 17:34:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:35.239 17:34:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.239 17:34:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:35.239 17:34:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:35.239 17:34:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:35.239 17:34:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:35.239 17:34:12 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.497 17:34:12 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.755 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.756 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:35.756 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:35.756 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.756 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:35.756 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:35.756 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:35.756 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.014 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:36.273 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:36.273 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:36.273 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:36.273 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:36.273 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:36.273 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:36.273 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.273 17:34:13 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.531 17:34:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:36.789 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:36.789 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:36.789 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:36.789 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:36.789 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:36.789 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:36.789 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:36.789 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.048 17:34:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:37.310 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:37.310 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:37.310 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:37.310 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:37.310 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:37.310 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:37.310 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:37.310 17:34:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.568 17:34:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:37.827 17:34:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:38.085 17:34:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:38.085 17:34:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:38.085 17:34:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:38.085 17:34:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:38.085 17:34:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.085 17:34:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:38.085 17:34:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:38.344 17:34:15 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:38.344 17:34:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:38.344 17:34:15 -- nvmf/common.sh@116 -- # sync 00:14:38.344 17:34:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:38.344 17:34:15 -- nvmf/common.sh@119 -- # set +e 00:14:38.344 17:34:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:38.344 17:34:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:38.344 rmmod nvme_tcp 00:14:38.344 rmmod nvme_fabrics 00:14:38.344 rmmod nvme_keyring 00:14:38.344 17:34:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:38.344 17:34:15 -- nvmf/common.sh@123 -- # set -e 00:14:38.344 17:34:15 -- nvmf/common.sh@124 -- # return 0 00:14:38.344 17:34:15 -- nvmf/common.sh@477 -- # '[' -n 1538225 ']' 00:14:38.344 17:34:15 -- nvmf/common.sh@478 -- # killprocess 1538225 00:14:38.344 17:34:15 -- common/autotest_common.sh@936 -- # '[' -z 1538225 ']' 00:14:38.344 17:34:15 -- common/autotest_common.sh@940 -- # kill -0 1538225 00:14:38.344 17:34:15 -- common/autotest_common.sh@941 -- # uname 00:14:38.344 17:34:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:38.344 17:34:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1538225 00:14:38.344 17:34:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:38.344 17:34:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:38.344 17:34:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1538225' 00:14:38.344 killing process with pid 1538225 00:14:38.344 17:34:15 -- common/autotest_common.sh@955 -- # kill 1538225 00:14:38.344 17:34:15 -- common/autotest_common.sh@960 -- # wait 1538225 00:14:38.602 17:34:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:38.602 17:34:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:38.602 17:34:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:38.602 17:34:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:38.602 17:34:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:38.602 17:34:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:38.602 17:34:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:38.602 17:34:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:41.136 17:34:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:41.136 00:14:41.136 real 0m46.649s 00:14:41.136 user 3m32.223s 00:14:41.136 sys 0m16.271s 00:14:41.136 17:34:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:41.136 17:34:18 -- common/autotest_common.sh@10 -- # set +x 00:14:41.136 ************************************ 00:14:41.136 END TEST nvmf_ns_hotplug_stress 00:14:41.136 ************************************ 00:14:41.136 17:34:18 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:41.136 17:34:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:41.136 17:34:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:41.136 17:34:18 -- common/autotest_common.sh@10 -- # set +x 00:14:41.136 ************************************ 00:14:41.136 START TEST nvmf_connect_stress 00:14:41.136 ************************************ 00:14:41.136 17:34:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:41.136 * Looking for test storage... 00:14:41.136 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:41.136 17:34:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:41.136 17:34:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:41.136 17:34:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:41.136 17:34:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:41.136 17:34:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:41.136 17:34:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:41.136 17:34:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:41.136 17:34:18 -- scripts/common.sh@335 -- # IFS=.-: 00:14:41.136 17:34:18 -- scripts/common.sh@335 -- # read -ra ver1 00:14:41.136 17:34:18 -- scripts/common.sh@336 -- # IFS=.-: 00:14:41.136 17:34:18 -- scripts/common.sh@336 -- # read -ra ver2 00:14:41.136 17:34:18 -- scripts/common.sh@337 -- # local 'op=<' 00:14:41.136 17:34:18 -- scripts/common.sh@339 -- # ver1_l=2 00:14:41.136 17:34:18 -- scripts/common.sh@340 -- # ver2_l=1 00:14:41.136 17:34:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:41.136 17:34:18 -- scripts/common.sh@343 -- # case "$op" in 00:14:41.136 17:34:18 -- scripts/common.sh@344 -- # : 1 00:14:41.136 17:34:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:41.136 17:34:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:41.136 17:34:18 -- scripts/common.sh@364 -- # decimal 1 00:14:41.136 17:34:18 -- scripts/common.sh@352 -- # local d=1 00:14:41.136 17:34:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:41.136 17:34:18 -- scripts/common.sh@354 -- # echo 1 00:14:41.136 17:34:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:41.136 17:34:18 -- scripts/common.sh@365 -- # decimal 2 00:14:41.136 17:34:18 -- scripts/common.sh@352 -- # local d=2 00:14:41.136 17:34:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:41.136 17:34:18 -- scripts/common.sh@354 -- # echo 2 00:14:41.137 17:34:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:41.137 17:34:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:41.137 17:34:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:41.137 17:34:18 -- scripts/common.sh@367 -- # return 0 00:14:41.137 17:34:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:41.137 17:34:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:41.137 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:41.137 --rc genhtml_branch_coverage=1 00:14:41.137 --rc genhtml_function_coverage=1 00:14:41.137 --rc genhtml_legend=1 00:14:41.137 --rc geninfo_all_blocks=1 00:14:41.137 --rc geninfo_unexecuted_blocks=1 00:14:41.137 00:14:41.137 ' 00:14:41.137 17:34:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:41.137 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:41.137 --rc genhtml_branch_coverage=1 00:14:41.137 --rc genhtml_function_coverage=1 00:14:41.137 --rc genhtml_legend=1 00:14:41.137 --rc geninfo_all_blocks=1 00:14:41.137 --rc geninfo_unexecuted_blocks=1 00:14:41.137 00:14:41.137 ' 00:14:41.137 17:34:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:41.137 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:41.137 --rc genhtml_branch_coverage=1 00:14:41.137 --rc genhtml_function_coverage=1 00:14:41.137 --rc genhtml_legend=1 00:14:41.137 --rc geninfo_all_blocks=1 00:14:41.137 --rc geninfo_unexecuted_blocks=1 00:14:41.137 00:14:41.137 ' 00:14:41.137 17:34:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:41.137 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:41.137 --rc genhtml_branch_coverage=1 00:14:41.137 --rc genhtml_function_coverage=1 00:14:41.137 --rc genhtml_legend=1 00:14:41.137 --rc geninfo_all_blocks=1 00:14:41.137 --rc geninfo_unexecuted_blocks=1 00:14:41.137 00:14:41.137 ' 00:14:41.137 17:34:18 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:41.137 17:34:18 -- nvmf/common.sh@7 -- # uname -s 00:14:41.137 17:34:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:41.137 17:34:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:41.137 17:34:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:41.137 17:34:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:41.137 17:34:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:41.137 17:34:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:41.137 17:34:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:41.137 17:34:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:41.137 17:34:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:41.137 17:34:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:41.137 17:34:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:41.137 17:34:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:41.137 17:34:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:41.137 17:34:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:41.137 17:34:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:41.137 17:34:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:41.137 17:34:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:41.137 17:34:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:41.137 17:34:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:41.137 17:34:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.137 17:34:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.137 17:34:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.137 17:34:18 -- paths/export.sh@5 -- # export PATH 00:14:41.137 17:34:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.137 17:34:18 -- nvmf/common.sh@46 -- # : 0 00:14:41.137 17:34:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:41.137 17:34:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:41.137 17:34:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:41.137 17:34:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:41.137 17:34:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:41.137 17:34:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:41.137 17:34:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:41.137 17:34:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:41.137 17:34:18 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:41.137 17:34:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:41.137 17:34:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:41.137 17:34:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:41.137 17:34:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:41.137 17:34:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:41.137 17:34:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.137 17:34:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.137 17:34:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:41.137 17:34:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:41.137 17:34:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:41.137 17:34:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:41.137 17:34:18 -- common/autotest_common.sh@10 -- # set +x 00:14:43.039 17:34:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:43.039 17:34:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:43.039 17:34:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:43.039 17:34:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:43.039 17:34:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:43.039 17:34:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:43.039 17:34:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:43.039 17:34:20 -- nvmf/common.sh@294 -- # net_devs=() 00:14:43.039 17:34:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:43.039 17:34:20 -- nvmf/common.sh@295 -- # e810=() 00:14:43.039 17:34:20 -- nvmf/common.sh@295 -- # local -ga e810 00:14:43.039 17:34:20 -- nvmf/common.sh@296 -- # x722=() 00:14:43.039 17:34:20 -- nvmf/common.sh@296 -- # local -ga x722 00:14:43.039 17:34:20 -- nvmf/common.sh@297 -- # mlx=() 00:14:43.039 17:34:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:43.039 17:34:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:43.039 17:34:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:43.039 17:34:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:43.039 17:34:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:43.039 17:34:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:43.039 17:34:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:43.039 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:43.039 17:34:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:43.039 17:34:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:43.039 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:43.039 17:34:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:43.039 17:34:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:43.039 17:34:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:43.039 17:34:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:43.039 17:34:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:43.039 17:34:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:43.039 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:43.039 17:34:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:43.039 17:34:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:43.039 17:34:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:43.039 17:34:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:43.039 17:34:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:43.039 17:34:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:43.039 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:43.039 17:34:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:43.039 17:34:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:43.039 17:34:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:43.039 17:34:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:43.039 17:34:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:43.039 17:34:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:43.039 17:34:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:43.039 17:34:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:43.039 17:34:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:43.039 17:34:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:43.039 17:34:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:43.039 17:34:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:43.039 17:34:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:43.039 17:34:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:43.039 17:34:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:43.039 17:34:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:43.039 17:34:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:43.039 17:34:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:43.039 17:34:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:43.039 17:34:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:43.039 17:34:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:43.039 17:34:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:43.039 17:34:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:43.039 17:34:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:43.039 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:43.039 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.204 ms 00:14:43.039 00:14:43.039 --- 10.0.0.2 ping statistics --- 00:14:43.039 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:43.039 rtt min/avg/max/mdev = 0.204/0.204/0.204/0.000 ms 00:14:43.039 17:34:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:43.039 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:43.039 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:14:43.039 00:14:43.039 --- 10.0.0.1 ping statistics --- 00:14:43.039 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:43.039 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:14:43.039 17:34:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:43.039 17:34:20 -- nvmf/common.sh@410 -- # return 0 00:14:43.039 17:34:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:43.039 17:34:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:43.039 17:34:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:43.039 17:34:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:43.040 17:34:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:43.040 17:34:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:43.040 17:34:20 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:43.040 17:34:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:43.040 17:34:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:43.040 17:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:43.040 17:34:20 -- nvmf/common.sh@469 -- # nvmfpid=1545607 00:14:43.040 17:34:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:43.040 17:34:20 -- nvmf/common.sh@470 -- # waitforlisten 1545607 00:14:43.040 17:34:20 -- common/autotest_common.sh@829 -- # '[' -z 1545607 ']' 00:14:43.040 17:34:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:43.040 17:34:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:43.040 17:34:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:43.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:43.040 17:34:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:43.040 17:34:20 -- common/autotest_common.sh@10 -- # set +x 00:14:43.040 [2024-11-16 17:34:20.513830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:43.040 [2024-11-16 17:34:20.513918] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:43.298 EAL: No free 2048 kB hugepages reported on node 1 00:14:43.298 [2024-11-16 17:34:20.589005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:43.298 [2024-11-16 17:34:20.679124] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:43.298 [2024-11-16 17:34:20.679288] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:43.298 [2024-11-16 17:34:20.679305] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:43.298 [2024-11-16 17:34:20.679318] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:43.298 [2024-11-16 17:34:20.682637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:43.298 [2024-11-16 17:34:20.682721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:43.298 [2024-11-16 17:34:20.682724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:44.231 17:34:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:44.231 17:34:21 -- common/autotest_common.sh@862 -- # return 0 00:14:44.231 17:34:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:44.231 17:34:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:44.231 17:34:21 -- common/autotest_common.sh@10 -- # set +x 00:14:44.231 17:34:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:44.231 17:34:21 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:44.231 17:34:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.231 17:34:21 -- common/autotest_common.sh@10 -- # set +x 00:14:44.231 [2024-11-16 17:34:21.517943] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:44.231 17:34:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.231 17:34:21 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:44.231 17:34:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.231 17:34:21 -- common/autotest_common.sh@10 -- # set +x 00:14:44.231 17:34:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.231 17:34:21 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:44.231 17:34:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.231 17:34:21 -- common/autotest_common.sh@10 -- # set +x 00:14:44.231 [2024-11-16 17:34:21.542788] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:44.231 17:34:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.231 17:34:21 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:44.231 17:34:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.231 17:34:21 -- common/autotest_common.sh@10 -- # set +x 00:14:44.231 NULL1 00:14:44.231 17:34:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.231 17:34:21 -- target/connect_stress.sh@21 -- # PERF_PID=1545767 00:14:44.231 17:34:21 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:44.231 17:34:21 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:44.231 17:34:21 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:44.231 17:34:21 -- target/connect_stress.sh@28 -- # cat 00:14:44.231 17:34:21 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:44.231 17:34:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.231 17:34:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.231 17:34:21 -- common/autotest_common.sh@10 -- # set +x 00:14:44.489 17:34:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.489 17:34:21 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:44.489 17:34:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.489 17:34:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.489 17:34:21 -- common/autotest_common.sh@10 -- # set +x 00:14:45.054 17:34:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.054 17:34:22 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:45.054 17:34:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.054 17:34:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.054 17:34:22 -- common/autotest_common.sh@10 -- # set +x 00:14:45.312 17:34:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.312 17:34:22 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:45.312 17:34:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.312 17:34:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.312 17:34:22 -- common/autotest_common.sh@10 -- # set +x 00:14:45.570 17:34:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.570 17:34:22 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:45.570 17:34:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.570 17:34:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.570 17:34:22 -- common/autotest_common.sh@10 -- # set +x 00:14:45.827 17:34:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.827 17:34:23 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:45.827 17:34:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.827 17:34:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.827 17:34:23 -- common/autotest_common.sh@10 -- # set +x 00:14:46.085 17:34:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.085 17:34:23 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:46.085 17:34:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.085 17:34:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.085 17:34:23 -- common/autotest_common.sh@10 -- # set +x 00:14:46.650 17:34:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.650 17:34:23 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:46.650 17:34:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.650 17:34:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.650 17:34:23 -- common/autotest_common.sh@10 -- # set +x 00:14:46.908 17:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.908 17:34:24 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:46.908 17:34:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.908 17:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.908 17:34:24 -- common/autotest_common.sh@10 -- # set +x 00:14:47.166 17:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.166 17:34:24 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:47.166 17:34:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.166 17:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.166 17:34:24 -- common/autotest_common.sh@10 -- # set +x 00:14:47.431 17:34:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.431 17:34:24 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:47.431 17:34:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.431 17:34:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.431 17:34:24 -- common/autotest_common.sh@10 -- # set +x 00:14:47.723 17:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.723 17:34:25 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:47.723 17:34:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.723 17:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.723 17:34:25 -- common/autotest_common.sh@10 -- # set +x 00:14:47.986 17:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.986 17:34:25 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:47.986 17:34:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.986 17:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.986 17:34:25 -- common/autotest_common.sh@10 -- # set +x 00:14:48.551 17:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.551 17:34:25 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:48.551 17:34:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.551 17:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.551 17:34:25 -- common/autotest_common.sh@10 -- # set +x 00:14:48.809 17:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.809 17:34:26 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:48.809 17:34:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.809 17:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.809 17:34:26 -- common/autotest_common.sh@10 -- # set +x 00:14:49.067 17:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.067 17:34:26 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:49.067 17:34:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.067 17:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.067 17:34:26 -- common/autotest_common.sh@10 -- # set +x 00:14:49.325 17:34:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.325 17:34:26 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:49.325 17:34:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.325 17:34:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.325 17:34:26 -- common/autotest_common.sh@10 -- # set +x 00:14:49.583 17:34:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.583 17:34:27 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:49.583 17:34:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.583 17:34:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.583 17:34:27 -- common/autotest_common.sh@10 -- # set +x 00:14:50.147 17:34:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.147 17:34:27 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:50.147 17:34:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.147 17:34:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.147 17:34:27 -- common/autotest_common.sh@10 -- # set +x 00:14:50.405 17:34:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.405 17:34:27 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:50.405 17:34:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.405 17:34:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.405 17:34:27 -- common/autotest_common.sh@10 -- # set +x 00:14:50.662 17:34:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.662 17:34:28 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:50.662 17:34:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.662 17:34:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.662 17:34:28 -- common/autotest_common.sh@10 -- # set +x 00:14:50.920 17:34:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.920 17:34:28 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:50.920 17:34:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.920 17:34:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.920 17:34:28 -- common/autotest_common.sh@10 -- # set +x 00:14:51.177 17:34:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.177 17:34:28 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:51.177 17:34:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.177 17:34:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.177 17:34:28 -- common/autotest_common.sh@10 -- # set +x 00:14:51.742 17:34:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.742 17:34:28 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:51.742 17:34:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.742 17:34:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.742 17:34:28 -- common/autotest_common.sh@10 -- # set +x 00:14:51.999 17:34:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.999 17:34:29 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:51.999 17:34:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.999 17:34:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.999 17:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:52.257 17:34:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.257 17:34:29 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:52.257 17:34:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.257 17:34:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.257 17:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:52.515 17:34:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.515 17:34:29 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:52.515 17:34:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.515 17:34:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.515 17:34:29 -- common/autotest_common.sh@10 -- # set +x 00:14:53.080 17:34:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.080 17:34:30 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:53.080 17:34:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.080 17:34:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.080 17:34:30 -- common/autotest_common.sh@10 -- # set +x 00:14:53.338 17:34:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.338 17:34:30 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:53.338 17:34:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.338 17:34:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.338 17:34:30 -- common/autotest_common.sh@10 -- # set +x 00:14:53.594 17:34:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.594 17:34:30 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:53.594 17:34:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.594 17:34:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.594 17:34:30 -- common/autotest_common.sh@10 -- # set +x 00:14:53.850 17:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.850 17:34:31 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:53.850 17:34:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.850 17:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.850 17:34:31 -- common/autotest_common.sh@10 -- # set +x 00:14:54.108 17:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.108 17:34:31 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:54.108 17:34:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.108 17:34:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.108 17:34:31 -- common/autotest_common.sh@10 -- # set +x 00:14:54.365 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:54.623 17:34:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.623 17:34:31 -- target/connect_stress.sh@34 -- # kill -0 1545767 00:14:54.623 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1545767) - No such process 00:14:54.623 17:34:31 -- target/connect_stress.sh@38 -- # wait 1545767 00:14:54.623 17:34:31 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:54.623 17:34:31 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:54.623 17:34:31 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:54.623 17:34:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:54.623 17:34:31 -- nvmf/common.sh@116 -- # sync 00:14:54.623 17:34:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:54.623 17:34:31 -- nvmf/common.sh@119 -- # set +e 00:14:54.623 17:34:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:54.623 17:34:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:54.623 rmmod nvme_tcp 00:14:54.623 rmmod nvme_fabrics 00:14:54.623 rmmod nvme_keyring 00:14:54.623 17:34:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:54.623 17:34:31 -- nvmf/common.sh@123 -- # set -e 00:14:54.623 17:34:31 -- nvmf/common.sh@124 -- # return 0 00:14:54.623 17:34:31 -- nvmf/common.sh@477 -- # '[' -n 1545607 ']' 00:14:54.623 17:34:31 -- nvmf/common.sh@478 -- # killprocess 1545607 00:14:54.623 17:34:31 -- common/autotest_common.sh@936 -- # '[' -z 1545607 ']' 00:14:54.623 17:34:31 -- common/autotest_common.sh@940 -- # kill -0 1545607 00:14:54.623 17:34:31 -- common/autotest_common.sh@941 -- # uname 00:14:54.623 17:34:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:54.623 17:34:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1545607 00:14:54.623 17:34:31 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:54.623 17:34:31 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:54.623 17:34:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1545607' 00:14:54.623 killing process with pid 1545607 00:14:54.623 17:34:31 -- common/autotest_common.sh@955 -- # kill 1545607 00:14:54.623 17:34:31 -- common/autotest_common.sh@960 -- # wait 1545607 00:14:54.882 17:34:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:54.882 17:34:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:54.882 17:34:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:54.882 17:34:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:54.882 17:34:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:54.882 17:34:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:54.882 17:34:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:54.882 17:34:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:56.789 17:34:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:56.789 00:14:56.789 real 0m16.200s 00:14:56.789 user 0m40.853s 00:14:56.789 sys 0m5.933s 00:14:56.789 17:34:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:56.789 17:34:34 -- common/autotest_common.sh@10 -- # set +x 00:14:56.789 ************************************ 00:14:56.789 END TEST nvmf_connect_stress 00:14:56.789 ************************************ 00:14:56.789 17:34:34 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:56.789 17:34:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:56.789 17:34:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:56.789 17:34:34 -- common/autotest_common.sh@10 -- # set +x 00:14:56.789 ************************************ 00:14:56.789 START TEST nvmf_fused_ordering 00:14:56.789 ************************************ 00:14:56.789 17:34:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:57.048 * Looking for test storage... 00:14:57.048 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:57.048 17:34:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:57.048 17:34:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:57.048 17:34:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:57.048 17:34:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:57.048 17:34:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:57.048 17:34:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:57.048 17:34:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:57.048 17:34:34 -- scripts/common.sh@335 -- # IFS=.-: 00:14:57.048 17:34:34 -- scripts/common.sh@335 -- # read -ra ver1 00:14:57.048 17:34:34 -- scripts/common.sh@336 -- # IFS=.-: 00:14:57.048 17:34:34 -- scripts/common.sh@336 -- # read -ra ver2 00:14:57.048 17:34:34 -- scripts/common.sh@337 -- # local 'op=<' 00:14:57.048 17:34:34 -- scripts/common.sh@339 -- # ver1_l=2 00:14:57.048 17:34:34 -- scripts/common.sh@340 -- # ver2_l=1 00:14:57.048 17:34:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:57.048 17:34:34 -- scripts/common.sh@343 -- # case "$op" in 00:14:57.048 17:34:34 -- scripts/common.sh@344 -- # : 1 00:14:57.048 17:34:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:57.048 17:34:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:57.048 17:34:34 -- scripts/common.sh@364 -- # decimal 1 00:14:57.048 17:34:34 -- scripts/common.sh@352 -- # local d=1 00:14:57.048 17:34:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:57.048 17:34:34 -- scripts/common.sh@354 -- # echo 1 00:14:57.048 17:34:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:57.048 17:34:34 -- scripts/common.sh@365 -- # decimal 2 00:14:57.048 17:34:34 -- scripts/common.sh@352 -- # local d=2 00:14:57.048 17:34:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:57.048 17:34:34 -- scripts/common.sh@354 -- # echo 2 00:14:57.048 17:34:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:57.048 17:34:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:57.048 17:34:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:57.048 17:34:34 -- scripts/common.sh@367 -- # return 0 00:14:57.048 17:34:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:57.048 17:34:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:57.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.048 --rc genhtml_branch_coverage=1 00:14:57.048 --rc genhtml_function_coverage=1 00:14:57.048 --rc genhtml_legend=1 00:14:57.048 --rc geninfo_all_blocks=1 00:14:57.048 --rc geninfo_unexecuted_blocks=1 00:14:57.048 00:14:57.048 ' 00:14:57.048 17:34:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:57.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.048 --rc genhtml_branch_coverage=1 00:14:57.048 --rc genhtml_function_coverage=1 00:14:57.048 --rc genhtml_legend=1 00:14:57.048 --rc geninfo_all_blocks=1 00:14:57.048 --rc geninfo_unexecuted_blocks=1 00:14:57.048 00:14:57.048 ' 00:14:57.048 17:34:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:57.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.048 --rc genhtml_branch_coverage=1 00:14:57.048 --rc genhtml_function_coverage=1 00:14:57.048 --rc genhtml_legend=1 00:14:57.048 --rc geninfo_all_blocks=1 00:14:57.048 --rc geninfo_unexecuted_blocks=1 00:14:57.048 00:14:57.048 ' 00:14:57.048 17:34:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:57.048 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.048 --rc genhtml_branch_coverage=1 00:14:57.048 --rc genhtml_function_coverage=1 00:14:57.048 --rc genhtml_legend=1 00:14:57.048 --rc geninfo_all_blocks=1 00:14:57.048 --rc geninfo_unexecuted_blocks=1 00:14:57.048 00:14:57.048 ' 00:14:57.048 17:34:34 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:57.048 17:34:34 -- nvmf/common.sh@7 -- # uname -s 00:14:57.048 17:34:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:57.048 17:34:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:57.048 17:34:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:57.048 17:34:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:57.048 17:34:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:57.048 17:34:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:57.048 17:34:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:57.048 17:34:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:57.048 17:34:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:57.048 17:34:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:57.048 17:34:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.048 17:34:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.048 17:34:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:57.048 17:34:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:57.048 17:34:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:57.048 17:34:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:57.048 17:34:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:57.048 17:34:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:57.048 17:34:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:57.048 17:34:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.049 17:34:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.049 17:34:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.049 17:34:34 -- paths/export.sh@5 -- # export PATH 00:14:57.049 17:34:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.049 17:34:34 -- nvmf/common.sh@46 -- # : 0 00:14:57.049 17:34:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:57.049 17:34:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:57.049 17:34:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:57.049 17:34:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:57.049 17:34:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:57.049 17:34:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:57.049 17:34:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:57.049 17:34:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:57.049 17:34:34 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:57.049 17:34:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:57.049 17:34:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:57.049 17:34:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:57.049 17:34:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:57.049 17:34:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:57.049 17:34:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:57.049 17:34:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:57.049 17:34:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.049 17:34:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:57.049 17:34:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:57.049 17:34:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:57.049 17:34:34 -- common/autotest_common.sh@10 -- # set +x 00:14:59.587 17:34:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:59.587 17:34:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:59.587 17:34:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:59.587 17:34:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:59.587 17:34:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:59.587 17:34:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:59.587 17:34:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:59.587 17:34:36 -- nvmf/common.sh@294 -- # net_devs=() 00:14:59.587 17:34:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:59.587 17:34:36 -- nvmf/common.sh@295 -- # e810=() 00:14:59.587 17:34:36 -- nvmf/common.sh@295 -- # local -ga e810 00:14:59.587 17:34:36 -- nvmf/common.sh@296 -- # x722=() 00:14:59.587 17:34:36 -- nvmf/common.sh@296 -- # local -ga x722 00:14:59.587 17:34:36 -- nvmf/common.sh@297 -- # mlx=() 00:14:59.587 17:34:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:59.587 17:34:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:59.587 17:34:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:59.588 17:34:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:59.588 17:34:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:59.588 17:34:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:59.588 17:34:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:59.588 17:34:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.588 17:34:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:59.588 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:59.588 17:34:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.588 17:34:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:59.588 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:59.588 17:34:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:59.588 17:34:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.588 17:34:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.588 17:34:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.588 17:34:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.588 17:34:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:59.588 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:59.588 17:34:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.588 17:34:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.588 17:34:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.588 17:34:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.588 17:34:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.588 17:34:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:59.588 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:59.588 17:34:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.588 17:34:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:59.588 17:34:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:59.588 17:34:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:59.588 17:34:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:59.588 17:34:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:59.588 17:34:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:59.588 17:34:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:59.588 17:34:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:59.588 17:34:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:59.588 17:34:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:59.588 17:34:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:59.588 17:34:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:59.588 17:34:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:59.588 17:34:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:59.588 17:34:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:59.588 17:34:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:59.588 17:34:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:59.588 17:34:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:59.588 17:34:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:59.588 17:34:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:59.588 17:34:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:59.588 17:34:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:59.588 17:34:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:59.588 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:59.588 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.181 ms 00:14:59.588 00:14:59.588 --- 10.0.0.2 ping statistics --- 00:14:59.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.588 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:14:59.588 17:34:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:59.588 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:59.588 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:14:59.588 00:14:59.588 --- 10.0.0.1 ping statistics --- 00:14:59.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.588 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:14:59.588 17:34:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:59.588 17:34:36 -- nvmf/common.sh@410 -- # return 0 00:14:59.588 17:34:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:59.588 17:34:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:59.588 17:34:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:59.588 17:34:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:59.588 17:34:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:59.588 17:34:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:59.588 17:34:36 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:59.588 17:34:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:59.588 17:34:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:59.588 17:34:36 -- common/autotest_common.sh@10 -- # set +x 00:14:59.588 17:34:36 -- nvmf/common.sh@469 -- # nvmfpid=1549092 00:14:59.588 17:34:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:59.588 17:34:36 -- nvmf/common.sh@470 -- # waitforlisten 1549092 00:14:59.588 17:34:36 -- common/autotest_common.sh@829 -- # '[' -z 1549092 ']' 00:14:59.588 17:34:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:59.588 17:34:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:59.588 17:34:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:59.588 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:59.588 17:34:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:59.588 17:34:36 -- common/autotest_common.sh@10 -- # set +x 00:14:59.588 [2024-11-16 17:34:36.770282] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.588 [2024-11-16 17:34:36.770357] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:59.588 EAL: No free 2048 kB hugepages reported on node 1 00:14:59.588 [2024-11-16 17:34:36.839422] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:59.588 [2024-11-16 17:34:36.927242] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:59.588 [2024-11-16 17:34:36.927399] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:59.588 [2024-11-16 17:34:36.927419] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:59.588 [2024-11-16 17:34:36.927434] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:59.588 [2024-11-16 17:34:36.927464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:00.523 17:34:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:00.523 17:34:37 -- common/autotest_common.sh@862 -- # return 0 00:15:00.523 17:34:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:00.523 17:34:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:00.523 17:34:37 -- common/autotest_common.sh@10 -- # set +x 00:15:00.523 17:34:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:00.523 17:34:37 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:00.523 17:34:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.523 17:34:37 -- common/autotest_common.sh@10 -- # set +x 00:15:00.523 [2024-11-16 17:34:37.755462] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:00.523 17:34:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.523 17:34:37 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:00.523 17:34:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.523 17:34:37 -- common/autotest_common.sh@10 -- # set +x 00:15:00.523 17:34:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.523 17:34:37 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:00.523 17:34:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.523 17:34:37 -- common/autotest_common.sh@10 -- # set +x 00:15:00.523 [2024-11-16 17:34:37.771681] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:00.523 17:34:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.523 17:34:37 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:00.523 17:34:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.523 17:34:37 -- common/autotest_common.sh@10 -- # set +x 00:15:00.523 NULL1 00:15:00.523 17:34:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.523 17:34:37 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:00.523 17:34:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.523 17:34:37 -- common/autotest_common.sh@10 -- # set +x 00:15:00.523 17:34:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.523 17:34:37 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:00.523 17:34:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.523 17:34:37 -- common/autotest_common.sh@10 -- # set +x 00:15:00.523 17:34:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.523 17:34:37 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:00.523 [2024-11-16 17:34:37.816158] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:00.523 [2024-11-16 17:34:37.816200] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1549249 ] 00:15:00.523 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.089 Attached to nqn.2016-06.io.spdk:cnode1 00:15:01.089 Namespace ID: 1 size: 1GB 00:15:01.089 fused_ordering(0) 00:15:01.089 fused_ordering(1) 00:15:01.089 fused_ordering(2) 00:15:01.089 fused_ordering(3) 00:15:01.089 fused_ordering(4) 00:15:01.089 fused_ordering(5) 00:15:01.089 fused_ordering(6) 00:15:01.089 fused_ordering(7) 00:15:01.089 fused_ordering(8) 00:15:01.089 fused_ordering(9) 00:15:01.089 fused_ordering(10) 00:15:01.089 fused_ordering(11) 00:15:01.089 fused_ordering(12) 00:15:01.089 fused_ordering(13) 00:15:01.089 fused_ordering(14) 00:15:01.089 fused_ordering(15) 00:15:01.089 fused_ordering(16) 00:15:01.089 fused_ordering(17) 00:15:01.089 fused_ordering(18) 00:15:01.089 fused_ordering(19) 00:15:01.089 fused_ordering(20) 00:15:01.089 fused_ordering(21) 00:15:01.089 fused_ordering(22) 00:15:01.089 fused_ordering(23) 00:15:01.089 fused_ordering(24) 00:15:01.089 fused_ordering(25) 00:15:01.089 fused_ordering(26) 00:15:01.089 fused_ordering(27) 00:15:01.089 fused_ordering(28) 00:15:01.089 fused_ordering(29) 00:15:01.089 fused_ordering(30) 00:15:01.089 fused_ordering(31) 00:15:01.089 fused_ordering(32) 00:15:01.089 fused_ordering(33) 00:15:01.089 fused_ordering(34) 00:15:01.089 fused_ordering(35) 00:15:01.089 fused_ordering(36) 00:15:01.089 fused_ordering(37) 00:15:01.089 fused_ordering(38) 00:15:01.089 fused_ordering(39) 00:15:01.089 fused_ordering(40) 00:15:01.089 fused_ordering(41) 00:15:01.089 fused_ordering(42) 00:15:01.089 fused_ordering(43) 00:15:01.089 fused_ordering(44) 00:15:01.089 fused_ordering(45) 00:15:01.089 fused_ordering(46) 00:15:01.089 fused_ordering(47) 00:15:01.089 fused_ordering(48) 00:15:01.089 fused_ordering(49) 00:15:01.089 fused_ordering(50) 00:15:01.089 fused_ordering(51) 00:15:01.089 fused_ordering(52) 00:15:01.090 fused_ordering(53) 00:15:01.090 fused_ordering(54) 00:15:01.090 fused_ordering(55) 00:15:01.090 fused_ordering(56) 00:15:01.090 fused_ordering(57) 00:15:01.090 fused_ordering(58) 00:15:01.090 fused_ordering(59) 00:15:01.090 fused_ordering(60) 00:15:01.090 fused_ordering(61) 00:15:01.090 fused_ordering(62) 00:15:01.090 fused_ordering(63) 00:15:01.090 fused_ordering(64) 00:15:01.090 fused_ordering(65) 00:15:01.090 fused_ordering(66) 00:15:01.090 fused_ordering(67) 00:15:01.090 fused_ordering(68) 00:15:01.090 fused_ordering(69) 00:15:01.090 fused_ordering(70) 00:15:01.090 fused_ordering(71) 00:15:01.090 fused_ordering(72) 00:15:01.090 fused_ordering(73) 00:15:01.090 fused_ordering(74) 00:15:01.090 fused_ordering(75) 00:15:01.090 fused_ordering(76) 00:15:01.090 fused_ordering(77) 00:15:01.090 fused_ordering(78) 00:15:01.090 fused_ordering(79) 00:15:01.090 fused_ordering(80) 00:15:01.090 fused_ordering(81) 00:15:01.090 fused_ordering(82) 00:15:01.090 fused_ordering(83) 00:15:01.090 fused_ordering(84) 00:15:01.090 fused_ordering(85) 00:15:01.090 fused_ordering(86) 00:15:01.090 fused_ordering(87) 00:15:01.090 fused_ordering(88) 00:15:01.090 fused_ordering(89) 00:15:01.090 fused_ordering(90) 00:15:01.090 fused_ordering(91) 00:15:01.090 fused_ordering(92) 00:15:01.090 fused_ordering(93) 00:15:01.090 fused_ordering(94) 00:15:01.090 fused_ordering(95) 00:15:01.090 fused_ordering(96) 00:15:01.090 fused_ordering(97) 00:15:01.090 fused_ordering(98) 00:15:01.090 fused_ordering(99) 00:15:01.090 fused_ordering(100) 00:15:01.090 fused_ordering(101) 00:15:01.090 fused_ordering(102) 00:15:01.090 fused_ordering(103) 00:15:01.090 fused_ordering(104) 00:15:01.090 fused_ordering(105) 00:15:01.090 fused_ordering(106) 00:15:01.090 fused_ordering(107) 00:15:01.090 fused_ordering(108) 00:15:01.090 fused_ordering(109) 00:15:01.090 fused_ordering(110) 00:15:01.090 fused_ordering(111) 00:15:01.090 fused_ordering(112) 00:15:01.090 fused_ordering(113) 00:15:01.090 fused_ordering(114) 00:15:01.090 fused_ordering(115) 00:15:01.090 fused_ordering(116) 00:15:01.090 fused_ordering(117) 00:15:01.090 fused_ordering(118) 00:15:01.090 fused_ordering(119) 00:15:01.090 fused_ordering(120) 00:15:01.090 fused_ordering(121) 00:15:01.090 fused_ordering(122) 00:15:01.090 fused_ordering(123) 00:15:01.090 fused_ordering(124) 00:15:01.090 fused_ordering(125) 00:15:01.090 fused_ordering(126) 00:15:01.090 fused_ordering(127) 00:15:01.090 fused_ordering(128) 00:15:01.090 fused_ordering(129) 00:15:01.090 fused_ordering(130) 00:15:01.090 fused_ordering(131) 00:15:01.090 fused_ordering(132) 00:15:01.090 fused_ordering(133) 00:15:01.090 fused_ordering(134) 00:15:01.090 fused_ordering(135) 00:15:01.090 fused_ordering(136) 00:15:01.090 fused_ordering(137) 00:15:01.090 fused_ordering(138) 00:15:01.090 fused_ordering(139) 00:15:01.090 fused_ordering(140) 00:15:01.090 fused_ordering(141) 00:15:01.090 fused_ordering(142) 00:15:01.090 fused_ordering(143) 00:15:01.090 fused_ordering(144) 00:15:01.090 fused_ordering(145) 00:15:01.090 fused_ordering(146) 00:15:01.090 fused_ordering(147) 00:15:01.090 fused_ordering(148) 00:15:01.090 fused_ordering(149) 00:15:01.090 fused_ordering(150) 00:15:01.090 fused_ordering(151) 00:15:01.090 fused_ordering(152) 00:15:01.090 fused_ordering(153) 00:15:01.090 fused_ordering(154) 00:15:01.090 fused_ordering(155) 00:15:01.090 fused_ordering(156) 00:15:01.090 fused_ordering(157) 00:15:01.090 fused_ordering(158) 00:15:01.090 fused_ordering(159) 00:15:01.090 fused_ordering(160) 00:15:01.090 fused_ordering(161) 00:15:01.090 fused_ordering(162) 00:15:01.090 fused_ordering(163) 00:15:01.090 fused_ordering(164) 00:15:01.090 fused_ordering(165) 00:15:01.090 fused_ordering(166) 00:15:01.090 fused_ordering(167) 00:15:01.090 fused_ordering(168) 00:15:01.090 fused_ordering(169) 00:15:01.090 fused_ordering(170) 00:15:01.090 fused_ordering(171) 00:15:01.090 fused_ordering(172) 00:15:01.090 fused_ordering(173) 00:15:01.090 fused_ordering(174) 00:15:01.090 fused_ordering(175) 00:15:01.090 fused_ordering(176) 00:15:01.090 fused_ordering(177) 00:15:01.090 fused_ordering(178) 00:15:01.090 fused_ordering(179) 00:15:01.090 fused_ordering(180) 00:15:01.090 fused_ordering(181) 00:15:01.090 fused_ordering(182) 00:15:01.090 fused_ordering(183) 00:15:01.090 fused_ordering(184) 00:15:01.090 fused_ordering(185) 00:15:01.090 fused_ordering(186) 00:15:01.090 fused_ordering(187) 00:15:01.090 fused_ordering(188) 00:15:01.090 fused_ordering(189) 00:15:01.090 fused_ordering(190) 00:15:01.090 fused_ordering(191) 00:15:01.090 fused_ordering(192) 00:15:01.090 fused_ordering(193) 00:15:01.090 fused_ordering(194) 00:15:01.090 fused_ordering(195) 00:15:01.090 fused_ordering(196) 00:15:01.090 fused_ordering(197) 00:15:01.090 fused_ordering(198) 00:15:01.090 fused_ordering(199) 00:15:01.090 fused_ordering(200) 00:15:01.090 fused_ordering(201) 00:15:01.090 fused_ordering(202) 00:15:01.090 fused_ordering(203) 00:15:01.090 fused_ordering(204) 00:15:01.090 fused_ordering(205) 00:15:01.349 fused_ordering(206) 00:15:01.349 fused_ordering(207) 00:15:01.349 fused_ordering(208) 00:15:01.349 fused_ordering(209) 00:15:01.349 fused_ordering(210) 00:15:01.349 fused_ordering(211) 00:15:01.349 fused_ordering(212) 00:15:01.349 fused_ordering(213) 00:15:01.349 fused_ordering(214) 00:15:01.349 fused_ordering(215) 00:15:01.349 fused_ordering(216) 00:15:01.349 fused_ordering(217) 00:15:01.349 fused_ordering(218) 00:15:01.349 fused_ordering(219) 00:15:01.349 fused_ordering(220) 00:15:01.349 fused_ordering(221) 00:15:01.349 fused_ordering(222) 00:15:01.349 fused_ordering(223) 00:15:01.349 fused_ordering(224) 00:15:01.349 fused_ordering(225) 00:15:01.349 fused_ordering(226) 00:15:01.349 fused_ordering(227) 00:15:01.349 fused_ordering(228) 00:15:01.349 fused_ordering(229) 00:15:01.349 fused_ordering(230) 00:15:01.349 fused_ordering(231) 00:15:01.349 fused_ordering(232) 00:15:01.349 fused_ordering(233) 00:15:01.349 fused_ordering(234) 00:15:01.349 fused_ordering(235) 00:15:01.349 fused_ordering(236) 00:15:01.349 fused_ordering(237) 00:15:01.349 fused_ordering(238) 00:15:01.349 fused_ordering(239) 00:15:01.349 fused_ordering(240) 00:15:01.349 fused_ordering(241) 00:15:01.349 fused_ordering(242) 00:15:01.349 fused_ordering(243) 00:15:01.349 fused_ordering(244) 00:15:01.349 fused_ordering(245) 00:15:01.349 fused_ordering(246) 00:15:01.349 fused_ordering(247) 00:15:01.349 fused_ordering(248) 00:15:01.349 fused_ordering(249) 00:15:01.349 fused_ordering(250) 00:15:01.349 fused_ordering(251) 00:15:01.349 fused_ordering(252) 00:15:01.349 fused_ordering(253) 00:15:01.349 fused_ordering(254) 00:15:01.349 fused_ordering(255) 00:15:01.349 fused_ordering(256) 00:15:01.349 fused_ordering(257) 00:15:01.349 fused_ordering(258) 00:15:01.349 fused_ordering(259) 00:15:01.349 fused_ordering(260) 00:15:01.349 fused_ordering(261) 00:15:01.349 fused_ordering(262) 00:15:01.349 fused_ordering(263) 00:15:01.349 fused_ordering(264) 00:15:01.349 fused_ordering(265) 00:15:01.349 fused_ordering(266) 00:15:01.349 fused_ordering(267) 00:15:01.349 fused_ordering(268) 00:15:01.349 fused_ordering(269) 00:15:01.349 fused_ordering(270) 00:15:01.349 fused_ordering(271) 00:15:01.349 fused_ordering(272) 00:15:01.349 fused_ordering(273) 00:15:01.349 fused_ordering(274) 00:15:01.349 fused_ordering(275) 00:15:01.349 fused_ordering(276) 00:15:01.349 fused_ordering(277) 00:15:01.349 fused_ordering(278) 00:15:01.349 fused_ordering(279) 00:15:01.349 fused_ordering(280) 00:15:01.349 fused_ordering(281) 00:15:01.349 fused_ordering(282) 00:15:01.349 fused_ordering(283) 00:15:01.349 fused_ordering(284) 00:15:01.349 fused_ordering(285) 00:15:01.349 fused_ordering(286) 00:15:01.349 fused_ordering(287) 00:15:01.349 fused_ordering(288) 00:15:01.349 fused_ordering(289) 00:15:01.349 fused_ordering(290) 00:15:01.349 fused_ordering(291) 00:15:01.349 fused_ordering(292) 00:15:01.349 fused_ordering(293) 00:15:01.349 fused_ordering(294) 00:15:01.349 fused_ordering(295) 00:15:01.349 fused_ordering(296) 00:15:01.349 fused_ordering(297) 00:15:01.349 fused_ordering(298) 00:15:01.349 fused_ordering(299) 00:15:01.349 fused_ordering(300) 00:15:01.349 fused_ordering(301) 00:15:01.349 fused_ordering(302) 00:15:01.349 fused_ordering(303) 00:15:01.349 fused_ordering(304) 00:15:01.349 fused_ordering(305) 00:15:01.349 fused_ordering(306) 00:15:01.349 fused_ordering(307) 00:15:01.349 fused_ordering(308) 00:15:01.349 fused_ordering(309) 00:15:01.349 fused_ordering(310) 00:15:01.349 fused_ordering(311) 00:15:01.349 fused_ordering(312) 00:15:01.349 fused_ordering(313) 00:15:01.349 fused_ordering(314) 00:15:01.349 fused_ordering(315) 00:15:01.349 fused_ordering(316) 00:15:01.349 fused_ordering(317) 00:15:01.349 fused_ordering(318) 00:15:01.349 fused_ordering(319) 00:15:01.350 fused_ordering(320) 00:15:01.350 fused_ordering(321) 00:15:01.350 fused_ordering(322) 00:15:01.350 fused_ordering(323) 00:15:01.350 fused_ordering(324) 00:15:01.350 fused_ordering(325) 00:15:01.350 fused_ordering(326) 00:15:01.350 fused_ordering(327) 00:15:01.350 fused_ordering(328) 00:15:01.350 fused_ordering(329) 00:15:01.350 fused_ordering(330) 00:15:01.350 fused_ordering(331) 00:15:01.350 fused_ordering(332) 00:15:01.350 fused_ordering(333) 00:15:01.350 fused_ordering(334) 00:15:01.350 fused_ordering(335) 00:15:01.350 fused_ordering(336) 00:15:01.350 fused_ordering(337) 00:15:01.350 fused_ordering(338) 00:15:01.350 fused_ordering(339) 00:15:01.350 fused_ordering(340) 00:15:01.350 fused_ordering(341) 00:15:01.350 fused_ordering(342) 00:15:01.350 fused_ordering(343) 00:15:01.350 fused_ordering(344) 00:15:01.350 fused_ordering(345) 00:15:01.350 fused_ordering(346) 00:15:01.350 fused_ordering(347) 00:15:01.350 fused_ordering(348) 00:15:01.350 fused_ordering(349) 00:15:01.350 fused_ordering(350) 00:15:01.350 fused_ordering(351) 00:15:01.350 fused_ordering(352) 00:15:01.350 fused_ordering(353) 00:15:01.350 fused_ordering(354) 00:15:01.350 fused_ordering(355) 00:15:01.350 fused_ordering(356) 00:15:01.350 fused_ordering(357) 00:15:01.350 fused_ordering(358) 00:15:01.350 fused_ordering(359) 00:15:01.350 fused_ordering(360) 00:15:01.350 fused_ordering(361) 00:15:01.350 fused_ordering(362) 00:15:01.350 fused_ordering(363) 00:15:01.350 fused_ordering(364) 00:15:01.350 fused_ordering(365) 00:15:01.350 fused_ordering(366) 00:15:01.350 fused_ordering(367) 00:15:01.350 fused_ordering(368) 00:15:01.350 fused_ordering(369) 00:15:01.350 fused_ordering(370) 00:15:01.350 fused_ordering(371) 00:15:01.350 fused_ordering(372) 00:15:01.350 fused_ordering(373) 00:15:01.350 fused_ordering(374) 00:15:01.350 fused_ordering(375) 00:15:01.350 fused_ordering(376) 00:15:01.350 fused_ordering(377) 00:15:01.350 fused_ordering(378) 00:15:01.350 fused_ordering(379) 00:15:01.350 fused_ordering(380) 00:15:01.350 fused_ordering(381) 00:15:01.350 fused_ordering(382) 00:15:01.350 fused_ordering(383) 00:15:01.350 fused_ordering(384) 00:15:01.350 fused_ordering(385) 00:15:01.350 fused_ordering(386) 00:15:01.350 fused_ordering(387) 00:15:01.350 fused_ordering(388) 00:15:01.350 fused_ordering(389) 00:15:01.350 fused_ordering(390) 00:15:01.350 fused_ordering(391) 00:15:01.350 fused_ordering(392) 00:15:01.350 fused_ordering(393) 00:15:01.350 fused_ordering(394) 00:15:01.350 fused_ordering(395) 00:15:01.350 fused_ordering(396) 00:15:01.350 fused_ordering(397) 00:15:01.350 fused_ordering(398) 00:15:01.350 fused_ordering(399) 00:15:01.350 fused_ordering(400) 00:15:01.350 fused_ordering(401) 00:15:01.350 fused_ordering(402) 00:15:01.350 fused_ordering(403) 00:15:01.350 fused_ordering(404) 00:15:01.350 fused_ordering(405) 00:15:01.350 fused_ordering(406) 00:15:01.350 fused_ordering(407) 00:15:01.350 fused_ordering(408) 00:15:01.350 fused_ordering(409) 00:15:01.350 fused_ordering(410) 00:15:01.608 fused_ordering(411) 00:15:01.608 fused_ordering(412) 00:15:01.608 fused_ordering(413) 00:15:01.608 fused_ordering(414) 00:15:01.608 fused_ordering(415) 00:15:01.608 fused_ordering(416) 00:15:01.608 fused_ordering(417) 00:15:01.608 fused_ordering(418) 00:15:01.608 fused_ordering(419) 00:15:01.608 fused_ordering(420) 00:15:01.608 fused_ordering(421) 00:15:01.608 fused_ordering(422) 00:15:01.608 fused_ordering(423) 00:15:01.608 fused_ordering(424) 00:15:01.608 fused_ordering(425) 00:15:01.608 fused_ordering(426) 00:15:01.608 fused_ordering(427) 00:15:01.608 fused_ordering(428) 00:15:01.608 fused_ordering(429) 00:15:01.608 fused_ordering(430) 00:15:01.608 fused_ordering(431) 00:15:01.608 fused_ordering(432) 00:15:01.608 fused_ordering(433) 00:15:01.608 fused_ordering(434) 00:15:01.608 fused_ordering(435) 00:15:01.608 fused_ordering(436) 00:15:01.608 fused_ordering(437) 00:15:01.608 fused_ordering(438) 00:15:01.608 fused_ordering(439) 00:15:01.608 fused_ordering(440) 00:15:01.608 fused_ordering(441) 00:15:01.608 fused_ordering(442) 00:15:01.608 fused_ordering(443) 00:15:01.608 fused_ordering(444) 00:15:01.608 fused_ordering(445) 00:15:01.608 fused_ordering(446) 00:15:01.608 fused_ordering(447) 00:15:01.608 fused_ordering(448) 00:15:01.608 fused_ordering(449) 00:15:01.608 fused_ordering(450) 00:15:01.608 fused_ordering(451) 00:15:01.608 fused_ordering(452) 00:15:01.608 fused_ordering(453) 00:15:01.608 fused_ordering(454) 00:15:01.608 fused_ordering(455) 00:15:01.608 fused_ordering(456) 00:15:01.608 fused_ordering(457) 00:15:01.608 fused_ordering(458) 00:15:01.608 fused_ordering(459) 00:15:01.608 fused_ordering(460) 00:15:01.608 fused_ordering(461) 00:15:01.608 fused_ordering(462) 00:15:01.608 fused_ordering(463) 00:15:01.608 fused_ordering(464) 00:15:01.608 fused_ordering(465) 00:15:01.608 fused_ordering(466) 00:15:01.608 fused_ordering(467) 00:15:01.608 fused_ordering(468) 00:15:01.608 fused_ordering(469) 00:15:01.608 fused_ordering(470) 00:15:01.608 fused_ordering(471) 00:15:01.608 fused_ordering(472) 00:15:01.608 fused_ordering(473) 00:15:01.608 fused_ordering(474) 00:15:01.608 fused_ordering(475) 00:15:01.608 fused_ordering(476) 00:15:01.608 fused_ordering(477) 00:15:01.608 fused_ordering(478) 00:15:01.608 fused_ordering(479) 00:15:01.608 fused_ordering(480) 00:15:01.608 fused_ordering(481) 00:15:01.608 fused_ordering(482) 00:15:01.608 fused_ordering(483) 00:15:01.608 fused_ordering(484) 00:15:01.608 fused_ordering(485) 00:15:01.608 fused_ordering(486) 00:15:01.608 fused_ordering(487) 00:15:01.608 fused_ordering(488) 00:15:01.608 fused_ordering(489) 00:15:01.608 fused_ordering(490) 00:15:01.608 fused_ordering(491) 00:15:01.608 fused_ordering(492) 00:15:01.608 fused_ordering(493) 00:15:01.608 fused_ordering(494) 00:15:01.608 fused_ordering(495) 00:15:01.608 fused_ordering(496) 00:15:01.608 fused_ordering(497) 00:15:01.608 fused_ordering(498) 00:15:01.608 fused_ordering(499) 00:15:01.608 fused_ordering(500) 00:15:01.608 fused_ordering(501) 00:15:01.608 fused_ordering(502) 00:15:01.608 fused_ordering(503) 00:15:01.608 fused_ordering(504) 00:15:01.608 fused_ordering(505) 00:15:01.608 fused_ordering(506) 00:15:01.608 fused_ordering(507) 00:15:01.608 fused_ordering(508) 00:15:01.608 fused_ordering(509) 00:15:01.608 fused_ordering(510) 00:15:01.608 fused_ordering(511) 00:15:01.608 fused_ordering(512) 00:15:01.608 fused_ordering(513) 00:15:01.608 fused_ordering(514) 00:15:01.608 fused_ordering(515) 00:15:01.608 fused_ordering(516) 00:15:01.608 fused_ordering(517) 00:15:01.608 fused_ordering(518) 00:15:01.608 fused_ordering(519) 00:15:01.608 fused_ordering(520) 00:15:01.608 fused_ordering(521) 00:15:01.608 fused_ordering(522) 00:15:01.608 fused_ordering(523) 00:15:01.608 fused_ordering(524) 00:15:01.608 fused_ordering(525) 00:15:01.608 fused_ordering(526) 00:15:01.608 fused_ordering(527) 00:15:01.608 fused_ordering(528) 00:15:01.608 fused_ordering(529) 00:15:01.608 fused_ordering(530) 00:15:01.608 fused_ordering(531) 00:15:01.608 fused_ordering(532) 00:15:01.608 fused_ordering(533) 00:15:01.608 fused_ordering(534) 00:15:01.608 fused_ordering(535) 00:15:01.608 fused_ordering(536) 00:15:01.609 fused_ordering(537) 00:15:01.609 fused_ordering(538) 00:15:01.609 fused_ordering(539) 00:15:01.609 fused_ordering(540) 00:15:01.609 fused_ordering(541) 00:15:01.609 fused_ordering(542) 00:15:01.609 fused_ordering(543) 00:15:01.609 fused_ordering(544) 00:15:01.609 fused_ordering(545) 00:15:01.609 fused_ordering(546) 00:15:01.609 fused_ordering(547) 00:15:01.609 fused_ordering(548) 00:15:01.609 fused_ordering(549) 00:15:01.609 fused_ordering(550) 00:15:01.609 fused_ordering(551) 00:15:01.609 fused_ordering(552) 00:15:01.609 fused_ordering(553) 00:15:01.609 fused_ordering(554) 00:15:01.609 fused_ordering(555) 00:15:01.609 fused_ordering(556) 00:15:01.609 fused_ordering(557) 00:15:01.609 fused_ordering(558) 00:15:01.609 fused_ordering(559) 00:15:01.609 fused_ordering(560) 00:15:01.609 fused_ordering(561) 00:15:01.609 fused_ordering(562) 00:15:01.609 fused_ordering(563) 00:15:01.609 fused_ordering(564) 00:15:01.609 fused_ordering(565) 00:15:01.609 fused_ordering(566) 00:15:01.609 fused_ordering(567) 00:15:01.609 fused_ordering(568) 00:15:01.609 fused_ordering(569) 00:15:01.609 fused_ordering(570) 00:15:01.609 fused_ordering(571) 00:15:01.609 fused_ordering(572) 00:15:01.609 fused_ordering(573) 00:15:01.609 fused_ordering(574) 00:15:01.609 fused_ordering(575) 00:15:01.609 fused_ordering(576) 00:15:01.609 fused_ordering(577) 00:15:01.609 fused_ordering(578) 00:15:01.609 fused_ordering(579) 00:15:01.609 fused_ordering(580) 00:15:01.609 fused_ordering(581) 00:15:01.609 fused_ordering(582) 00:15:01.609 fused_ordering(583) 00:15:01.609 fused_ordering(584) 00:15:01.609 fused_ordering(585) 00:15:01.609 fused_ordering(586) 00:15:01.609 fused_ordering(587) 00:15:01.609 fused_ordering(588) 00:15:01.609 fused_ordering(589) 00:15:01.609 fused_ordering(590) 00:15:01.609 fused_ordering(591) 00:15:01.609 fused_ordering(592) 00:15:01.609 fused_ordering(593) 00:15:01.609 fused_ordering(594) 00:15:01.609 fused_ordering(595) 00:15:01.609 fused_ordering(596) 00:15:01.609 fused_ordering(597) 00:15:01.609 fused_ordering(598) 00:15:01.609 fused_ordering(599) 00:15:01.609 fused_ordering(600) 00:15:01.609 fused_ordering(601) 00:15:01.609 fused_ordering(602) 00:15:01.609 fused_ordering(603) 00:15:01.609 fused_ordering(604) 00:15:01.609 fused_ordering(605) 00:15:01.609 fused_ordering(606) 00:15:01.609 fused_ordering(607) 00:15:01.609 fused_ordering(608) 00:15:01.609 fused_ordering(609) 00:15:01.609 fused_ordering(610) 00:15:01.609 fused_ordering(611) 00:15:01.609 fused_ordering(612) 00:15:01.609 fused_ordering(613) 00:15:01.609 fused_ordering(614) 00:15:01.609 fused_ordering(615) 00:15:02.184 fused_ordering(616) 00:15:02.184 fused_ordering(617) 00:15:02.184 fused_ordering(618) 00:15:02.184 fused_ordering(619) 00:15:02.184 fused_ordering(620) 00:15:02.184 fused_ordering(621) 00:15:02.184 fused_ordering(622) 00:15:02.184 fused_ordering(623) 00:15:02.184 fused_ordering(624) 00:15:02.184 fused_ordering(625) 00:15:02.184 fused_ordering(626) 00:15:02.184 fused_ordering(627) 00:15:02.184 fused_ordering(628) 00:15:02.184 fused_ordering(629) 00:15:02.184 fused_ordering(630) 00:15:02.184 fused_ordering(631) 00:15:02.184 fused_ordering(632) 00:15:02.184 fused_ordering(633) 00:15:02.184 fused_ordering(634) 00:15:02.184 fused_ordering(635) 00:15:02.184 fused_ordering(636) 00:15:02.184 fused_ordering(637) 00:15:02.184 fused_ordering(638) 00:15:02.184 fused_ordering(639) 00:15:02.184 fused_ordering(640) 00:15:02.184 fused_ordering(641) 00:15:02.184 fused_ordering(642) 00:15:02.184 fused_ordering(643) 00:15:02.184 fused_ordering(644) 00:15:02.184 fused_ordering(645) 00:15:02.184 fused_ordering(646) 00:15:02.184 fused_ordering(647) 00:15:02.184 fused_ordering(648) 00:15:02.184 fused_ordering(649) 00:15:02.184 fused_ordering(650) 00:15:02.184 fused_ordering(651) 00:15:02.184 fused_ordering(652) 00:15:02.184 fused_ordering(653) 00:15:02.184 fused_ordering(654) 00:15:02.184 fused_ordering(655) 00:15:02.184 fused_ordering(656) 00:15:02.184 fused_ordering(657) 00:15:02.184 fused_ordering(658) 00:15:02.184 fused_ordering(659) 00:15:02.184 fused_ordering(660) 00:15:02.184 fused_ordering(661) 00:15:02.184 fused_ordering(662) 00:15:02.184 fused_ordering(663) 00:15:02.184 fused_ordering(664) 00:15:02.184 fused_ordering(665) 00:15:02.184 fused_ordering(666) 00:15:02.184 fused_ordering(667) 00:15:02.185 fused_ordering(668) 00:15:02.185 fused_ordering(669) 00:15:02.185 fused_ordering(670) 00:15:02.185 fused_ordering(671) 00:15:02.185 fused_ordering(672) 00:15:02.185 fused_ordering(673) 00:15:02.185 fused_ordering(674) 00:15:02.185 fused_ordering(675) 00:15:02.185 fused_ordering(676) 00:15:02.185 fused_ordering(677) 00:15:02.185 fused_ordering(678) 00:15:02.185 fused_ordering(679) 00:15:02.185 fused_ordering(680) 00:15:02.185 fused_ordering(681) 00:15:02.185 fused_ordering(682) 00:15:02.185 fused_ordering(683) 00:15:02.185 fused_ordering(684) 00:15:02.185 fused_ordering(685) 00:15:02.185 fused_ordering(686) 00:15:02.185 fused_ordering(687) 00:15:02.185 fused_ordering(688) 00:15:02.185 fused_ordering(689) 00:15:02.185 fused_ordering(690) 00:15:02.185 fused_ordering(691) 00:15:02.185 fused_ordering(692) 00:15:02.185 fused_ordering(693) 00:15:02.185 fused_ordering(694) 00:15:02.185 fused_ordering(695) 00:15:02.185 fused_ordering(696) 00:15:02.185 fused_ordering(697) 00:15:02.185 fused_ordering(698) 00:15:02.185 fused_ordering(699) 00:15:02.185 fused_ordering(700) 00:15:02.185 fused_ordering(701) 00:15:02.185 fused_ordering(702) 00:15:02.185 fused_ordering(703) 00:15:02.185 fused_ordering(704) 00:15:02.185 fused_ordering(705) 00:15:02.185 fused_ordering(706) 00:15:02.185 fused_ordering(707) 00:15:02.185 fused_ordering(708) 00:15:02.185 fused_ordering(709) 00:15:02.185 fused_ordering(710) 00:15:02.185 fused_ordering(711) 00:15:02.185 fused_ordering(712) 00:15:02.185 fused_ordering(713) 00:15:02.185 fused_ordering(714) 00:15:02.185 fused_ordering(715) 00:15:02.185 fused_ordering(716) 00:15:02.185 fused_ordering(717) 00:15:02.185 fused_ordering(718) 00:15:02.185 fused_ordering(719) 00:15:02.185 fused_ordering(720) 00:15:02.185 fused_ordering(721) 00:15:02.185 fused_ordering(722) 00:15:02.185 fused_ordering(723) 00:15:02.185 fused_ordering(724) 00:15:02.185 fused_ordering(725) 00:15:02.185 fused_ordering(726) 00:15:02.185 fused_ordering(727) 00:15:02.185 fused_ordering(728) 00:15:02.185 fused_ordering(729) 00:15:02.185 fused_ordering(730) 00:15:02.185 fused_ordering(731) 00:15:02.185 fused_ordering(732) 00:15:02.185 fused_ordering(733) 00:15:02.185 fused_ordering(734) 00:15:02.185 fused_ordering(735) 00:15:02.185 fused_ordering(736) 00:15:02.185 fused_ordering(737) 00:15:02.185 fused_ordering(738) 00:15:02.185 fused_ordering(739) 00:15:02.185 fused_ordering(740) 00:15:02.185 fused_ordering(741) 00:15:02.185 fused_ordering(742) 00:15:02.185 fused_ordering(743) 00:15:02.185 fused_ordering(744) 00:15:02.185 fused_ordering(745) 00:15:02.185 fused_ordering(746) 00:15:02.185 fused_ordering(747) 00:15:02.185 fused_ordering(748) 00:15:02.185 fused_ordering(749) 00:15:02.185 fused_ordering(750) 00:15:02.185 fused_ordering(751) 00:15:02.185 fused_ordering(752) 00:15:02.185 fused_ordering(753) 00:15:02.185 fused_ordering(754) 00:15:02.185 fused_ordering(755) 00:15:02.185 fused_ordering(756) 00:15:02.185 fused_ordering(757) 00:15:02.185 fused_ordering(758) 00:15:02.185 fused_ordering(759) 00:15:02.185 fused_ordering(760) 00:15:02.185 fused_ordering(761) 00:15:02.185 fused_ordering(762) 00:15:02.185 fused_ordering(763) 00:15:02.185 fused_ordering(764) 00:15:02.185 fused_ordering(765) 00:15:02.185 fused_ordering(766) 00:15:02.185 fused_ordering(767) 00:15:02.185 fused_ordering(768) 00:15:02.185 fused_ordering(769) 00:15:02.185 fused_ordering(770) 00:15:02.185 fused_ordering(771) 00:15:02.185 fused_ordering(772) 00:15:02.185 fused_ordering(773) 00:15:02.185 fused_ordering(774) 00:15:02.185 fused_ordering(775) 00:15:02.185 fused_ordering(776) 00:15:02.185 fused_ordering(777) 00:15:02.185 fused_ordering(778) 00:15:02.185 fused_ordering(779) 00:15:02.185 fused_ordering(780) 00:15:02.185 fused_ordering(781) 00:15:02.185 fused_ordering(782) 00:15:02.185 fused_ordering(783) 00:15:02.185 fused_ordering(784) 00:15:02.185 fused_ordering(785) 00:15:02.185 fused_ordering(786) 00:15:02.185 fused_ordering(787) 00:15:02.185 fused_ordering(788) 00:15:02.185 fused_ordering(789) 00:15:02.185 fused_ordering(790) 00:15:02.185 fused_ordering(791) 00:15:02.185 fused_ordering(792) 00:15:02.185 fused_ordering(793) 00:15:02.185 fused_ordering(794) 00:15:02.185 fused_ordering(795) 00:15:02.185 fused_ordering(796) 00:15:02.185 fused_ordering(797) 00:15:02.185 fused_ordering(798) 00:15:02.185 fused_ordering(799) 00:15:02.185 fused_ordering(800) 00:15:02.185 fused_ordering(801) 00:15:02.185 fused_ordering(802) 00:15:02.185 fused_ordering(803) 00:15:02.185 fused_ordering(804) 00:15:02.185 fused_ordering(805) 00:15:02.185 fused_ordering(806) 00:15:02.185 fused_ordering(807) 00:15:02.185 fused_ordering(808) 00:15:02.185 fused_ordering(809) 00:15:02.185 fused_ordering(810) 00:15:02.185 fused_ordering(811) 00:15:02.185 fused_ordering(812) 00:15:02.185 fused_ordering(813) 00:15:02.185 fused_ordering(814) 00:15:02.185 fused_ordering(815) 00:15:02.185 fused_ordering(816) 00:15:02.185 fused_ordering(817) 00:15:02.185 fused_ordering(818) 00:15:02.185 fused_ordering(819) 00:15:02.185 fused_ordering(820) 00:15:03.120 fused_ordering(821) 00:15:03.120 fused_ordering(822) 00:15:03.120 fused_ordering(823) 00:15:03.120 fused_ordering(824) 00:15:03.120 fused_ordering(825) 00:15:03.120 fused_ordering(826) 00:15:03.120 fused_ordering(827) 00:15:03.120 fused_ordering(828) 00:15:03.120 fused_ordering(829) 00:15:03.120 fused_ordering(830) 00:15:03.120 fused_ordering(831) 00:15:03.120 fused_ordering(832) 00:15:03.120 fused_ordering(833) 00:15:03.120 fused_ordering(834) 00:15:03.120 fused_ordering(835) 00:15:03.120 fused_ordering(836) 00:15:03.120 fused_ordering(837) 00:15:03.120 fused_ordering(838) 00:15:03.120 fused_ordering(839) 00:15:03.120 fused_ordering(840) 00:15:03.120 fused_ordering(841) 00:15:03.120 fused_ordering(842) 00:15:03.120 fused_ordering(843) 00:15:03.120 fused_ordering(844) 00:15:03.120 fused_ordering(845) 00:15:03.120 fused_ordering(846) 00:15:03.120 fused_ordering(847) 00:15:03.120 fused_ordering(848) 00:15:03.120 fused_ordering(849) 00:15:03.120 fused_ordering(850) 00:15:03.120 fused_ordering(851) 00:15:03.120 fused_ordering(852) 00:15:03.120 fused_ordering(853) 00:15:03.120 fused_ordering(854) 00:15:03.120 fused_ordering(855) 00:15:03.120 fused_ordering(856) 00:15:03.120 fused_ordering(857) 00:15:03.120 fused_ordering(858) 00:15:03.120 fused_ordering(859) 00:15:03.120 fused_ordering(860) 00:15:03.120 fused_ordering(861) 00:15:03.120 fused_ordering(862) 00:15:03.120 fused_ordering(863) 00:15:03.120 fused_ordering(864) 00:15:03.120 fused_ordering(865) 00:15:03.120 fused_ordering(866) 00:15:03.120 fused_ordering(867) 00:15:03.120 fused_ordering(868) 00:15:03.120 fused_ordering(869) 00:15:03.120 fused_ordering(870) 00:15:03.120 fused_ordering(871) 00:15:03.120 fused_ordering(872) 00:15:03.120 fused_ordering(873) 00:15:03.120 fused_ordering(874) 00:15:03.120 fused_ordering(875) 00:15:03.120 fused_ordering(876) 00:15:03.120 fused_ordering(877) 00:15:03.120 fused_ordering(878) 00:15:03.120 fused_ordering(879) 00:15:03.120 fused_ordering(880) 00:15:03.120 fused_ordering(881) 00:15:03.121 fused_ordering(882) 00:15:03.121 fused_ordering(883) 00:15:03.121 fused_ordering(884) 00:15:03.121 fused_ordering(885) 00:15:03.121 fused_ordering(886) 00:15:03.121 fused_ordering(887) 00:15:03.121 fused_ordering(888) 00:15:03.121 fused_ordering(889) 00:15:03.121 fused_ordering(890) 00:15:03.121 fused_ordering(891) 00:15:03.121 fused_ordering(892) 00:15:03.121 fused_ordering(893) 00:15:03.121 fused_ordering(894) 00:15:03.121 fused_ordering(895) 00:15:03.121 fused_ordering(896) 00:15:03.121 fused_ordering(897) 00:15:03.121 fused_ordering(898) 00:15:03.121 fused_ordering(899) 00:15:03.121 fused_ordering(900) 00:15:03.121 fused_ordering(901) 00:15:03.121 fused_ordering(902) 00:15:03.121 fused_ordering(903) 00:15:03.121 fused_ordering(904) 00:15:03.121 fused_ordering(905) 00:15:03.121 fused_ordering(906) 00:15:03.121 fused_ordering(907) 00:15:03.121 fused_ordering(908) 00:15:03.121 fused_ordering(909) 00:15:03.121 fused_ordering(910) 00:15:03.121 fused_ordering(911) 00:15:03.121 fused_ordering(912) 00:15:03.121 fused_ordering(913) 00:15:03.121 fused_ordering(914) 00:15:03.121 fused_ordering(915) 00:15:03.121 fused_ordering(916) 00:15:03.121 fused_ordering(917) 00:15:03.121 fused_ordering(918) 00:15:03.121 fused_ordering(919) 00:15:03.121 fused_ordering(920) 00:15:03.121 fused_ordering(921) 00:15:03.121 fused_ordering(922) 00:15:03.121 fused_ordering(923) 00:15:03.121 fused_ordering(924) 00:15:03.121 fused_ordering(925) 00:15:03.121 fused_ordering(926) 00:15:03.121 fused_ordering(927) 00:15:03.121 fused_ordering(928) 00:15:03.121 fused_ordering(929) 00:15:03.121 fused_ordering(930) 00:15:03.121 fused_ordering(931) 00:15:03.121 fused_ordering(932) 00:15:03.121 fused_ordering(933) 00:15:03.121 fused_ordering(934) 00:15:03.121 fused_ordering(935) 00:15:03.121 fused_ordering(936) 00:15:03.121 fused_ordering(937) 00:15:03.121 fused_ordering(938) 00:15:03.121 fused_ordering(939) 00:15:03.121 fused_ordering(940) 00:15:03.121 fused_ordering(941) 00:15:03.121 fused_ordering(942) 00:15:03.121 fused_ordering(943) 00:15:03.121 fused_ordering(944) 00:15:03.121 fused_ordering(945) 00:15:03.121 fused_ordering(946) 00:15:03.121 fused_ordering(947) 00:15:03.121 fused_ordering(948) 00:15:03.121 fused_ordering(949) 00:15:03.121 fused_ordering(950) 00:15:03.121 fused_ordering(951) 00:15:03.121 fused_ordering(952) 00:15:03.121 fused_ordering(953) 00:15:03.121 fused_ordering(954) 00:15:03.121 fused_ordering(955) 00:15:03.121 fused_ordering(956) 00:15:03.121 fused_ordering(957) 00:15:03.121 fused_ordering(958) 00:15:03.121 fused_ordering(959) 00:15:03.121 fused_ordering(960) 00:15:03.121 fused_ordering(961) 00:15:03.121 fused_ordering(962) 00:15:03.121 fused_ordering(963) 00:15:03.121 fused_ordering(964) 00:15:03.121 fused_ordering(965) 00:15:03.121 fused_ordering(966) 00:15:03.121 fused_ordering(967) 00:15:03.121 fused_ordering(968) 00:15:03.121 fused_ordering(969) 00:15:03.121 fused_ordering(970) 00:15:03.121 fused_ordering(971) 00:15:03.121 fused_ordering(972) 00:15:03.121 fused_ordering(973) 00:15:03.121 fused_ordering(974) 00:15:03.121 fused_ordering(975) 00:15:03.121 fused_ordering(976) 00:15:03.121 fused_ordering(977) 00:15:03.121 fused_ordering(978) 00:15:03.121 fused_ordering(979) 00:15:03.121 fused_ordering(980) 00:15:03.121 fused_ordering(981) 00:15:03.121 fused_ordering(982) 00:15:03.121 fused_ordering(983) 00:15:03.121 fused_ordering(984) 00:15:03.121 fused_ordering(985) 00:15:03.121 fused_ordering(986) 00:15:03.121 fused_ordering(987) 00:15:03.121 fused_ordering(988) 00:15:03.121 fused_ordering(989) 00:15:03.121 fused_ordering(990) 00:15:03.121 fused_ordering(991) 00:15:03.121 fused_ordering(992) 00:15:03.121 fused_ordering(993) 00:15:03.121 fused_ordering(994) 00:15:03.121 fused_ordering(995) 00:15:03.121 fused_ordering(996) 00:15:03.121 fused_ordering(997) 00:15:03.121 fused_ordering(998) 00:15:03.121 fused_ordering(999) 00:15:03.121 fused_ordering(1000) 00:15:03.121 fused_ordering(1001) 00:15:03.121 fused_ordering(1002) 00:15:03.121 fused_ordering(1003) 00:15:03.121 fused_ordering(1004) 00:15:03.121 fused_ordering(1005) 00:15:03.121 fused_ordering(1006) 00:15:03.121 fused_ordering(1007) 00:15:03.121 fused_ordering(1008) 00:15:03.121 fused_ordering(1009) 00:15:03.121 fused_ordering(1010) 00:15:03.121 fused_ordering(1011) 00:15:03.121 fused_ordering(1012) 00:15:03.121 fused_ordering(1013) 00:15:03.121 fused_ordering(1014) 00:15:03.121 fused_ordering(1015) 00:15:03.121 fused_ordering(1016) 00:15:03.121 fused_ordering(1017) 00:15:03.121 fused_ordering(1018) 00:15:03.121 fused_ordering(1019) 00:15:03.121 fused_ordering(1020) 00:15:03.121 fused_ordering(1021) 00:15:03.121 fused_ordering(1022) 00:15:03.121 fused_ordering(1023) 00:15:03.121 17:34:40 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:03.121 17:34:40 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:03.121 17:34:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:03.121 17:34:40 -- nvmf/common.sh@116 -- # sync 00:15:03.121 17:34:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:03.121 17:34:40 -- nvmf/common.sh@119 -- # set +e 00:15:03.121 17:34:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:03.121 17:34:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:03.121 rmmod nvme_tcp 00:15:03.121 rmmod nvme_fabrics 00:15:03.121 rmmod nvme_keyring 00:15:03.121 17:34:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:03.121 17:34:40 -- nvmf/common.sh@123 -- # set -e 00:15:03.121 17:34:40 -- nvmf/common.sh@124 -- # return 0 00:15:03.121 17:34:40 -- nvmf/common.sh@477 -- # '[' -n 1549092 ']' 00:15:03.121 17:34:40 -- nvmf/common.sh@478 -- # killprocess 1549092 00:15:03.121 17:34:40 -- common/autotest_common.sh@936 -- # '[' -z 1549092 ']' 00:15:03.121 17:34:40 -- common/autotest_common.sh@940 -- # kill -0 1549092 00:15:03.121 17:34:40 -- common/autotest_common.sh@941 -- # uname 00:15:03.121 17:34:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:03.121 17:34:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1549092 00:15:03.121 17:34:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:03.121 17:34:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:03.121 17:34:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1549092' 00:15:03.121 killing process with pid 1549092 00:15:03.121 17:34:40 -- common/autotest_common.sh@955 -- # kill 1549092 00:15:03.121 17:34:40 -- common/autotest_common.sh@960 -- # wait 1549092 00:15:03.380 17:34:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:03.380 17:34:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:03.380 17:34:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:03.380 17:34:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:03.380 17:34:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:03.380 17:34:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:03.380 17:34:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:03.380 17:34:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:05.286 17:34:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:05.286 00:15:05.286 real 0m8.436s 00:15:05.286 user 0m6.287s 00:15:05.286 sys 0m3.247s 00:15:05.286 17:34:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:05.286 17:34:42 -- common/autotest_common.sh@10 -- # set +x 00:15:05.286 ************************************ 00:15:05.286 END TEST nvmf_fused_ordering 00:15:05.286 ************************************ 00:15:05.286 17:34:42 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:05.286 17:34:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:05.286 17:34:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:05.286 17:34:42 -- common/autotest_common.sh@10 -- # set +x 00:15:05.286 ************************************ 00:15:05.286 START TEST nvmf_delete_subsystem 00:15:05.286 ************************************ 00:15:05.286 17:34:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:05.546 * Looking for test storage... 00:15:05.546 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:05.546 17:34:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:05.546 17:34:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:05.546 17:34:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:05.546 17:34:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:05.546 17:34:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:05.546 17:34:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:05.546 17:34:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:05.546 17:34:42 -- scripts/common.sh@335 -- # IFS=.-: 00:15:05.546 17:34:42 -- scripts/common.sh@335 -- # read -ra ver1 00:15:05.546 17:34:42 -- scripts/common.sh@336 -- # IFS=.-: 00:15:05.546 17:34:42 -- scripts/common.sh@336 -- # read -ra ver2 00:15:05.546 17:34:42 -- scripts/common.sh@337 -- # local 'op=<' 00:15:05.546 17:34:42 -- scripts/common.sh@339 -- # ver1_l=2 00:15:05.546 17:34:42 -- scripts/common.sh@340 -- # ver2_l=1 00:15:05.546 17:34:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:05.546 17:34:42 -- scripts/common.sh@343 -- # case "$op" in 00:15:05.546 17:34:42 -- scripts/common.sh@344 -- # : 1 00:15:05.546 17:34:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:05.546 17:34:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:05.546 17:34:42 -- scripts/common.sh@364 -- # decimal 1 00:15:05.546 17:34:42 -- scripts/common.sh@352 -- # local d=1 00:15:05.546 17:34:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:05.546 17:34:42 -- scripts/common.sh@354 -- # echo 1 00:15:05.546 17:34:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:05.546 17:34:42 -- scripts/common.sh@365 -- # decimal 2 00:15:05.546 17:34:42 -- scripts/common.sh@352 -- # local d=2 00:15:05.546 17:34:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:05.546 17:34:42 -- scripts/common.sh@354 -- # echo 2 00:15:05.546 17:34:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:05.546 17:34:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:05.546 17:34:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:05.546 17:34:42 -- scripts/common.sh@367 -- # return 0 00:15:05.546 17:34:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:05.546 17:34:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:05.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:05.546 --rc genhtml_branch_coverage=1 00:15:05.546 --rc genhtml_function_coverage=1 00:15:05.546 --rc genhtml_legend=1 00:15:05.546 --rc geninfo_all_blocks=1 00:15:05.546 --rc geninfo_unexecuted_blocks=1 00:15:05.546 00:15:05.546 ' 00:15:05.546 17:34:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:05.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:05.546 --rc genhtml_branch_coverage=1 00:15:05.546 --rc genhtml_function_coverage=1 00:15:05.546 --rc genhtml_legend=1 00:15:05.546 --rc geninfo_all_blocks=1 00:15:05.546 --rc geninfo_unexecuted_blocks=1 00:15:05.546 00:15:05.546 ' 00:15:05.546 17:34:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:05.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:05.546 --rc genhtml_branch_coverage=1 00:15:05.546 --rc genhtml_function_coverage=1 00:15:05.546 --rc genhtml_legend=1 00:15:05.546 --rc geninfo_all_blocks=1 00:15:05.546 --rc geninfo_unexecuted_blocks=1 00:15:05.546 00:15:05.546 ' 00:15:05.546 17:34:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:05.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:05.546 --rc genhtml_branch_coverage=1 00:15:05.546 --rc genhtml_function_coverage=1 00:15:05.546 --rc genhtml_legend=1 00:15:05.546 --rc geninfo_all_blocks=1 00:15:05.546 --rc geninfo_unexecuted_blocks=1 00:15:05.546 00:15:05.546 ' 00:15:05.546 17:34:42 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:05.546 17:34:42 -- nvmf/common.sh@7 -- # uname -s 00:15:05.546 17:34:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:05.546 17:34:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:05.546 17:34:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:05.546 17:34:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:05.546 17:34:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:05.546 17:34:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:05.546 17:34:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:05.546 17:34:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:05.546 17:34:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:05.546 17:34:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:05.546 17:34:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:05.546 17:34:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:05.546 17:34:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:05.546 17:34:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:05.546 17:34:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:05.546 17:34:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:05.546 17:34:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:05.546 17:34:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:05.546 17:34:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:05.546 17:34:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.546 17:34:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.546 17:34:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.546 17:34:42 -- paths/export.sh@5 -- # export PATH 00:15:05.546 17:34:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:05.546 17:34:42 -- nvmf/common.sh@46 -- # : 0 00:15:05.546 17:34:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:05.546 17:34:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:05.546 17:34:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:05.546 17:34:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:05.546 17:34:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:05.546 17:34:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:05.546 17:34:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:05.546 17:34:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:05.546 17:34:42 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:05.546 17:34:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:05.546 17:34:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:05.546 17:34:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:05.546 17:34:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:05.546 17:34:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:05.546 17:34:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:05.546 17:34:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:05.546 17:34:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:05.546 17:34:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:05.546 17:34:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:05.546 17:34:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:05.546 17:34:42 -- common/autotest_common.sh@10 -- # set +x 00:15:08.081 17:34:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:08.081 17:34:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:08.081 17:34:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:08.081 17:34:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:08.081 17:34:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:08.081 17:34:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:08.081 17:34:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:08.081 17:34:44 -- nvmf/common.sh@294 -- # net_devs=() 00:15:08.081 17:34:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:08.081 17:34:44 -- nvmf/common.sh@295 -- # e810=() 00:15:08.081 17:34:44 -- nvmf/common.sh@295 -- # local -ga e810 00:15:08.081 17:34:44 -- nvmf/common.sh@296 -- # x722=() 00:15:08.081 17:34:44 -- nvmf/common.sh@296 -- # local -ga x722 00:15:08.081 17:34:44 -- nvmf/common.sh@297 -- # mlx=() 00:15:08.081 17:34:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:08.081 17:34:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:08.081 17:34:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:08.081 17:34:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:08.081 17:34:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:08.081 17:34:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:08.081 17:34:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:08.081 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:08.081 17:34:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:08.081 17:34:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:08.081 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:08.081 17:34:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:08.081 17:34:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:08.081 17:34:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:08.081 17:34:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:08.081 17:34:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:08.081 17:34:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:08.081 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:08.081 17:34:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:08.081 17:34:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:08.081 17:34:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:08.081 17:34:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:08.081 17:34:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:08.081 17:34:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:08.081 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:08.081 17:34:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:08.081 17:34:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:08.081 17:34:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:08.081 17:34:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:08.081 17:34:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:08.081 17:34:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:08.081 17:34:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:08.081 17:34:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:08.081 17:34:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:08.081 17:34:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:08.081 17:34:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:08.081 17:34:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:08.081 17:34:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:08.081 17:34:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:08.081 17:34:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:08.081 17:34:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:08.081 17:34:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:08.081 17:34:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:08.081 17:34:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:08.081 17:34:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:08.081 17:34:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:08.081 17:34:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:08.081 17:34:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:08.081 17:34:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:08.081 17:34:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:08.081 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:08.081 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:15:08.081 00:15:08.081 --- 10.0.0.2 ping statistics --- 00:15:08.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:08.081 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:15:08.081 17:34:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:08.081 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:08.081 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:15:08.081 00:15:08.081 --- 10.0.0.1 ping statistics --- 00:15:08.081 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:08.081 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:15:08.081 17:34:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:08.081 17:34:45 -- nvmf/common.sh@410 -- # return 0 00:15:08.081 17:34:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:08.081 17:34:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:08.082 17:34:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:08.082 17:34:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:08.082 17:34:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:08.082 17:34:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:08.082 17:34:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:08.082 17:34:45 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:08.082 17:34:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:08.082 17:34:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:08.082 17:34:45 -- common/autotest_common.sh@10 -- # set +x 00:15:08.082 17:34:45 -- nvmf/common.sh@469 -- # nvmfpid=1551471 00:15:08.082 17:34:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:08.082 17:34:45 -- nvmf/common.sh@470 -- # waitforlisten 1551471 00:15:08.082 17:34:45 -- common/autotest_common.sh@829 -- # '[' -z 1551471 ']' 00:15:08.082 17:34:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:08.082 17:34:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:08.082 17:34:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:08.082 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:08.082 17:34:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:08.082 17:34:45 -- common/autotest_common.sh@10 -- # set +x 00:15:08.082 [2024-11-16 17:34:45.200522] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:08.082 [2024-11-16 17:34:45.200629] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:08.082 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.082 [2024-11-16 17:34:45.266424] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:08.082 [2024-11-16 17:34:45.353675] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:08.082 [2024-11-16 17:34:45.353843] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:08.082 [2024-11-16 17:34:45.353876] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:08.082 [2024-11-16 17:34:45.353890] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:08.082 [2024-11-16 17:34:45.354034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:08.082 [2024-11-16 17:34:45.354039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:09.019 17:34:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:09.019 17:34:46 -- common/autotest_common.sh@862 -- # return 0 00:15:09.019 17:34:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:09.019 17:34:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:09.019 17:34:46 -- common/autotest_common.sh@10 -- # set +x 00:15:09.019 17:34:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:09.019 17:34:46 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:09.019 17:34:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.019 17:34:46 -- common/autotest_common.sh@10 -- # set +x 00:15:09.019 [2024-11-16 17:34:46.194006] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:09.019 17:34:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.019 17:34:46 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:09.019 17:34:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.019 17:34:46 -- common/autotest_common.sh@10 -- # set +x 00:15:09.019 17:34:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.019 17:34:46 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:09.019 17:34:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.019 17:34:46 -- common/autotest_common.sh@10 -- # set +x 00:15:09.019 [2024-11-16 17:34:46.210214] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:09.020 17:34:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.020 17:34:46 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:09.020 17:34:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.020 17:34:46 -- common/autotest_common.sh@10 -- # set +x 00:15:09.020 NULL1 00:15:09.020 17:34:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.020 17:34:46 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:09.020 17:34:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.020 17:34:46 -- common/autotest_common.sh@10 -- # set +x 00:15:09.020 Delay0 00:15:09.020 17:34:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.020 17:34:46 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:09.020 17:34:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.020 17:34:46 -- common/autotest_common.sh@10 -- # set +x 00:15:09.020 17:34:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.020 17:34:46 -- target/delete_subsystem.sh@28 -- # perf_pid=1551630 00:15:09.020 17:34:46 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:09.020 17:34:46 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:09.020 EAL: No free 2048 kB hugepages reported on node 1 00:15:09.020 [2024-11-16 17:34:46.284825] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:10.927 17:34:48 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:10.927 17:34:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.927 17:34:48 -- common/autotest_common.sh@10 -- # set +x 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Write completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 starting I/O failed: -6 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.927 Read completed with error (sct=0, sc=8) 00:15:10.928 [2024-11-16 17:34:48.364699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a07c90 is same with the state(5) to be set 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 starting I/O failed: -6 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 [2024-11-16 17:34:48.365648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fbd74000c00 is same with the state(5) to be set 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Read completed with error (sct=0, sc=8) 00:15:10.928 Write completed with error (sct=0, sc=8) 00:15:11.865 [2024-11-16 17:34:49.339985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a07a40 is same with the state(5) to be set 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 [2024-11-16 17:34:49.366440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a06810 is same with the state(5) to be set 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 [2024-11-16 17:34:49.366674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a07e10 is same with the state(5) to be set 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 [2024-11-16 17:34:49.367935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fbd7400c480 is same with the state(5) to be set 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 Read completed with error (sct=0, sc=8) 00:15:12.126 Write completed with error (sct=0, sc=8) 00:15:12.126 [2024-11-16 17:34:49.368567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fbd7400bf20 is same with the state(5) to be set 00:15:12.126 [2024-11-16 17:34:49.369002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a07a40 (9): Bad file descriptor 00:15:12.126 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:12.126 17:34:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.126 17:34:49 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:12.126 17:34:49 -- target/delete_subsystem.sh@35 -- # kill -0 1551630 00:15:12.126 17:34:49 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:12.126 Initializing NVMe Controllers 00:15:12.126 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:12.126 Controller IO queue size 128, less than required. 00:15:12.126 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:12.126 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:12.126 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:12.126 Initialization complete. Launching workers. 00:15:12.126 ======================================================== 00:15:12.126 Latency(us) 00:15:12.126 Device Information : IOPS MiB/s Average min max 00:15:12.126 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 169.89 0.08 893717.94 422.01 1010204.06 00:15:12.126 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 166.41 0.08 957559.15 384.40 2002647.36 00:15:12.126 ======================================================== 00:15:12.126 Total : 336.30 0.16 925308.49 384.40 2002647.36 00:15:12.126 00:15:12.386 17:34:49 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:12.386 17:34:49 -- target/delete_subsystem.sh@35 -- # kill -0 1551630 00:15:12.386 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1551630) - No such process 00:15:12.386 17:34:49 -- target/delete_subsystem.sh@45 -- # NOT wait 1551630 00:15:12.386 17:34:49 -- common/autotest_common.sh@650 -- # local es=0 00:15:12.386 17:34:49 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 1551630 00:15:12.386 17:34:49 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:12.386 17:34:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.386 17:34:49 -- common/autotest_common.sh@642 -- # type -t wait 00:15:12.386 17:34:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:12.386 17:34:49 -- common/autotest_common.sh@653 -- # wait 1551630 00:15:12.386 17:34:49 -- common/autotest_common.sh@653 -- # es=1 00:15:12.646 17:34:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:12.646 17:34:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:12.646 17:34:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:12.646 17:34:49 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:12.646 17:34:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.646 17:34:49 -- common/autotest_common.sh@10 -- # set +x 00:15:12.646 17:34:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.646 17:34:49 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:12.646 17:34:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.646 17:34:49 -- common/autotest_common.sh@10 -- # set +x 00:15:12.646 [2024-11-16 17:34:49.893229] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:12.646 17:34:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.646 17:34:49 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:12.646 17:34:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:12.646 17:34:49 -- common/autotest_common.sh@10 -- # set +x 00:15:12.646 17:34:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:12.646 17:34:49 -- target/delete_subsystem.sh@54 -- # perf_pid=1552045 00:15:12.646 17:34:49 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:12.646 17:34:49 -- target/delete_subsystem.sh@57 -- # kill -0 1552045 00:15:12.646 17:34:49 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:12.646 17:34:49 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:12.646 EAL: No free 2048 kB hugepages reported on node 1 00:15:12.646 [2024-11-16 17:34:49.956648] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:13.214 17:34:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:13.214 17:34:50 -- target/delete_subsystem.sh@57 -- # kill -0 1552045 00:15:13.214 17:34:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:13.474 17:34:50 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:13.474 17:34:50 -- target/delete_subsystem.sh@57 -- # kill -0 1552045 00:15:13.474 17:34:50 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:14.041 17:34:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:14.041 17:34:51 -- target/delete_subsystem.sh@57 -- # kill -0 1552045 00:15:14.041 17:34:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:14.638 17:34:51 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:14.638 17:34:51 -- target/delete_subsystem.sh@57 -- # kill -0 1552045 00:15:14.638 17:34:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.226 17:34:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.226 17:34:52 -- target/delete_subsystem.sh@57 -- # kill -0 1552045 00:15:15.226 17:34:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.484 17:34:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.484 17:34:52 -- target/delete_subsystem.sh@57 -- # kill -0 1552045 00:15:15.484 17:34:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.742 Initializing NVMe Controllers 00:15:15.742 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:15.742 Controller IO queue size 128, less than required. 00:15:15.742 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:15.742 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:15.742 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:15.742 Initialization complete. Launching workers. 00:15:15.742 ======================================================== 00:15:15.742 Latency(us) 00:15:15.742 Device Information : IOPS MiB/s Average min max 00:15:15.742 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003612.19 1000169.22 1014778.17 00:15:15.742 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005802.44 1000179.19 1042716.47 00:15:15.742 ======================================================== 00:15:15.742 Total : 256.00 0.12 1004707.31 1000169.22 1042716.47 00:15:15.742 00:15:16.000 17:34:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:16.001 17:34:53 -- target/delete_subsystem.sh@57 -- # kill -0 1552045 00:15:16.001 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1552045) - No such process 00:15:16.001 17:34:53 -- target/delete_subsystem.sh@67 -- # wait 1552045 00:15:16.001 17:34:53 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:16.001 17:34:53 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:16.001 17:34:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:16.001 17:34:53 -- nvmf/common.sh@116 -- # sync 00:15:16.001 17:34:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:16.001 17:34:53 -- nvmf/common.sh@119 -- # set +e 00:15:16.001 17:34:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:16.001 17:34:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:16.001 rmmod nvme_tcp 00:15:16.001 rmmod nvme_fabrics 00:15:16.001 rmmod nvme_keyring 00:15:16.001 17:34:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:16.001 17:34:53 -- nvmf/common.sh@123 -- # set -e 00:15:16.001 17:34:53 -- nvmf/common.sh@124 -- # return 0 00:15:16.001 17:34:53 -- nvmf/common.sh@477 -- # '[' -n 1551471 ']' 00:15:16.001 17:34:53 -- nvmf/common.sh@478 -- # killprocess 1551471 00:15:16.001 17:34:53 -- common/autotest_common.sh@936 -- # '[' -z 1551471 ']' 00:15:16.001 17:34:53 -- common/autotest_common.sh@940 -- # kill -0 1551471 00:15:16.001 17:34:53 -- common/autotest_common.sh@941 -- # uname 00:15:16.001 17:34:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:16.001 17:34:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1551471 00:15:16.259 17:34:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:16.259 17:34:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:16.259 17:34:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1551471' 00:15:16.259 killing process with pid 1551471 00:15:16.259 17:34:53 -- common/autotest_common.sh@955 -- # kill 1551471 00:15:16.259 17:34:53 -- common/autotest_common.sh@960 -- # wait 1551471 00:15:16.259 17:34:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:16.259 17:34:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:16.259 17:34:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:16.259 17:34:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:16.259 17:34:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:16.259 17:34:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:16.259 17:34:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:16.259 17:34:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.798 17:34:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:18.798 00:15:18.798 real 0m13.046s 00:15:18.798 user 0m29.240s 00:15:18.798 sys 0m3.153s 00:15:18.798 17:34:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:18.798 17:34:55 -- common/autotest_common.sh@10 -- # set +x 00:15:18.798 ************************************ 00:15:18.798 END TEST nvmf_delete_subsystem 00:15:18.798 ************************************ 00:15:18.798 17:34:55 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:18.798 17:34:55 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:18.798 17:34:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:18.798 17:34:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:18.798 17:34:55 -- common/autotest_common.sh@10 -- # set +x 00:15:18.798 ************************************ 00:15:18.798 START TEST nvmf_nvme_cli 00:15:18.798 ************************************ 00:15:18.798 17:34:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:18.798 * Looking for test storage... 00:15:18.798 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:18.798 17:34:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:18.798 17:34:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:18.798 17:34:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:18.798 17:34:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:18.798 17:34:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:18.798 17:34:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:18.798 17:34:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:18.798 17:34:55 -- scripts/common.sh@335 -- # IFS=.-: 00:15:18.798 17:34:55 -- scripts/common.sh@335 -- # read -ra ver1 00:15:18.798 17:34:55 -- scripts/common.sh@336 -- # IFS=.-: 00:15:18.798 17:34:55 -- scripts/common.sh@336 -- # read -ra ver2 00:15:18.798 17:34:55 -- scripts/common.sh@337 -- # local 'op=<' 00:15:18.798 17:34:55 -- scripts/common.sh@339 -- # ver1_l=2 00:15:18.798 17:34:55 -- scripts/common.sh@340 -- # ver2_l=1 00:15:18.798 17:34:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:18.798 17:34:55 -- scripts/common.sh@343 -- # case "$op" in 00:15:18.798 17:34:55 -- scripts/common.sh@344 -- # : 1 00:15:18.798 17:34:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:18.798 17:34:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:18.798 17:34:55 -- scripts/common.sh@364 -- # decimal 1 00:15:18.798 17:34:55 -- scripts/common.sh@352 -- # local d=1 00:15:18.798 17:34:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:18.798 17:34:55 -- scripts/common.sh@354 -- # echo 1 00:15:18.798 17:34:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:18.798 17:34:55 -- scripts/common.sh@365 -- # decimal 2 00:15:18.798 17:34:55 -- scripts/common.sh@352 -- # local d=2 00:15:18.798 17:34:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:18.798 17:34:55 -- scripts/common.sh@354 -- # echo 2 00:15:18.798 17:34:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:18.798 17:34:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:18.798 17:34:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:18.798 17:34:55 -- scripts/common.sh@367 -- # return 0 00:15:18.798 17:34:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:18.798 17:34:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:18.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.798 --rc genhtml_branch_coverage=1 00:15:18.798 --rc genhtml_function_coverage=1 00:15:18.798 --rc genhtml_legend=1 00:15:18.798 --rc geninfo_all_blocks=1 00:15:18.798 --rc geninfo_unexecuted_blocks=1 00:15:18.798 00:15:18.798 ' 00:15:18.798 17:34:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:18.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.798 --rc genhtml_branch_coverage=1 00:15:18.798 --rc genhtml_function_coverage=1 00:15:18.798 --rc genhtml_legend=1 00:15:18.798 --rc geninfo_all_blocks=1 00:15:18.798 --rc geninfo_unexecuted_blocks=1 00:15:18.798 00:15:18.798 ' 00:15:18.798 17:34:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:18.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.798 --rc genhtml_branch_coverage=1 00:15:18.798 --rc genhtml_function_coverage=1 00:15:18.798 --rc genhtml_legend=1 00:15:18.798 --rc geninfo_all_blocks=1 00:15:18.798 --rc geninfo_unexecuted_blocks=1 00:15:18.798 00:15:18.798 ' 00:15:18.798 17:34:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:18.798 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:18.798 --rc genhtml_branch_coverage=1 00:15:18.798 --rc genhtml_function_coverage=1 00:15:18.798 --rc genhtml_legend=1 00:15:18.798 --rc geninfo_all_blocks=1 00:15:18.798 --rc geninfo_unexecuted_blocks=1 00:15:18.798 00:15:18.798 ' 00:15:18.798 17:34:55 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:18.798 17:34:55 -- nvmf/common.sh@7 -- # uname -s 00:15:18.798 17:34:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:18.798 17:34:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:18.798 17:34:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:18.798 17:34:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:18.798 17:34:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:18.798 17:34:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:18.798 17:34:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:18.798 17:34:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:18.798 17:34:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:18.798 17:34:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:18.798 17:34:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:18.798 17:34:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:18.798 17:34:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:18.798 17:34:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:18.799 17:34:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:18.799 17:34:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:18.799 17:34:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:18.799 17:34:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:18.799 17:34:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:18.799 17:34:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.799 17:34:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.799 17:34:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.799 17:34:55 -- paths/export.sh@5 -- # export PATH 00:15:18.799 17:34:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.799 17:34:55 -- nvmf/common.sh@46 -- # : 0 00:15:18.799 17:34:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:18.799 17:34:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:18.799 17:34:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:18.799 17:34:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:18.799 17:34:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:18.799 17:34:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:18.799 17:34:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:18.799 17:34:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:18.799 17:34:55 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:18.799 17:34:55 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:18.799 17:34:55 -- target/nvme_cli.sh@14 -- # devs=() 00:15:18.799 17:34:55 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:18.799 17:34:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:18.799 17:34:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:18.799 17:34:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:18.799 17:34:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:18.799 17:34:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:18.799 17:34:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:18.799 17:34:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:18.799 17:34:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.799 17:34:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:18.799 17:34:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:18.799 17:34:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:18.799 17:34:55 -- common/autotest_common.sh@10 -- # set +x 00:15:20.704 17:34:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:20.704 17:34:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:20.704 17:34:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:20.704 17:34:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:20.704 17:34:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:20.704 17:34:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:20.704 17:34:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:20.704 17:34:58 -- nvmf/common.sh@294 -- # net_devs=() 00:15:20.704 17:34:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:20.704 17:34:58 -- nvmf/common.sh@295 -- # e810=() 00:15:20.704 17:34:58 -- nvmf/common.sh@295 -- # local -ga e810 00:15:20.704 17:34:58 -- nvmf/common.sh@296 -- # x722=() 00:15:20.704 17:34:58 -- nvmf/common.sh@296 -- # local -ga x722 00:15:20.704 17:34:58 -- nvmf/common.sh@297 -- # mlx=() 00:15:20.704 17:34:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:20.704 17:34:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:20.704 17:34:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:20.704 17:34:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:20.704 17:34:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:20.704 17:34:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:20.704 17:34:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:20.704 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:20.704 17:34:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:20.704 17:34:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:20.704 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:20.704 17:34:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:20.704 17:34:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:20.704 17:34:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:20.704 17:34:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:20.704 17:34:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:20.704 17:34:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:20.704 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:20.704 17:34:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:20.704 17:34:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:20.704 17:34:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:20.704 17:34:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:20.704 17:34:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:20.704 17:34:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:20.704 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:20.704 17:34:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:20.704 17:34:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:20.704 17:34:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:20.704 17:34:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:20.704 17:34:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:20.704 17:34:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:20.704 17:34:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:20.704 17:34:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:20.704 17:34:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:20.704 17:34:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:20.704 17:34:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:20.704 17:34:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:20.704 17:34:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:20.704 17:34:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:20.704 17:34:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:20.705 17:34:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:20.705 17:34:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:20.705 17:34:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:20.705 17:34:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:20.705 17:34:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:20.705 17:34:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:20.705 17:34:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:20.705 17:34:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:20.705 17:34:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:20.705 17:34:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:20.705 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:20.705 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:15:20.705 00:15:20.705 --- 10.0.0.2 ping statistics --- 00:15:20.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:20.705 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:15:20.705 17:34:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:20.705 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:20.705 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:15:20.705 00:15:20.705 --- 10.0.0.1 ping statistics --- 00:15:20.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:20.705 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:15:20.705 17:34:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:20.705 17:34:58 -- nvmf/common.sh@410 -- # return 0 00:15:20.705 17:34:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:20.705 17:34:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:20.705 17:34:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:20.705 17:34:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:20.705 17:34:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:20.705 17:34:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:20.705 17:34:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:20.965 17:34:58 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:20.965 17:34:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:20.965 17:34:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:20.965 17:34:58 -- common/autotest_common.sh@10 -- # set +x 00:15:20.965 17:34:58 -- nvmf/common.sh@469 -- # nvmfpid=1554537 00:15:20.965 17:34:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:20.965 17:34:58 -- nvmf/common.sh@470 -- # waitforlisten 1554537 00:15:20.965 17:34:58 -- common/autotest_common.sh@829 -- # '[' -z 1554537 ']' 00:15:20.965 17:34:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:20.965 17:34:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:20.965 17:34:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:20.965 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:20.965 17:34:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:20.965 17:34:58 -- common/autotest_common.sh@10 -- # set +x 00:15:20.965 [2024-11-16 17:34:58.253712] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:20.965 [2024-11-16 17:34:58.253785] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:20.965 EAL: No free 2048 kB hugepages reported on node 1 00:15:20.965 [2024-11-16 17:34:58.328623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:20.965 [2024-11-16 17:34:58.423224] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:20.965 [2024-11-16 17:34:58.423393] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:20.965 [2024-11-16 17:34:58.423414] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:20.965 [2024-11-16 17:34:58.423429] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:20.965 [2024-11-16 17:34:58.423488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:20.965 [2024-11-16 17:34:58.423543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:20.965 [2024-11-16 17:34:58.423580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:20.965 [2024-11-16 17:34:58.423583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:21.901 17:34:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:21.901 17:34:59 -- common/autotest_common.sh@862 -- # return 0 00:15:21.901 17:34:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:21.901 17:34:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:21.901 17:34:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:21.901 17:34:59 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:21.901 17:34:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:21.901 [2024-11-16 17:34:59.296478] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:21.901 17:34:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.901 17:34:59 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:21.901 17:34:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:21.901 Malloc0 00:15:21.901 17:34:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.901 17:34:59 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:21.901 17:34:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:21.901 Malloc1 00:15:21.901 17:34:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.901 17:34:59 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:21.901 17:34:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:21.901 17:34:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.901 17:34:59 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:21.901 17:34:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:21.901 17:34:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.901 17:34:59 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:21.901 17:34:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:21.901 17:34:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.901 17:34:59 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:21.901 17:34:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:21.901 [2024-11-16 17:34:59.382297] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:21.901 17:34:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:21.901 17:34:59 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:21.901 17:34:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:21.901 17:34:59 -- common/autotest_common.sh@10 -- # set +x 00:15:22.161 17:34:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.161 17:34:59 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:22.161 00:15:22.161 Discovery Log Number of Records 2, Generation counter 2 00:15:22.161 =====Discovery Log Entry 0====== 00:15:22.161 trtype: tcp 00:15:22.161 adrfam: ipv4 00:15:22.161 subtype: current discovery subsystem 00:15:22.161 treq: not required 00:15:22.161 portid: 0 00:15:22.161 trsvcid: 4420 00:15:22.161 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:22.161 traddr: 10.0.0.2 00:15:22.161 eflags: explicit discovery connections, duplicate discovery information 00:15:22.161 sectype: none 00:15:22.161 =====Discovery Log Entry 1====== 00:15:22.161 trtype: tcp 00:15:22.161 adrfam: ipv4 00:15:22.161 subtype: nvme subsystem 00:15:22.161 treq: not required 00:15:22.161 portid: 0 00:15:22.161 trsvcid: 4420 00:15:22.161 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:22.161 traddr: 10.0.0.2 00:15:22.161 eflags: none 00:15:22.161 sectype: none 00:15:22.161 17:34:59 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:22.161 17:34:59 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:22.161 17:34:59 -- nvmf/common.sh@510 -- # local dev _ 00:15:22.161 17:34:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.161 17:34:59 -- nvmf/common.sh@509 -- # nvme list 00:15:22.161 17:34:59 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:22.161 17:34:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.161 17:34:59 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:22.161 17:34:59 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.161 17:34:59 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:22.161 17:34:59 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:23.099 17:35:00 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:23.099 17:35:00 -- common/autotest_common.sh@1187 -- # local i=0 00:15:23.099 17:35:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:23.099 17:35:00 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:23.099 17:35:00 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:23.099 17:35:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:25.009 17:35:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:25.009 17:35:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:25.009 17:35:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:25.009 17:35:02 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:25.009 17:35:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:25.009 17:35:02 -- common/autotest_common.sh@1197 -- # return 0 00:15:25.009 17:35:02 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:25.009 17:35:02 -- nvmf/common.sh@510 -- # local dev _ 00:15:25.009 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.009 17:35:02 -- nvmf/common.sh@509 -- # nvme list 00:15:25.009 17:35:02 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:25.009 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.009 17:35:02 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:25.009 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.009 17:35:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:25.009 17:35:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:25.009 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.009 17:35:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:25.009 17:35:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:25.009 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.009 17:35:02 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:25.009 /dev/nvme0n2 ]] 00:15:25.009 17:35:02 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:25.009 17:35:02 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:25.009 17:35:02 -- nvmf/common.sh@510 -- # local dev _ 00:15:25.009 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.009 17:35:02 -- nvmf/common.sh@509 -- # nvme list 00:15:25.269 17:35:02 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:25.269 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.269 17:35:02 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:25.269 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.269 17:35:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:25.269 17:35:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:25.269 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.269 17:35:02 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:25.269 17:35:02 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:25.269 17:35:02 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:25.269 17:35:02 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:25.269 17:35:02 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:25.528 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:25.528 17:35:02 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:25.528 17:35:02 -- common/autotest_common.sh@1208 -- # local i=0 00:15:25.528 17:35:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:25.528 17:35:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:25.528 17:35:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:25.528 17:35:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:25.528 17:35:02 -- common/autotest_common.sh@1220 -- # return 0 00:15:25.528 17:35:02 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:25.528 17:35:02 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:25.528 17:35:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.528 17:35:02 -- common/autotest_common.sh@10 -- # set +x 00:15:25.528 17:35:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.528 17:35:02 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:25.528 17:35:02 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:25.528 17:35:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:25.528 17:35:02 -- nvmf/common.sh@116 -- # sync 00:15:25.528 17:35:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:25.528 17:35:02 -- nvmf/common.sh@119 -- # set +e 00:15:25.528 17:35:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:25.528 17:35:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:25.528 rmmod nvme_tcp 00:15:25.528 rmmod nvme_fabrics 00:15:25.528 rmmod nvme_keyring 00:15:25.528 17:35:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:25.528 17:35:02 -- nvmf/common.sh@123 -- # set -e 00:15:25.528 17:35:02 -- nvmf/common.sh@124 -- # return 0 00:15:25.528 17:35:02 -- nvmf/common.sh@477 -- # '[' -n 1554537 ']' 00:15:25.528 17:35:02 -- nvmf/common.sh@478 -- # killprocess 1554537 00:15:25.528 17:35:02 -- common/autotest_common.sh@936 -- # '[' -z 1554537 ']' 00:15:25.528 17:35:02 -- common/autotest_common.sh@940 -- # kill -0 1554537 00:15:25.528 17:35:02 -- common/autotest_common.sh@941 -- # uname 00:15:25.528 17:35:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:25.528 17:35:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1554537 00:15:25.528 17:35:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:25.528 17:35:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:25.528 17:35:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1554537' 00:15:25.528 killing process with pid 1554537 00:15:25.528 17:35:02 -- common/autotest_common.sh@955 -- # kill 1554537 00:15:25.528 17:35:02 -- common/autotest_common.sh@960 -- # wait 1554537 00:15:25.788 17:35:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:25.788 17:35:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:25.788 17:35:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:25.788 17:35:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:25.788 17:35:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:25.788 17:35:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:25.788 17:35:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:25.788 17:35:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:28.328 17:35:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:28.328 00:15:28.328 real 0m9.426s 00:15:28.328 user 0m19.839s 00:15:28.328 sys 0m2.340s 00:15:28.328 17:35:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:28.328 17:35:05 -- common/autotest_common.sh@10 -- # set +x 00:15:28.328 ************************************ 00:15:28.328 END TEST nvmf_nvme_cli 00:15:28.328 ************************************ 00:15:28.328 17:35:05 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:28.328 17:35:05 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:28.328 17:35:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:28.328 17:35:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:28.328 17:35:05 -- common/autotest_common.sh@10 -- # set +x 00:15:28.328 ************************************ 00:15:28.328 START TEST nvmf_vfio_user 00:15:28.328 ************************************ 00:15:28.328 17:35:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:28.328 * Looking for test storage... 00:15:28.328 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:28.328 17:35:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:28.328 17:35:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:28.328 17:35:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:28.328 17:35:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:28.328 17:35:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:28.328 17:35:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:28.328 17:35:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:28.328 17:35:05 -- scripts/common.sh@335 -- # IFS=.-: 00:15:28.328 17:35:05 -- scripts/common.sh@335 -- # read -ra ver1 00:15:28.328 17:35:05 -- scripts/common.sh@336 -- # IFS=.-: 00:15:28.328 17:35:05 -- scripts/common.sh@336 -- # read -ra ver2 00:15:28.328 17:35:05 -- scripts/common.sh@337 -- # local 'op=<' 00:15:28.328 17:35:05 -- scripts/common.sh@339 -- # ver1_l=2 00:15:28.328 17:35:05 -- scripts/common.sh@340 -- # ver2_l=1 00:15:28.328 17:35:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:28.328 17:35:05 -- scripts/common.sh@343 -- # case "$op" in 00:15:28.328 17:35:05 -- scripts/common.sh@344 -- # : 1 00:15:28.328 17:35:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:28.328 17:35:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:28.328 17:35:05 -- scripts/common.sh@364 -- # decimal 1 00:15:28.328 17:35:05 -- scripts/common.sh@352 -- # local d=1 00:15:28.328 17:35:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:28.328 17:35:05 -- scripts/common.sh@354 -- # echo 1 00:15:28.328 17:35:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:28.328 17:35:05 -- scripts/common.sh@365 -- # decimal 2 00:15:28.328 17:35:05 -- scripts/common.sh@352 -- # local d=2 00:15:28.328 17:35:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:28.328 17:35:05 -- scripts/common.sh@354 -- # echo 2 00:15:28.328 17:35:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:28.328 17:35:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:28.328 17:35:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:28.328 17:35:05 -- scripts/common.sh@367 -- # return 0 00:15:28.328 17:35:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:28.328 17:35:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:28.328 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.328 --rc genhtml_branch_coverage=1 00:15:28.328 --rc genhtml_function_coverage=1 00:15:28.328 --rc genhtml_legend=1 00:15:28.328 --rc geninfo_all_blocks=1 00:15:28.328 --rc geninfo_unexecuted_blocks=1 00:15:28.328 00:15:28.328 ' 00:15:28.328 17:35:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:28.328 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.328 --rc genhtml_branch_coverage=1 00:15:28.328 --rc genhtml_function_coverage=1 00:15:28.328 --rc genhtml_legend=1 00:15:28.328 --rc geninfo_all_blocks=1 00:15:28.328 --rc geninfo_unexecuted_blocks=1 00:15:28.328 00:15:28.328 ' 00:15:28.328 17:35:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:28.328 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.328 --rc genhtml_branch_coverage=1 00:15:28.328 --rc genhtml_function_coverage=1 00:15:28.328 --rc genhtml_legend=1 00:15:28.328 --rc geninfo_all_blocks=1 00:15:28.328 --rc geninfo_unexecuted_blocks=1 00:15:28.328 00:15:28.328 ' 00:15:28.328 17:35:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:28.328 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.328 --rc genhtml_branch_coverage=1 00:15:28.328 --rc genhtml_function_coverage=1 00:15:28.328 --rc genhtml_legend=1 00:15:28.328 --rc geninfo_all_blocks=1 00:15:28.328 --rc geninfo_unexecuted_blocks=1 00:15:28.328 00:15:28.328 ' 00:15:28.328 17:35:05 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:28.328 17:35:05 -- nvmf/common.sh@7 -- # uname -s 00:15:28.328 17:35:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:28.328 17:35:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:28.328 17:35:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:28.328 17:35:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:28.328 17:35:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:28.328 17:35:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:28.328 17:35:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:28.328 17:35:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:28.328 17:35:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:28.328 17:35:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:28.328 17:35:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:28.328 17:35:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:28.328 17:35:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:28.328 17:35:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:28.329 17:35:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:28.329 17:35:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:28.329 17:35:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:28.329 17:35:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:28.329 17:35:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:28.329 17:35:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.329 17:35:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.329 17:35:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.329 17:35:05 -- paths/export.sh@5 -- # export PATH 00:15:28.329 17:35:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.329 17:35:05 -- nvmf/common.sh@46 -- # : 0 00:15:28.329 17:35:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:28.329 17:35:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:28.329 17:35:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:28.329 17:35:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:28.329 17:35:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:28.329 17:35:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:28.329 17:35:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:28.329 17:35:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1555508 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1555508' 00:15:28.329 Process pid: 1555508 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:28.329 17:35:05 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1555508 00:15:28.329 17:35:05 -- common/autotest_common.sh@829 -- # '[' -z 1555508 ']' 00:15:28.329 17:35:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:28.329 17:35:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:28.329 17:35:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:28.329 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:28.329 17:35:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:28.329 17:35:05 -- common/autotest_common.sh@10 -- # set +x 00:15:28.329 [2024-11-16 17:35:05.479975] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:28.329 [2024-11-16 17:35:05.480062] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:28.329 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.329 [2024-11-16 17:35:05.544598] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:28.329 [2024-11-16 17:35:05.637232] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:28.329 [2024-11-16 17:35:05.637387] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:28.329 [2024-11-16 17:35:05.637404] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:28.329 [2024-11-16 17:35:05.637416] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:28.329 [2024-11-16 17:35:05.637467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:28.329 [2024-11-16 17:35:05.637497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:28.329 [2024-11-16 17:35:05.637554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:28.329 [2024-11-16 17:35:05.637557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:29.266 17:35:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:29.266 17:35:06 -- common/autotest_common.sh@862 -- # return 0 00:15:29.266 17:35:06 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:30.201 17:35:07 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:30.459 17:35:07 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:30.459 17:35:07 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:30.459 17:35:07 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:30.459 17:35:07 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:30.459 17:35:07 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:30.717 Malloc1 00:15:30.717 17:35:07 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:30.974 17:35:08 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:31.233 17:35:08 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:31.491 17:35:08 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:31.491 17:35:08 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:31.491 17:35:08 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:31.752 Malloc2 00:15:31.752 17:35:09 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:32.010 17:35:09 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:32.269 17:35:09 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:32.530 17:35:09 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:32.530 17:35:09 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:32.530 17:35:09 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:32.530 17:35:09 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:32.530 17:35:09 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:32.530 17:35:09 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:32.530 [2024-11-16 17:35:09.803333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:32.530 [2024-11-16 17:35:09.803375] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1556073 ] 00:15:32.530 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.530 [2024-11-16 17:35:09.835309] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:32.530 [2024-11-16 17:35:09.839756] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:32.530 [2024-11-16 17:35:09.839787] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fe220a97000 00:15:32.530 [2024-11-16 17:35:09.840751] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.530 [2024-11-16 17:35:09.841749] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.530 [2024-11-16 17:35:09.842756] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.530 [2024-11-16 17:35:09.843761] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.530 [2024-11-16 17:35:09.844765] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.530 [2024-11-16 17:35:09.845773] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.530 [2024-11-16 17:35:09.846784] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.530 [2024-11-16 17:35:09.847788] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.530 [2024-11-16 17:35:09.848802] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:32.530 [2024-11-16 17:35:09.848823] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fe21f78f000 00:15:32.530 [2024-11-16 17:35:09.850003] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:32.530 [2024-11-16 17:35:09.866301] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:32.530 [2024-11-16 17:35:09.866337] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:32.530 [2024-11-16 17:35:09.870952] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:32.530 [2024-11-16 17:35:09.871001] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:32.530 [2024-11-16 17:35:09.871092] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:32.530 [2024-11-16 17:35:09.871123] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:32.530 [2024-11-16 17:35:09.871134] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:32.530 [2024-11-16 17:35:09.871951] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:32.530 [2024-11-16 17:35:09.871971] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:32.530 [2024-11-16 17:35:09.871983] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:32.530 [2024-11-16 17:35:09.872952] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:32.531 [2024-11-16 17:35:09.872969] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:32.531 [2024-11-16 17:35:09.872991] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:32.531 [2024-11-16 17:35:09.873950] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:32.531 [2024-11-16 17:35:09.873968] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:32.531 [2024-11-16 17:35:09.874954] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:32.531 [2024-11-16 17:35:09.874972] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:32.531 [2024-11-16 17:35:09.874981] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:32.531 [2024-11-16 17:35:09.874992] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:32.531 [2024-11-16 17:35:09.875101] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:32.531 [2024-11-16 17:35:09.875108] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:32.531 [2024-11-16 17:35:09.875116] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:32.531 [2024-11-16 17:35:09.875965] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:32.531 [2024-11-16 17:35:09.876971] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:32.531 [2024-11-16 17:35:09.877977] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:32.531 [2024-11-16 17:35:09.879016] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:32.531 [2024-11-16 17:35:09.879988] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:32.531 [2024-11-16 17:35:09.880005] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:32.531 [2024-11-16 17:35:09.880014] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880037] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:32.531 [2024-11-16 17:35:09.880050] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880071] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.531 [2024-11-16 17:35:09.880080] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.531 [2024-11-16 17:35:09.880098] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.531 [2024-11-16 17:35:09.880148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:32.531 [2024-11-16 17:35:09.880162] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:32.531 [2024-11-16 17:35:09.880173] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:32.531 [2024-11-16 17:35:09.880180] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:32.531 [2024-11-16 17:35:09.880187] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:32.531 [2024-11-16 17:35:09.880194] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:32.531 [2024-11-16 17:35:09.880201] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:32.531 [2024-11-16 17:35:09.880208] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880223] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880238] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:32.531 [2024-11-16 17:35:09.880252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:32.531 [2024-11-16 17:35:09.880272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.531 [2024-11-16 17:35:09.880284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.531 [2024-11-16 17:35:09.880296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.531 [2024-11-16 17:35:09.880307] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.531 [2024-11-16 17:35:09.880314] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880328] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880342] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:32.531 [2024-11-16 17:35:09.880356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:32.531 [2024-11-16 17:35:09.880366] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:32.531 [2024-11-16 17:35:09.880373] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880383] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880395] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880408] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:32.531 [2024-11-16 17:35:09.880420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:32.531 [2024-11-16 17:35:09.880479] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880491] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880506] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:32.531 [2024-11-16 17:35:09.880515] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:32.531 [2024-11-16 17:35:09.880524] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:32.531 [2024-11-16 17:35:09.880535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:32.531 [2024-11-16 17:35:09.880557] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:32.531 [2024-11-16 17:35:09.880575] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880589] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:32.531 [2024-11-16 17:35:09.880621] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.531 [2024-11-16 17:35:09.880632] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.531 [2024-11-16 17:35:09.880642] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.531 [2024-11-16 17:35:09.880678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.880700] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:32.532 [2024-11-16 17:35:09.880715] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:32.532 [2024-11-16 17:35:09.880728] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.532 [2024-11-16 17:35:09.880736] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.532 [2024-11-16 17:35:09.880746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.532 [2024-11-16 17:35:09.880764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.880778] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:32.532 [2024-11-16 17:35:09.880789] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:32.532 [2024-11-16 17:35:09.880803] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:32.532 [2024-11-16 17:35:09.880814] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:32.532 [2024-11-16 17:35:09.880822] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:32.532 [2024-11-16 17:35:09.880830] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:32.532 [2024-11-16 17:35:09.880838] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:32.532 [2024-11-16 17:35:09.880846] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:32.532 [2024-11-16 17:35:09.880873] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:32.532 [2024-11-16 17:35:09.880895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.880914] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:32.532 [2024-11-16 17:35:09.880942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.880958] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:32.532 [2024-11-16 17:35:09.880970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.880985] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:32.532 [2024-11-16 17:35:09.881011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.881028] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:32.532 [2024-11-16 17:35:09.881036] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:32.532 [2024-11-16 17:35:09.881042] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:32.532 [2024-11-16 17:35:09.881048] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:32.532 [2024-11-16 17:35:09.881057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:32.532 [2024-11-16 17:35:09.881068] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:32.532 [2024-11-16 17:35:09.881075] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:32.532 [2024-11-16 17:35:09.881084] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:32.532 [2024-11-16 17:35:09.881094] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:32.532 [2024-11-16 17:35:09.881101] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.532 [2024-11-16 17:35:09.881110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.532 [2024-11-16 17:35:09.881121] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:32.532 [2024-11-16 17:35:09.881128] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:32.532 [2024-11-16 17:35:09.881137] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:32.532 [2024-11-16 17:35:09.881148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.881168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.881183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:32.532 [2024-11-16 17:35:09.881194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:32.532 ===================================================== 00:15:32.532 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:32.532 ===================================================== 00:15:32.532 Controller Capabilities/Features 00:15:32.532 ================================ 00:15:32.532 Vendor ID: 4e58 00:15:32.532 Subsystem Vendor ID: 4e58 00:15:32.532 Serial Number: SPDK1 00:15:32.532 Model Number: SPDK bdev Controller 00:15:32.532 Firmware Version: 24.01.1 00:15:32.532 Recommended Arb Burst: 6 00:15:32.532 IEEE OUI Identifier: 8d 6b 50 00:15:32.532 Multi-path I/O 00:15:32.532 May have multiple subsystem ports: Yes 00:15:32.532 May have multiple controllers: Yes 00:15:32.532 Associated with SR-IOV VF: No 00:15:32.532 Max Data Transfer Size: 131072 00:15:32.532 Max Number of Namespaces: 32 00:15:32.532 Max Number of I/O Queues: 127 00:15:32.532 NVMe Specification Version (VS): 1.3 00:15:32.532 NVMe Specification Version (Identify): 1.3 00:15:32.532 Maximum Queue Entries: 256 00:15:32.532 Contiguous Queues Required: Yes 00:15:32.532 Arbitration Mechanisms Supported 00:15:32.532 Weighted Round Robin: Not Supported 00:15:32.532 Vendor Specific: Not Supported 00:15:32.532 Reset Timeout: 15000 ms 00:15:32.532 Doorbell Stride: 4 bytes 00:15:32.532 NVM Subsystem Reset: Not Supported 00:15:32.532 Command Sets Supported 00:15:32.532 NVM Command Set: Supported 00:15:32.532 Boot Partition: Not Supported 00:15:32.532 Memory Page Size Minimum: 4096 bytes 00:15:32.532 Memory Page Size Maximum: 4096 bytes 00:15:32.532 Persistent Memory Region: Not Supported 00:15:32.532 Optional Asynchronous Events Supported 00:15:32.532 Namespace Attribute Notices: Supported 00:15:32.532 Firmware Activation Notices: Not Supported 00:15:32.532 ANA Change Notices: Not Supported 00:15:32.532 PLE Aggregate Log Change Notices: Not Supported 00:15:32.532 LBA Status Info Alert Notices: Not Supported 00:15:32.532 EGE Aggregate Log Change Notices: Not Supported 00:15:32.532 Normal NVM Subsystem Shutdown event: Not Supported 00:15:32.532 Zone Descriptor Change Notices: Not Supported 00:15:32.532 Discovery Log Change Notices: Not Supported 00:15:32.532 Controller Attributes 00:15:32.532 128-bit Host Identifier: Supported 00:15:32.532 Non-Operational Permissive Mode: Not Supported 00:15:32.532 NVM Sets: Not Supported 00:15:32.532 Read Recovery Levels: Not Supported 00:15:32.532 Endurance Groups: Not Supported 00:15:32.532 Predictable Latency Mode: Not Supported 00:15:32.532 Traffic Based Keep ALive: Not Supported 00:15:32.532 Namespace Granularity: Not Supported 00:15:32.532 SQ Associations: Not Supported 00:15:32.532 UUID List: Not Supported 00:15:32.533 Multi-Domain Subsystem: Not Supported 00:15:32.533 Fixed Capacity Management: Not Supported 00:15:32.533 Variable Capacity Management: Not Supported 00:15:32.533 Delete Endurance Group: Not Supported 00:15:32.533 Delete NVM Set: Not Supported 00:15:32.533 Extended LBA Formats Supported: Not Supported 00:15:32.533 Flexible Data Placement Supported: Not Supported 00:15:32.533 00:15:32.533 Controller Memory Buffer Support 00:15:32.533 ================================ 00:15:32.533 Supported: No 00:15:32.533 00:15:32.533 Persistent Memory Region Support 00:15:32.533 ================================ 00:15:32.533 Supported: No 00:15:32.533 00:15:32.533 Admin Command Set Attributes 00:15:32.533 ============================ 00:15:32.533 Security Send/Receive: Not Supported 00:15:32.533 Format NVM: Not Supported 00:15:32.533 Firmware Activate/Download: Not Supported 00:15:32.533 Namespace Management: Not Supported 00:15:32.533 Device Self-Test: Not Supported 00:15:32.533 Directives: Not Supported 00:15:32.533 NVMe-MI: Not Supported 00:15:32.533 Virtualization Management: Not Supported 00:15:32.533 Doorbell Buffer Config: Not Supported 00:15:32.533 Get LBA Status Capability: Not Supported 00:15:32.533 Command & Feature Lockdown Capability: Not Supported 00:15:32.533 Abort Command Limit: 4 00:15:32.533 Async Event Request Limit: 4 00:15:32.533 Number of Firmware Slots: N/A 00:15:32.533 Firmware Slot 1 Read-Only: N/A 00:15:32.533 Firmware Activation Without Reset: N/A 00:15:32.533 Multiple Update Detection Support: N/A 00:15:32.533 Firmware Update Granularity: No Information Provided 00:15:32.533 Per-Namespace SMART Log: No 00:15:32.533 Asymmetric Namespace Access Log Page: Not Supported 00:15:32.533 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:32.533 Command Effects Log Page: Supported 00:15:32.533 Get Log Page Extended Data: Supported 00:15:32.533 Telemetry Log Pages: Not Supported 00:15:32.533 Persistent Event Log Pages: Not Supported 00:15:32.533 Supported Log Pages Log Page: May Support 00:15:32.533 Commands Supported & Effects Log Page: Not Supported 00:15:32.533 Feature Identifiers & Effects Log Page:May Support 00:15:32.533 NVMe-MI Commands & Effects Log Page: May Support 00:15:32.533 Data Area 4 for Telemetry Log: Not Supported 00:15:32.533 Error Log Page Entries Supported: 128 00:15:32.533 Keep Alive: Supported 00:15:32.533 Keep Alive Granularity: 10000 ms 00:15:32.533 00:15:32.533 NVM Command Set Attributes 00:15:32.533 ========================== 00:15:32.533 Submission Queue Entry Size 00:15:32.533 Max: 64 00:15:32.533 Min: 64 00:15:32.533 Completion Queue Entry Size 00:15:32.533 Max: 16 00:15:32.533 Min: 16 00:15:32.533 Number of Namespaces: 32 00:15:32.533 Compare Command: Supported 00:15:32.533 Write Uncorrectable Command: Not Supported 00:15:32.533 Dataset Management Command: Supported 00:15:32.533 Write Zeroes Command: Supported 00:15:32.533 Set Features Save Field: Not Supported 00:15:32.533 Reservations: Not Supported 00:15:32.533 Timestamp: Not Supported 00:15:32.533 Copy: Supported 00:15:32.533 Volatile Write Cache: Present 00:15:32.533 Atomic Write Unit (Normal): 1 00:15:32.533 Atomic Write Unit (PFail): 1 00:15:32.533 Atomic Compare & Write Unit: 1 00:15:32.533 Fused Compare & Write: Supported 00:15:32.533 Scatter-Gather List 00:15:32.533 SGL Command Set: Supported (Dword aligned) 00:15:32.533 SGL Keyed: Not Supported 00:15:32.533 SGL Bit Bucket Descriptor: Not Supported 00:15:32.533 SGL Metadata Pointer: Not Supported 00:15:32.533 Oversized SGL: Not Supported 00:15:32.533 SGL Metadata Address: Not Supported 00:15:32.533 SGL Offset: Not Supported 00:15:32.533 Transport SGL Data Block: Not Supported 00:15:32.533 Replay Protected Memory Block: Not Supported 00:15:32.533 00:15:32.533 Firmware Slot Information 00:15:32.533 ========================= 00:15:32.533 Active slot: 1 00:15:32.533 Slot 1 Firmware Revision: 24.01.1 00:15:32.533 00:15:32.533 00:15:32.533 Commands Supported and Effects 00:15:32.533 ============================== 00:15:32.533 Admin Commands 00:15:32.533 -------------- 00:15:32.533 Get Log Page (02h): Supported 00:15:32.533 Identify (06h): Supported 00:15:32.533 Abort (08h): Supported 00:15:32.533 Set Features (09h): Supported 00:15:32.533 Get Features (0Ah): Supported 00:15:32.533 Asynchronous Event Request (0Ch): Supported 00:15:32.533 Keep Alive (18h): Supported 00:15:32.533 I/O Commands 00:15:32.533 ------------ 00:15:32.533 Flush (00h): Supported LBA-Change 00:15:32.533 Write (01h): Supported LBA-Change 00:15:32.533 Read (02h): Supported 00:15:32.533 Compare (05h): Supported 00:15:32.533 Write Zeroes (08h): Supported LBA-Change 00:15:32.533 Dataset Management (09h): Supported LBA-Change 00:15:32.533 Copy (19h): Supported LBA-Change 00:15:32.533 Unknown (79h): Supported LBA-Change 00:15:32.533 Unknown (7Ah): Supported 00:15:32.533 00:15:32.533 Error Log 00:15:32.533 ========= 00:15:32.533 00:15:32.533 Arbitration 00:15:32.533 =========== 00:15:32.533 Arbitration Burst: 1 00:15:32.533 00:15:32.533 Power Management 00:15:32.533 ================ 00:15:32.533 Number of Power States: 1 00:15:32.533 Current Power State: Power State #0 00:15:32.533 Power State #0: 00:15:32.533 Max Power: 0.00 W 00:15:32.533 Non-Operational State: Operational 00:15:32.533 Entry Latency: Not Reported 00:15:32.533 Exit Latency: Not Reported 00:15:32.533 Relative Read Throughput: 0 00:15:32.533 Relative Read Latency: 0 00:15:32.533 Relative Write Throughput: 0 00:15:32.533 Relative Write Latency: 0 00:15:32.533 Idle Power: Not Reported 00:15:32.533 Active Power: Not Reported 00:15:32.533 Non-Operational Permissive Mode: Not Supported 00:15:32.533 00:15:32.533 Health Information 00:15:32.533 ================== 00:15:32.533 Critical Warnings: 00:15:32.533 Available Spare Space: OK 00:15:32.533 Temperature: OK 00:15:32.533 Device Reliability: OK 00:15:32.533 Read Only: No 00:15:32.533 Volatile Memory Backup: OK 00:15:32.533 Current Temperature: 0 Kelvin[2024-11-16 17:35:09.881326] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:32.533 [2024-11-16 17:35:09.881342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:32.533 [2024-11-16 17:35:09.881383] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:32.533 [2024-11-16 17:35:09.881400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.533 [2024-11-16 17:35:09.881411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.533 [2024-11-16 17:35:09.881420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.534 [2024-11-16 17:35:09.881429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.534 [2024-11-16 17:35:09.885628] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:32.534 [2024-11-16 17:35:09.885650] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:32.534 [2024-11-16 17:35:09.886075] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:32.534 [2024-11-16 17:35:09.886087] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:32.534 [2024-11-16 17:35:09.887042] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:32.534 [2024-11-16 17:35:09.887064] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:32.534 [2024-11-16 17:35:09.887116] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:32.534 [2024-11-16 17:35:09.889083] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:32.534 (-273 Celsius) 00:15:32.534 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:32.534 Available Spare: 0% 00:15:32.534 Available Spare Threshold: 0% 00:15:32.534 Life Percentage Used: 0% 00:15:32.534 Data Units Read: 0 00:15:32.534 Data Units Written: 0 00:15:32.534 Host Read Commands: 0 00:15:32.534 Host Write Commands: 0 00:15:32.534 Controller Busy Time: 0 minutes 00:15:32.534 Power Cycles: 0 00:15:32.534 Power On Hours: 0 hours 00:15:32.534 Unsafe Shutdowns: 0 00:15:32.534 Unrecoverable Media Errors: 0 00:15:32.534 Lifetime Error Log Entries: 0 00:15:32.534 Warning Temperature Time: 0 minutes 00:15:32.534 Critical Temperature Time: 0 minutes 00:15:32.534 00:15:32.534 Number of Queues 00:15:32.534 ================ 00:15:32.534 Number of I/O Submission Queues: 127 00:15:32.534 Number of I/O Completion Queues: 127 00:15:32.534 00:15:32.534 Active Namespaces 00:15:32.534 ================= 00:15:32.534 Namespace ID:1 00:15:32.534 Error Recovery Timeout: Unlimited 00:15:32.534 Command Set Identifier: NVM (00h) 00:15:32.534 Deallocate: Supported 00:15:32.534 Deallocated/Unwritten Error: Not Supported 00:15:32.534 Deallocated Read Value: Unknown 00:15:32.534 Deallocate in Write Zeroes: Not Supported 00:15:32.534 Deallocated Guard Field: 0xFFFF 00:15:32.534 Flush: Supported 00:15:32.534 Reservation: Supported 00:15:32.534 Namespace Sharing Capabilities: Multiple Controllers 00:15:32.534 Size (in LBAs): 131072 (0GiB) 00:15:32.534 Capacity (in LBAs): 131072 (0GiB) 00:15:32.534 Utilization (in LBAs): 131072 (0GiB) 00:15:32.534 NGUID: E471CE7E6EE04FA3B81E848B5ACAE676 00:15:32.534 UUID: e471ce7e-6ee0-4fa3-b81e-848b5acae676 00:15:32.534 Thin Provisioning: Not Supported 00:15:32.534 Per-NS Atomic Units: Yes 00:15:32.534 Atomic Boundary Size (Normal): 0 00:15:32.534 Atomic Boundary Size (PFail): 0 00:15:32.534 Atomic Boundary Offset: 0 00:15:32.534 Maximum Single Source Range Length: 65535 00:15:32.534 Maximum Copy Length: 65535 00:15:32.534 Maximum Source Range Count: 1 00:15:32.534 NGUID/EUI64 Never Reused: No 00:15:32.534 Namespace Write Protected: No 00:15:32.534 Number of LBA Formats: 1 00:15:32.534 Current LBA Format: LBA Format #00 00:15:32.534 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:32.534 00:15:32.534 17:35:09 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:32.534 EAL: No free 2048 kB hugepages reported on node 1 00:15:37.799 Initializing NVMe Controllers 00:15:37.799 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:37.799 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:37.799 Initialization complete. Launching workers. 00:15:37.799 ======================================================== 00:15:37.799 Latency(us) 00:15:37.799 Device Information : IOPS MiB/s Average min max 00:15:37.799 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 36454.56 142.40 3512.64 1149.48 9778.18 00:15:37.799 ======================================================== 00:15:37.799 Total : 36454.56 142.40 3512.64 1149.48 9778.18 00:15:37.799 00:15:37.800 17:35:15 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:37.800 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.153 Initializing NVMe Controllers 00:15:43.153 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:43.153 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:43.153 Initialization complete. Launching workers. 00:15:43.153 ======================================================== 00:15:43.153 Latency(us) 00:15:43.153 Device Information : IOPS MiB/s Average min max 00:15:43.153 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16051.20 62.70 7982.66 4966.66 11973.00 00:15:43.153 ======================================================== 00:15:43.153 Total : 16051.20 62.70 7982.66 4966.66 11973.00 00:15:43.153 00:15:43.153 17:35:20 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:43.153 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.416 Initializing NVMe Controllers 00:15:48.416 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:48.416 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:48.416 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:48.416 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:48.416 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:48.416 Initialization complete. Launching workers. 00:15:48.416 Starting thread on core 2 00:15:48.416 Starting thread on core 3 00:15:48.416 Starting thread on core 1 00:15:48.416 17:35:25 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:48.416 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.700 Initializing NVMe Controllers 00:15:51.700 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.700 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.700 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:51.700 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:51.700 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:51.700 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:51.700 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:51.700 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:51.700 Initialization complete. Launching workers. 00:15:51.700 Starting thread on core 1 with urgent priority queue 00:15:51.700 Starting thread on core 2 with urgent priority queue 00:15:51.700 Starting thread on core 3 with urgent priority queue 00:15:51.700 Starting thread on core 0 with urgent priority queue 00:15:51.700 SPDK bdev Controller (SPDK1 ) core 0: 5905.33 IO/s 16.93 secs/100000 ios 00:15:51.700 SPDK bdev Controller (SPDK1 ) core 1: 6111.33 IO/s 16.36 secs/100000 ios 00:15:51.700 SPDK bdev Controller (SPDK1 ) core 2: 6278.00 IO/s 15.93 secs/100000 ios 00:15:51.700 SPDK bdev Controller (SPDK1 ) core 3: 5338.67 IO/s 18.73 secs/100000 ios 00:15:51.700 ======================================================== 00:15:51.700 00:15:51.700 17:35:29 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:51.700 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.958 Initializing NVMe Controllers 00:15:51.958 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.958 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.958 Namespace ID: 1 size: 0GB 00:15:51.958 Initialization complete. 00:15:51.958 INFO: using host memory buffer for IO 00:15:51.958 Hello world! 00:15:52.215 17:35:29 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:52.215 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.596 Initializing NVMe Controllers 00:15:53.597 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.597 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.597 Initialization complete. Launching workers. 00:15:53.597 submit (in ns) avg, min, max = 8451.3, 3442.2, 4021558.9 00:15:53.597 complete (in ns) avg, min, max = 26817.9, 2032.2, 4018776.7 00:15:53.597 00:15:53.597 Submit histogram 00:15:53.597 ================ 00:15:53.597 Range in us Cumulative Count 00:15:53.597 3.437 - 3.461: 0.1409% ( 19) 00:15:53.597 3.461 - 3.484: 0.7045% ( 76) 00:15:53.597 3.484 - 3.508: 2.4473% ( 235) 00:15:53.597 3.508 - 3.532: 5.9700% ( 475) 00:15:53.597 3.532 - 3.556: 12.0884% ( 825) 00:15:53.597 3.556 - 3.579: 19.5788% ( 1010) 00:15:53.597 3.579 - 3.603: 26.2311% ( 897) 00:15:53.597 3.603 - 3.627: 33.0540% ( 920) 00:15:53.597 3.627 - 3.650: 40.0030% ( 937) 00:15:53.597 3.650 - 3.674: 45.8024% ( 782) 00:15:53.597 3.674 - 3.698: 50.1854% ( 591) 00:15:53.597 3.698 - 3.721: 54.7612% ( 617) 00:15:53.597 3.721 - 3.745: 58.1726% ( 460) 00:15:53.597 3.745 - 3.769: 62.7114% ( 612) 00:15:53.597 3.769 - 3.793: 67.1907% ( 604) 00:15:53.597 3.793 - 3.816: 71.6701% ( 604) 00:15:53.597 3.816 - 3.840: 75.7861% ( 555) 00:15:53.597 3.840 - 3.864: 79.4201% ( 490) 00:15:53.597 3.864 - 3.887: 82.2382% ( 380) 00:15:53.597 3.887 - 3.911: 84.3370% ( 283) 00:15:53.597 3.911 - 3.935: 86.3023% ( 265) 00:15:53.597 3.935 - 3.959: 87.7559% ( 196) 00:15:53.597 3.959 - 3.982: 89.1130% ( 183) 00:15:53.597 3.982 - 4.006: 90.3441% ( 166) 00:15:53.597 4.006 - 4.030: 91.5900% ( 168) 00:15:53.597 4.030 - 4.053: 92.6283% ( 140) 00:15:53.597 4.053 - 4.077: 93.6592% ( 139) 00:15:53.597 4.077 - 4.101: 94.2821% ( 84) 00:15:53.597 4.101 - 4.124: 94.6603% ( 51) 00:15:53.597 4.124 - 4.148: 94.9347% ( 37) 00:15:53.597 4.148 - 4.172: 95.2017% ( 36) 00:15:53.597 4.172 - 4.196: 95.3797% ( 24) 00:15:53.597 4.196 - 4.219: 95.6022% ( 30) 00:15:53.597 4.219 - 4.243: 95.7357% ( 18) 00:15:53.597 4.243 - 4.267: 95.8692% ( 18) 00:15:53.597 4.267 - 4.290: 95.9582% ( 12) 00:15:53.597 4.290 - 4.314: 96.0175% ( 8) 00:15:53.597 4.314 - 4.338: 96.1065% ( 12) 00:15:53.597 4.338 - 4.361: 96.1584% ( 7) 00:15:53.597 4.361 - 4.385: 96.1881% ( 4) 00:15:53.597 4.385 - 4.409: 96.2400% ( 7) 00:15:53.597 4.409 - 4.433: 96.2622% ( 3) 00:15:53.597 4.433 - 4.456: 96.2697% ( 1) 00:15:53.597 4.456 - 4.480: 96.2845% ( 2) 00:15:53.597 4.480 - 4.504: 96.3067% ( 3) 00:15:53.597 4.504 - 4.527: 96.3142% ( 1) 00:15:53.597 4.551 - 4.575: 96.3290% ( 2) 00:15:53.597 4.575 - 4.599: 96.3512% ( 3) 00:15:53.597 4.622 - 4.646: 96.3883% ( 5) 00:15:53.597 4.646 - 4.670: 96.4106% ( 3) 00:15:53.597 4.670 - 4.693: 96.4625% ( 7) 00:15:53.597 4.693 - 4.717: 96.5218% ( 8) 00:15:53.597 4.717 - 4.741: 96.5441% ( 3) 00:15:53.597 4.741 - 4.764: 96.5960% ( 7) 00:15:53.597 4.764 - 4.788: 96.6330% ( 5) 00:15:53.597 4.788 - 4.812: 96.6924% ( 8) 00:15:53.597 4.812 - 4.836: 96.7369% ( 6) 00:15:53.597 4.836 - 4.859: 96.7814% ( 6) 00:15:53.597 4.859 - 4.883: 96.8555% ( 10) 00:15:53.597 4.883 - 4.907: 96.9000% ( 6) 00:15:53.597 4.907 - 4.930: 96.9223% ( 3) 00:15:53.597 4.930 - 4.954: 96.9816% ( 8) 00:15:53.597 4.954 - 4.978: 97.0187% ( 5) 00:15:53.597 4.978 - 5.001: 97.0558% ( 5) 00:15:53.597 5.001 - 5.025: 97.0929% ( 5) 00:15:53.597 5.025 - 5.049: 97.1077% ( 2) 00:15:53.597 5.049 - 5.073: 97.1151% ( 1) 00:15:53.597 5.073 - 5.096: 97.1225% ( 1) 00:15:53.597 5.096 - 5.120: 97.1448% ( 3) 00:15:53.597 5.120 - 5.144: 97.1596% ( 2) 00:15:53.597 5.144 - 5.167: 97.1670% ( 1) 00:15:53.597 5.167 - 5.191: 97.1818% ( 2) 00:15:53.597 5.191 - 5.215: 97.1893% ( 1) 00:15:53.597 5.357 - 5.381: 97.1967% ( 1) 00:15:53.597 5.381 - 5.404: 97.2041% ( 1) 00:15:53.597 5.428 - 5.452: 97.2115% ( 1) 00:15:53.597 5.499 - 5.523: 97.2189% ( 1) 00:15:53.597 5.523 - 5.547: 97.2263% ( 1) 00:15:53.597 5.547 - 5.570: 97.2338% ( 1) 00:15:53.597 5.594 - 5.618: 97.2412% ( 1) 00:15:53.597 5.618 - 5.641: 97.2486% ( 1) 00:15:53.597 5.641 - 5.665: 97.2560% ( 1) 00:15:53.597 5.689 - 5.713: 97.2708% ( 2) 00:15:53.597 5.760 - 5.784: 97.2783% ( 1) 00:15:53.597 5.831 - 5.855: 97.2857% ( 1) 00:15:53.597 5.855 - 5.879: 97.2931% ( 1) 00:15:53.597 5.926 - 5.950: 97.3079% ( 2) 00:15:53.597 6.068 - 6.116: 97.3153% ( 1) 00:15:53.597 6.116 - 6.163: 97.3228% ( 1) 00:15:53.597 6.163 - 6.210: 97.3450% ( 3) 00:15:53.597 6.210 - 6.258: 97.3524% ( 1) 00:15:53.597 6.305 - 6.353: 97.3598% ( 1) 00:15:53.597 6.447 - 6.495: 97.3969% ( 5) 00:15:53.597 6.590 - 6.637: 97.4192% ( 3) 00:15:53.597 6.637 - 6.684: 97.4266% ( 1) 00:15:53.597 6.684 - 6.732: 97.4414% ( 2) 00:15:53.597 6.732 - 6.779: 97.4562% ( 2) 00:15:53.597 6.779 - 6.827: 97.4637% ( 1) 00:15:53.597 6.827 - 6.874: 97.4859% ( 3) 00:15:53.597 6.874 - 6.921: 97.5007% ( 2) 00:15:53.597 6.921 - 6.969: 97.5230% ( 3) 00:15:53.597 7.064 - 7.111: 97.5452% ( 3) 00:15:53.597 7.111 - 7.159: 97.5527% ( 1) 00:15:53.597 7.159 - 7.206: 97.5601% ( 1) 00:15:53.597 7.301 - 7.348: 97.5749% ( 2) 00:15:53.597 7.348 - 7.396: 97.5972% ( 3) 00:15:53.597 7.396 - 7.443: 97.6120% ( 2) 00:15:53.597 7.443 - 7.490: 97.6194% ( 1) 00:15:53.597 7.490 - 7.538: 97.6268% ( 1) 00:15:53.597 7.585 - 7.633: 97.6639% ( 5) 00:15:53.597 7.633 - 7.680: 97.6713% ( 1) 00:15:53.597 7.680 - 7.727: 97.6861% ( 2) 00:15:53.597 7.727 - 7.775: 97.7010% ( 2) 00:15:53.597 7.775 - 7.822: 97.7084% ( 1) 00:15:53.597 7.822 - 7.870: 97.7158% ( 1) 00:15:53.597 7.870 - 7.917: 97.7232% ( 1) 00:15:53.597 7.917 - 7.964: 97.7306% ( 1) 00:15:53.597 8.012 - 8.059: 97.7381% ( 1) 00:15:53.597 8.107 - 8.154: 97.7529% ( 2) 00:15:53.597 8.154 - 8.201: 97.7826% ( 4) 00:15:53.597 8.249 - 8.296: 97.8048% ( 3) 00:15:53.597 8.296 - 8.344: 97.8122% ( 1) 00:15:53.597 8.344 - 8.391: 97.8196% ( 1) 00:15:53.597 8.391 - 8.439: 97.8271% ( 1) 00:15:53.597 8.439 - 8.486: 97.8345% ( 1) 00:15:53.597 8.486 - 8.533: 97.8419% ( 1) 00:15:53.597 8.533 - 8.581: 97.8493% ( 1) 00:15:53.597 8.581 - 8.628: 97.8567% ( 1) 00:15:53.597 8.676 - 8.723: 97.8641% ( 1) 00:15:53.597 8.723 - 8.770: 97.8716% ( 1) 00:15:53.597 8.770 - 8.818: 97.9012% ( 4) 00:15:53.597 8.818 - 8.865: 97.9086% ( 1) 00:15:53.597 8.865 - 8.913: 97.9309% ( 3) 00:15:53.597 8.960 - 9.007: 97.9457% ( 2) 00:15:53.597 9.055 - 9.102: 97.9605% ( 2) 00:15:53.597 9.102 - 9.150: 97.9754% ( 2) 00:15:53.597 9.150 - 9.197: 97.9828% ( 1) 00:15:53.597 9.197 - 9.244: 97.9902% ( 1) 00:15:53.597 9.244 - 9.292: 97.9976% ( 1) 00:15:53.597 9.292 - 9.339: 98.0125% ( 2) 00:15:53.598 9.339 - 9.387: 98.0199% ( 1) 00:15:53.598 9.387 - 9.434: 98.0347% ( 2) 00:15:53.598 9.434 - 9.481: 98.0570% ( 3) 00:15:53.598 9.529 - 9.576: 98.0644% ( 1) 00:15:53.598 9.576 - 9.624: 98.0940% ( 4) 00:15:53.598 9.624 - 9.671: 98.1015% ( 1) 00:15:53.598 9.719 - 9.766: 98.1163% ( 2) 00:15:53.598 9.766 - 9.813: 98.1237% ( 1) 00:15:53.598 9.861 - 9.908: 98.1385% ( 2) 00:15:53.598 10.003 - 10.050: 98.1460% ( 1) 00:15:53.598 10.050 - 10.098: 98.1682% ( 3) 00:15:53.598 10.098 - 10.145: 98.1904% ( 3) 00:15:53.598 10.145 - 10.193: 98.1979% ( 1) 00:15:53.598 10.193 - 10.240: 98.2053% ( 1) 00:15:53.598 10.240 - 10.287: 98.2127% ( 1) 00:15:53.598 10.335 - 10.382: 98.2275% ( 2) 00:15:53.598 10.382 - 10.430: 98.2349% ( 1) 00:15:53.598 10.430 - 10.477: 98.2424% ( 1) 00:15:53.598 10.477 - 10.524: 98.2646% ( 3) 00:15:53.598 10.524 - 10.572: 98.2869% ( 3) 00:15:53.598 10.619 - 10.667: 98.2943% ( 1) 00:15:53.598 10.667 - 10.714: 98.3017% ( 1) 00:15:53.598 10.714 - 10.761: 98.3091% ( 1) 00:15:53.598 10.809 - 10.856: 98.3314% ( 3) 00:15:53.598 10.856 - 10.904: 98.3388% ( 1) 00:15:53.598 10.904 - 10.951: 98.3536% ( 2) 00:15:53.598 10.951 - 10.999: 98.3610% ( 1) 00:15:53.598 11.188 - 11.236: 98.3684% ( 1) 00:15:53.598 11.236 - 11.283: 98.3759% ( 1) 00:15:53.598 11.378 - 11.425: 98.3907% ( 2) 00:15:53.598 11.425 - 11.473: 98.3981% ( 1) 00:15:53.598 11.520 - 11.567: 98.4055% ( 1) 00:15:53.598 11.567 - 11.615: 98.4129% ( 1) 00:15:53.598 11.662 - 11.710: 98.4204% ( 1) 00:15:53.598 11.852 - 11.899: 98.4352% ( 2) 00:15:53.598 11.994 - 12.041: 98.4426% ( 1) 00:15:53.598 12.041 - 12.089: 98.4500% ( 1) 00:15:53.598 12.089 - 12.136: 98.4574% ( 1) 00:15:53.598 12.136 - 12.231: 98.4648% ( 1) 00:15:53.598 12.231 - 12.326: 98.4723% ( 1) 00:15:53.598 12.326 - 12.421: 98.4871% ( 2) 00:15:53.598 12.421 - 12.516: 98.5019% ( 2) 00:15:53.598 12.516 - 12.610: 98.5168% ( 2) 00:15:53.598 12.610 - 12.705: 98.5242% ( 1) 00:15:53.598 12.895 - 12.990: 98.5390% ( 2) 00:15:53.598 12.990 - 13.084: 98.5538% ( 2) 00:15:53.598 13.084 - 13.179: 98.5613% ( 1) 00:15:53.598 13.179 - 13.274: 98.5761% ( 2) 00:15:53.598 13.274 - 13.369: 98.5909% ( 2) 00:15:53.598 13.369 - 13.464: 98.6058% ( 2) 00:15:53.598 13.464 - 13.559: 98.6280% ( 3) 00:15:53.598 13.559 - 13.653: 98.6354% ( 1) 00:15:53.598 13.653 - 13.748: 98.6428% ( 1) 00:15:53.598 13.843 - 13.938: 98.6651% ( 3) 00:15:53.598 13.938 - 14.033: 98.6873% ( 3) 00:15:53.598 14.127 - 14.222: 98.6947% ( 1) 00:15:53.598 14.412 - 14.507: 98.7170% ( 3) 00:15:53.598 14.507 - 14.601: 98.7318% ( 2) 00:15:53.598 14.601 - 14.696: 98.7392% ( 1) 00:15:53.598 14.791 - 14.886: 98.7541% ( 2) 00:15:53.598 14.886 - 14.981: 98.7615% ( 1) 00:15:53.598 14.981 - 15.076: 98.7689% ( 1) 00:15:53.598 15.265 - 15.360: 98.7763% ( 1) 00:15:53.598 15.550 - 15.644: 98.7837% ( 1) 00:15:53.598 16.877 - 16.972: 98.7912% ( 1) 00:15:53.598 17.256 - 17.351: 98.8060% ( 2) 00:15:53.598 17.351 - 17.446: 98.8653% ( 8) 00:15:53.598 17.446 - 17.541: 98.9024% ( 5) 00:15:53.598 17.541 - 17.636: 98.9321% ( 4) 00:15:53.598 17.636 - 17.730: 98.9988% ( 9) 00:15:53.598 17.730 - 17.825: 99.0136% ( 2) 00:15:53.598 17.825 - 17.920: 99.0952% ( 11) 00:15:53.598 17.920 - 18.015: 99.1397% ( 6) 00:15:53.598 18.015 - 18.110: 99.1916% ( 7) 00:15:53.598 18.110 - 18.204: 99.3325% ( 19) 00:15:53.598 18.204 - 18.299: 99.3993% ( 9) 00:15:53.598 18.299 - 18.394: 99.4438% ( 6) 00:15:53.598 18.394 - 18.489: 99.4660% ( 3) 00:15:53.598 18.489 - 18.584: 99.4957% ( 4) 00:15:53.598 18.584 - 18.679: 99.5476% ( 7) 00:15:53.598 18.679 - 18.773: 99.5624% ( 2) 00:15:53.598 18.773 - 18.868: 99.6069% ( 6) 00:15:53.598 18.868 - 18.963: 99.6144% ( 1) 00:15:53.598 18.963 - 19.058: 99.6292% ( 2) 00:15:53.598 19.058 - 19.153: 99.6440% ( 2) 00:15:53.598 19.153 - 19.247: 99.6663% ( 3) 00:15:53.598 19.342 - 19.437: 99.6885% ( 3) 00:15:53.598 19.721 - 19.816: 99.6959% ( 1) 00:15:53.598 20.006 - 20.101: 99.7108% ( 2) 00:15:53.598 20.196 - 20.290: 99.7182% ( 1) 00:15:53.598 20.859 - 20.954: 99.7256% ( 1) 00:15:53.598 21.239 - 21.333: 99.7330% ( 1) 00:15:53.598 21.807 - 21.902: 99.7404% ( 1) 00:15:53.598 22.187 - 22.281: 99.7478% ( 1) 00:15:53.598 22.376 - 22.471: 99.7553% ( 1) 00:15:53.598 22.471 - 22.566: 99.7627% ( 1) 00:15:53.598 22.566 - 22.661: 99.7701% ( 1) 00:15:53.598 22.756 - 22.850: 99.7775% ( 1) 00:15:53.598 23.514 - 23.609: 99.7849% ( 1) 00:15:53.598 23.988 - 24.083: 99.7923% ( 1) 00:15:53.598 24.178 - 24.273: 99.7998% ( 1) 00:15:53.598 24.273 - 24.462: 99.8072% ( 1) 00:15:53.598 24.841 - 25.031: 99.8146% ( 1) 00:15:53.598 25.221 - 25.410: 99.8220% ( 1) 00:15:53.598 27.686 - 27.876: 99.8294% ( 1) 00:15:53.598 28.824 - 29.013: 99.8368% ( 1) 00:15:53.598 29.013 - 29.203: 99.8443% ( 1) 00:15:53.598 29.393 - 29.582: 99.8517% ( 1) 00:15:53.598 29.582 - 29.772: 99.8665% ( 2) 00:15:53.598 30.341 - 30.530: 99.8739% ( 1) 00:15:53.598 33.754 - 33.944: 99.8813% ( 1) 00:15:53.598 35.081 - 35.271: 99.8888% ( 1) 00:15:53.598 3980.705 - 4004.978: 99.9555% ( 9) 00:15:53.598 4004.978 - 4029.250: 100.0000% ( 6) 00:15:53.598 00:15:53.598 Complete histogram 00:15:53.598 ================== 00:15:53.598 Range in us Cumulative Count 00:15:53.598 2.027 - 2.039: 1.2608% ( 170) 00:15:53.598 2.039 - 2.050: 12.8004% ( 1556) 00:15:53.598 2.050 - 2.062: 14.9066% ( 284) 00:15:53.598 2.062 - 2.074: 23.6651% ( 1181) 00:15:53.598 2.074 - 2.086: 45.3130% ( 2919) 00:15:53.598 2.086 - 2.098: 48.2646% ( 398) 00:15:53.598 2.098 - 2.110: 51.4239% ( 426) 00:15:53.598 2.110 - 2.121: 55.0949% ( 495) 00:15:53.598 2.121 - 2.133: 55.9404% ( 114) 00:15:53.598 2.133 - 2.145: 64.8843% ( 1206) 00:15:53.598 2.145 - 2.157: 72.5378% ( 1032) 00:15:53.598 2.157 - 2.169: 73.7244% ( 160) 00:15:53.598 2.169 - 2.181: 76.5796% ( 385) 00:15:53.598 2.181 - 2.193: 79.1160% ( 342) 00:15:53.598 2.193 - 2.204: 80.0208% ( 122) 00:15:53.598 2.204 - 2.216: 86.7695% ( 910) 00:15:53.598 2.216 - 2.228: 91.9312% ( 696) 00:15:53.598 2.228 - 2.240: 92.6654% ( 99) 00:15:53.598 2.240 - 2.252: 93.5924% ( 125) 00:15:53.598 2.252 - 2.264: 93.9706% ( 51) 00:15:53.598 2.264 - 2.276: 94.3340% ( 49) 00:15:53.598 2.276 - 2.287: 95.1053% ( 104) 00:15:53.598 2.287 - 2.299: 95.2907% ( 25) 00:15:53.598 2.299 - 2.311: 95.3426% ( 7) 00:15:53.598 2.311 - 2.323: 95.6986% ( 48) 00:15:53.598 2.323 - 2.335: 95.9582% ( 35) 00:15:53.598 2.335 - 2.347: 96.1436% ( 25) 00:15:53.598 2.347 - 2.359: 96.6627% ( 70) 00:15:53.598 2.359 - 2.370: 97.0335% ( 50) 00:15:53.598 2.370 - 2.382: 97.2857% ( 34) 00:15:53.598 2.382 - 2.394: 97.4340% ( 20) 00:15:53.598 2.394 - 2.406: 97.6268% ( 26) 00:15:53.598 2.406 - 2.418: 97.7381% ( 15) 00:15:53.598 2.418 - 2.430: 97.8493% ( 15) 00:15:53.598 2.430 - 2.441: 97.9828% ( 18) 00:15:53.598 2.441 - 2.453: 98.0570% ( 10) 00:15:53.598 2.453 - 2.465: 98.1311% ( 10) 00:15:53.598 2.465 - 2.477: 98.1830% ( 7) 00:15:53.598 2.477 - 2.489: 98.2424% ( 8) 00:15:53.598 2.489 - 2.501: 98.2720% ( 4) 00:15:53.598 2.501 - 2.513: 98.3314% ( 8) 00:15:53.598 2.513 - 2.524: 98.3536% ( 3) 00:15:53.598 2.524 - 2.536: 98.3610% ( 1) 00:15:53.599 2.631 - 2.643: 98.3833% ( 3) 00:15:53.599 2.655 - 2.667: 98.3981% ( 2) 00:15:53.599 2.667 - 2.679: 98.4055% ( 1) 00:15:53.599 2.690 - 2.702: 98.4129% ( 1) 00:15:53.599 2.738 - 2.750: 98.4204% ( 1) 00:15:53.599 2.761 - 2.773: 98.4278% ( 1) 00:15:53.599 2.821 - 2.833: 98.4352% ( 1) 00:15:53.599 2.868 - 2.880: 98.4426% ( 1) 00:15:53.599 2.951 - 2.963: 98.4500% ( 1) 00:15:53.599 2.975 - 2.987: 98.4574% ( 1) 00:15:53.599 3.058 - 3.081: 98.4648% ( 1) 00:15:53.599 3.105 - 3.129: 98.4723% ( 1) 00:15:53.599 3.224 - 3.247: 98.4797% ( 1) 00:15:53.599 3.271 - 3.295: 98.4871% ( 1) 00:15:53.599 3.342 - 3.366: 98.5093% ( 3) 00:15:53.599 3.366 - 3.390: 98.5168% ( 1) 00:15:53.599 3.390 - 3.413: 98.5242% ( 1) 00:15:53.599 3.413 - 3.437: 98.5316% ( 1) 00:15:53.599 3.437 - 3.461: 98.5464% ( 2) 00:15:53.599 3.461 - 3.484: 98.5613% ( 2) 00:15:53.599 3.484 - 3.508: 98.5761% ( 2) 00:15:53.599 3.532 - 3.556: 98.5835% ( 1) 00:15:53.599 3.556 - 3.579: 98.6132% ( 4) 00:15:53.599 3.579 - 3.603: 98.6206% ( 1) 00:15:53.599 3.603 - 3.627: 98.6280% ( 1) 00:15:53.599 3.627 - 3.650: 98.6354% ( 1) 00:15:53.599 3.816 - 3.840: 98.6428% ( 1) 00:15:53.599 3.887 - 3.911: 98.6503% ( 1) 00:15:53.599 3.935 - 3.959: 98.6577% ( 1) 00:15:53.599 3.982 - 4.006: 98.6651% ( 1) 00:15:53.599 4.053 - 4.077: 98.6725% ( 1) 00:15:53.599 5.333 - 5.357: 98.6799% ( 1) 00:15:53.599 5.523 - 5.547: 98.6873% ( 1) 00:15:53.599 6.258 - 6.305: 98.7022% ( 2) 00:15:53.599 6.542 - 6.590: 98.7096% ( 1) 00:15:53.599 6.637 - 6.684: 98.7170% ( 1) 00:15:53.599 6.874 - 6.921: 98.7318% ( 2) 00:15:53.599 7.016 - 7.064: 98.7392% ( 1) 00:15:53.599 7.111 - 7.159: 98.7541% ( 2) 00:15:53.599 7.301 - 7.348: 98.7615% ( 1) 00:15:53.599 7.396 - 7.443: 98.7689% ( 1) 00:15:53.599 7.822 - 7.870: 98.7763% ( 1) 00:15:53.599 8.154 - 8.201: 98.7912% ( 2) 00:15:53.599 8.439 - 8.486: 98.7986% ( 1) 00:15:53.599 8.676 - 8.723: 98.8060% ( 1) 00:15:53.599 13.748 - 13.843: 98.8134% ( 1) 00:15:53.599 15.360 - 15.455: 98.8208% ( 1) 00:15:53.599 15.644 - 15.739: 98.8357% ( 2) 00:15:53.599 15.739 - 15.834: 98.8727% ( 5) 00:15:53.599 15.834 - 15.929: 98.9024% ( 4) 00:15:53.599 15.929 - 16.024: 98.9395% ( 5) 00:15:53.599 16.024 - 16.119: 98.9617% ( 3) 00:15:53.599 16.119 - 16.213: 98.9914% ( 4) 00:15:53.599 16.213 - 16.308: 99.0136% ( 3) 00:15:53.599 16.403 - 16.498: 99.0285% ( 2) 00:15:53.599 16.498 - 16.593: 99.0730% ( 6) 00:15:53.599 16.593 - 16.687: 99.0804% ( 1) 00:15:53.599 16.687 - 16.782: 99.1175% ( 5) 00:15:53.599 16.782 - 16.877: 99.1397% ( 3) 00:15:53.599 16.877 - 16.972: 99.1768% ( 5) 00:15:53.599 16.972 - 17.067: 99.2287% ( 7) 00:15:53.599 17.067 - 17.161: 99.2732% ( 6) 00:15:53.599 17.161 - 17.256: 99.3029% ( 4) 00:15:53.599 17.256 - 17.351: 99.3103% ( 1) 00:15:53.599 17.351 - 17.446: 99.3325% ( 3) 00:15:53.599 17.541 - 17.636: 99.3400% ( 1) 00:15:53.599 17.730 - 17.825: 99.3548% ( 2) 00:15:53.599 17.825 - 17.920: 99.3696% ( 2) 00:15:53.599 19.816 - 19.911: 99.3845% ( 2) 00:15:53.599 3713.707 - 3737.979: 99.3919% ( 1) 00:15:53.599 3980.705 - 4004.978: 99.9555% ( 76) 00:15:53.599 4004.978 - 4029.250: 100.0000% ( 6) 00:15:53.599 00:15:53.599 17:35:30 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:53.599 17:35:30 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:53.599 17:35:30 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:53.599 17:35:30 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:53.599 17:35:30 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:53.599 [2024-11-16 17:35:31.033386] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:53.599 [ 00:15:53.599 { 00:15:53.599 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:53.599 "subtype": "Discovery", 00:15:53.599 "listen_addresses": [], 00:15:53.599 "allow_any_host": true, 00:15:53.599 "hosts": [] 00:15:53.599 }, 00:15:53.599 { 00:15:53.599 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:53.599 "subtype": "NVMe", 00:15:53.599 "listen_addresses": [ 00:15:53.599 { 00:15:53.599 "transport": "VFIOUSER", 00:15:53.599 "trtype": "VFIOUSER", 00:15:53.599 "adrfam": "IPv4", 00:15:53.599 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:53.599 "trsvcid": "0" 00:15:53.599 } 00:15:53.599 ], 00:15:53.599 "allow_any_host": true, 00:15:53.599 "hosts": [], 00:15:53.599 "serial_number": "SPDK1", 00:15:53.599 "model_number": "SPDK bdev Controller", 00:15:53.599 "max_namespaces": 32, 00:15:53.599 "min_cntlid": 1, 00:15:53.599 "max_cntlid": 65519, 00:15:53.599 "namespaces": [ 00:15:53.599 { 00:15:53.599 "nsid": 1, 00:15:53.599 "bdev_name": "Malloc1", 00:15:53.599 "name": "Malloc1", 00:15:53.599 "nguid": "E471CE7E6EE04FA3B81E848B5ACAE676", 00:15:53.599 "uuid": "e471ce7e-6ee0-4fa3-b81e-848b5acae676" 00:15:53.599 } 00:15:53.599 ] 00:15:53.599 }, 00:15:53.599 { 00:15:53.599 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:53.599 "subtype": "NVMe", 00:15:53.599 "listen_addresses": [ 00:15:53.599 { 00:15:53.599 "transport": "VFIOUSER", 00:15:53.599 "trtype": "VFIOUSER", 00:15:53.599 "adrfam": "IPv4", 00:15:53.599 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:53.599 "trsvcid": "0" 00:15:53.599 } 00:15:53.599 ], 00:15:53.599 "allow_any_host": true, 00:15:53.599 "hosts": [], 00:15:53.599 "serial_number": "SPDK2", 00:15:53.599 "model_number": "SPDK bdev Controller", 00:15:53.599 "max_namespaces": 32, 00:15:53.599 "min_cntlid": 1, 00:15:53.599 "max_cntlid": 65519, 00:15:53.599 "namespaces": [ 00:15:53.599 { 00:15:53.599 "nsid": 1, 00:15:53.599 "bdev_name": "Malloc2", 00:15:53.599 "name": "Malloc2", 00:15:53.599 "nguid": "0F3C86E13C7844CE89662C2DCE878DBF", 00:15:53.599 "uuid": "0f3c86e1-3c78-44ce-8966-2c2dce878dbf" 00:15:53.599 } 00:15:53.599 ] 00:15:53.599 } 00:15:53.599 ] 00:15:53.599 17:35:31 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:53.599 17:35:31 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1558665 00:15:53.599 17:35:31 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:53.599 17:35:31 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:53.599 17:35:31 -- common/autotest_common.sh@1254 -- # local i=0 00:15:53.599 17:35:31 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:53.599 17:35:31 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:53.599 17:35:31 -- common/autotest_common.sh@1265 -- # return 0 00:15:53.599 17:35:31 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:53.599 17:35:31 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:53.858 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.858 Malloc3 00:15:53.858 17:35:31 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:54.117 17:35:31 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:54.376 Asynchronous Event Request test 00:15:54.376 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:54.376 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:54.376 Registering asynchronous event callbacks... 00:15:54.376 Starting namespace attribute notice tests for all controllers... 00:15:54.376 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:54.376 aer_cb - Changed Namespace 00:15:54.376 Cleaning up... 00:15:54.376 [ 00:15:54.376 { 00:15:54.376 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:54.376 "subtype": "Discovery", 00:15:54.376 "listen_addresses": [], 00:15:54.376 "allow_any_host": true, 00:15:54.376 "hosts": [] 00:15:54.376 }, 00:15:54.376 { 00:15:54.376 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:54.376 "subtype": "NVMe", 00:15:54.376 "listen_addresses": [ 00:15:54.376 { 00:15:54.376 "transport": "VFIOUSER", 00:15:54.376 "trtype": "VFIOUSER", 00:15:54.376 "adrfam": "IPv4", 00:15:54.376 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:54.376 "trsvcid": "0" 00:15:54.376 } 00:15:54.376 ], 00:15:54.376 "allow_any_host": true, 00:15:54.376 "hosts": [], 00:15:54.376 "serial_number": "SPDK1", 00:15:54.376 "model_number": "SPDK bdev Controller", 00:15:54.376 "max_namespaces": 32, 00:15:54.376 "min_cntlid": 1, 00:15:54.376 "max_cntlid": 65519, 00:15:54.376 "namespaces": [ 00:15:54.376 { 00:15:54.376 "nsid": 1, 00:15:54.376 "bdev_name": "Malloc1", 00:15:54.376 "name": "Malloc1", 00:15:54.376 "nguid": "E471CE7E6EE04FA3B81E848B5ACAE676", 00:15:54.376 "uuid": "e471ce7e-6ee0-4fa3-b81e-848b5acae676" 00:15:54.376 }, 00:15:54.376 { 00:15:54.376 "nsid": 2, 00:15:54.376 "bdev_name": "Malloc3", 00:15:54.376 "name": "Malloc3", 00:15:54.376 "nguid": "0817D9BDEBE447FCB03835E9A15FE4DA", 00:15:54.376 "uuid": "0817d9bd-ebe4-47fc-b038-35e9a15fe4da" 00:15:54.376 } 00:15:54.376 ] 00:15:54.376 }, 00:15:54.376 { 00:15:54.376 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:54.376 "subtype": "NVMe", 00:15:54.376 "listen_addresses": [ 00:15:54.376 { 00:15:54.376 "transport": "VFIOUSER", 00:15:54.376 "trtype": "VFIOUSER", 00:15:54.376 "adrfam": "IPv4", 00:15:54.376 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:54.376 "trsvcid": "0" 00:15:54.376 } 00:15:54.376 ], 00:15:54.376 "allow_any_host": true, 00:15:54.376 "hosts": [], 00:15:54.376 "serial_number": "SPDK2", 00:15:54.376 "model_number": "SPDK bdev Controller", 00:15:54.376 "max_namespaces": 32, 00:15:54.376 "min_cntlid": 1, 00:15:54.376 "max_cntlid": 65519, 00:15:54.376 "namespaces": [ 00:15:54.376 { 00:15:54.376 "nsid": 1, 00:15:54.376 "bdev_name": "Malloc2", 00:15:54.376 "name": "Malloc2", 00:15:54.376 "nguid": "0F3C86E13C7844CE89662C2DCE878DBF", 00:15:54.376 "uuid": "0f3c86e1-3c78-44ce-8966-2c2dce878dbf" 00:15:54.376 } 00:15:54.376 ] 00:15:54.376 } 00:15:54.376 ] 00:15:54.376 17:35:31 -- target/nvmf_vfio_user.sh@44 -- # wait 1558665 00:15:54.376 17:35:31 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:54.376 17:35:31 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:54.376 17:35:31 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:54.376 17:35:31 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:54.637 [2024-11-16 17:35:31.869318] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:54.637 [2024-11-16 17:35:31.869354] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1558687 ] 00:15:54.637 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.637 [2024-11-16 17:35:31.901583] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:54.637 [2024-11-16 17:35:31.910865] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:54.637 [2024-11-16 17:35:31.910896] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fcdef063000 00:15:54.637 [2024-11-16 17:35:31.911864] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.637 [2024-11-16 17:35:31.912872] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.637 [2024-11-16 17:35:31.913881] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.637 [2024-11-16 17:35:31.914886] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.637 [2024-11-16 17:35:31.915895] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.637 [2024-11-16 17:35:31.916896] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.637 [2024-11-16 17:35:31.917906] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.637 [2024-11-16 17:35:31.918921] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.637 [2024-11-16 17:35:31.919931] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:54.637 [2024-11-16 17:35:31.919954] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fcdedd5b000 00:15:54.637 [2024-11-16 17:35:31.921070] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:54.637 [2024-11-16 17:35:31.935740] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:54.637 [2024-11-16 17:35:31.935775] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:54.637 [2024-11-16 17:35:31.937866] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:54.637 [2024-11-16 17:35:31.937917] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:54.637 [2024-11-16 17:35:31.938013] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:54.637 [2024-11-16 17:35:31.938038] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:54.637 [2024-11-16 17:35:31.938048] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:54.637 [2024-11-16 17:35:31.938875] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:54.637 [2024-11-16 17:35:31.938895] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:54.637 [2024-11-16 17:35:31.938923] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:54.637 [2024-11-16 17:35:31.939880] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:54.637 [2024-11-16 17:35:31.939915] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:54.637 [2024-11-16 17:35:31.939929] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:54.637 [2024-11-16 17:35:31.940885] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:54.637 [2024-11-16 17:35:31.940905] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:54.637 [2024-11-16 17:35:31.941888] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:54.637 [2024-11-16 17:35:31.941908] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:54.637 [2024-11-16 17:35:31.941918] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:54.637 [2024-11-16 17:35:31.941932] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:54.637 [2024-11-16 17:35:31.942041] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:54.637 [2024-11-16 17:35:31.942049] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:54.637 [2024-11-16 17:35:31.942057] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:54.637 [2024-11-16 17:35:31.942896] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:54.637 [2024-11-16 17:35:31.943919] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:54.637 [2024-11-16 17:35:31.944925] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:54.637 [2024-11-16 17:35:31.945956] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:54.637 [2024-11-16 17:35:31.946937] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:54.637 [2024-11-16 17:35:31.946955] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:54.637 [2024-11-16 17:35:31.946964] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:54.637 [2024-11-16 17:35:31.946988] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:54.637 [2024-11-16 17:35:31.947004] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:54.637 [2024-11-16 17:35:31.947022] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.637 [2024-11-16 17:35:31.947032] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.637 [2024-11-16 17:35:31.947048] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.637 [2024-11-16 17:35:31.953632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:54.637 [2024-11-16 17:35:31.953654] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:54.637 [2024-11-16 17:35:31.953663] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:54.637 [2024-11-16 17:35:31.953670] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:54.637 [2024-11-16 17:35:31.953678] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:54.637 [2024-11-16 17:35:31.953686] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:54.637 [2024-11-16 17:35:31.953693] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:54.637 [2024-11-16 17:35:31.953701] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:54.637 [2024-11-16 17:35:31.953718] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:54.637 [2024-11-16 17:35:31.953735] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:54.637 [2024-11-16 17:35:31.962626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:54.637 [2024-11-16 17:35:31.962655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.637 [2024-11-16 17:35:31.962670] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.637 [2024-11-16 17:35:31.962681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.637 [2024-11-16 17:35:31.962693] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.637 [2024-11-16 17:35:31.962702] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:54.637 [2024-11-16 17:35:31.962717] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:54.637 [2024-11-16 17:35:31.962735] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:54.637 [2024-11-16 17:35:31.970628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:31.970646] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:54.638 [2024-11-16 17:35:31.970655] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.970667] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.970681] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.970696] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:31.978642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:31.978713] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.978728] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.978741] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:54.638 [2024-11-16 17:35:31.978750] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:54.638 [2024-11-16 17:35:31.978759] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:31.986645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:31.986673] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:54.638 [2024-11-16 17:35:31.986689] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.986703] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.986716] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.638 [2024-11-16 17:35:31.986724] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.638 [2024-11-16 17:35:31.986735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:31.994644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:31.994674] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.994690] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:31.994704] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.638 [2024-11-16 17:35:31.994713] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.638 [2024-11-16 17:35:31.994723] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:32.002630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:32.002651] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:32.002663] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:32.002678] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:32.002688] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:32.002697] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:32.002706] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:54.638 [2024-11-16 17:35:32.002713] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:54.638 [2024-11-16 17:35:32.002722] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:54.638 [2024-11-16 17:35:32.002746] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:32.010627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:32.010654] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:32.018633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:32.018659] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:32.026635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:32.026660] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:32.034631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:32.034658] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:54.638 [2024-11-16 17:35:32.034683] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:54.638 [2024-11-16 17:35:32.034689] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:54.638 [2024-11-16 17:35:32.034696] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:54.638 [2024-11-16 17:35:32.034706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:54.638 [2024-11-16 17:35:32.034717] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:54.638 [2024-11-16 17:35:32.034726] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:54.638 [2024-11-16 17:35:32.034735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:32.034746] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:54.638 [2024-11-16 17:35:32.034758] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.638 [2024-11-16 17:35:32.034768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:32.034780] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:54.638 [2024-11-16 17:35:32.034788] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:54.638 [2024-11-16 17:35:32.034797] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:54.638 [2024-11-16 17:35:32.042644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:32.042675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:32.042692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:54.638 [2024-11-16 17:35:32.042704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:54.638 ===================================================== 00:15:54.638 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:54.638 ===================================================== 00:15:54.638 Controller Capabilities/Features 00:15:54.638 ================================ 00:15:54.638 Vendor ID: 4e58 00:15:54.638 Subsystem Vendor ID: 4e58 00:15:54.638 Serial Number: SPDK2 00:15:54.638 Model Number: SPDK bdev Controller 00:15:54.638 Firmware Version: 24.01.1 00:15:54.638 Recommended Arb Burst: 6 00:15:54.638 IEEE OUI Identifier: 8d 6b 50 00:15:54.638 Multi-path I/O 00:15:54.638 May have multiple subsystem ports: Yes 00:15:54.638 May have multiple controllers: Yes 00:15:54.638 Associated with SR-IOV VF: No 00:15:54.638 Max Data Transfer Size: 131072 00:15:54.638 Max Number of Namespaces: 32 00:15:54.638 Max Number of I/O Queues: 127 00:15:54.638 NVMe Specification Version (VS): 1.3 00:15:54.638 NVMe Specification Version (Identify): 1.3 00:15:54.638 Maximum Queue Entries: 256 00:15:54.638 Contiguous Queues Required: Yes 00:15:54.638 Arbitration Mechanisms Supported 00:15:54.638 Weighted Round Robin: Not Supported 00:15:54.638 Vendor Specific: Not Supported 00:15:54.638 Reset Timeout: 15000 ms 00:15:54.638 Doorbell Stride: 4 bytes 00:15:54.638 NVM Subsystem Reset: Not Supported 00:15:54.638 Command Sets Supported 00:15:54.638 NVM Command Set: Supported 00:15:54.638 Boot Partition: Not Supported 00:15:54.638 Memory Page Size Minimum: 4096 bytes 00:15:54.639 Memory Page Size Maximum: 4096 bytes 00:15:54.639 Persistent Memory Region: Not Supported 00:15:54.639 Optional Asynchronous Events Supported 00:15:54.639 Namespace Attribute Notices: Supported 00:15:54.639 Firmware Activation Notices: Not Supported 00:15:54.639 ANA Change Notices: Not Supported 00:15:54.639 PLE Aggregate Log Change Notices: Not Supported 00:15:54.639 LBA Status Info Alert Notices: Not Supported 00:15:54.639 EGE Aggregate Log Change Notices: Not Supported 00:15:54.639 Normal NVM Subsystem Shutdown event: Not Supported 00:15:54.639 Zone Descriptor Change Notices: Not Supported 00:15:54.639 Discovery Log Change Notices: Not Supported 00:15:54.639 Controller Attributes 00:15:54.639 128-bit Host Identifier: Supported 00:15:54.639 Non-Operational Permissive Mode: Not Supported 00:15:54.639 NVM Sets: Not Supported 00:15:54.639 Read Recovery Levels: Not Supported 00:15:54.639 Endurance Groups: Not Supported 00:15:54.639 Predictable Latency Mode: Not Supported 00:15:54.639 Traffic Based Keep ALive: Not Supported 00:15:54.639 Namespace Granularity: Not Supported 00:15:54.639 SQ Associations: Not Supported 00:15:54.639 UUID List: Not Supported 00:15:54.639 Multi-Domain Subsystem: Not Supported 00:15:54.639 Fixed Capacity Management: Not Supported 00:15:54.639 Variable Capacity Management: Not Supported 00:15:54.639 Delete Endurance Group: Not Supported 00:15:54.639 Delete NVM Set: Not Supported 00:15:54.639 Extended LBA Formats Supported: Not Supported 00:15:54.639 Flexible Data Placement Supported: Not Supported 00:15:54.639 00:15:54.639 Controller Memory Buffer Support 00:15:54.639 ================================ 00:15:54.639 Supported: No 00:15:54.639 00:15:54.639 Persistent Memory Region Support 00:15:54.639 ================================ 00:15:54.639 Supported: No 00:15:54.639 00:15:54.639 Admin Command Set Attributes 00:15:54.639 ============================ 00:15:54.639 Security Send/Receive: Not Supported 00:15:54.639 Format NVM: Not Supported 00:15:54.639 Firmware Activate/Download: Not Supported 00:15:54.639 Namespace Management: Not Supported 00:15:54.639 Device Self-Test: Not Supported 00:15:54.639 Directives: Not Supported 00:15:54.639 NVMe-MI: Not Supported 00:15:54.639 Virtualization Management: Not Supported 00:15:54.639 Doorbell Buffer Config: Not Supported 00:15:54.639 Get LBA Status Capability: Not Supported 00:15:54.639 Command & Feature Lockdown Capability: Not Supported 00:15:54.639 Abort Command Limit: 4 00:15:54.639 Async Event Request Limit: 4 00:15:54.639 Number of Firmware Slots: N/A 00:15:54.639 Firmware Slot 1 Read-Only: N/A 00:15:54.639 Firmware Activation Without Reset: N/A 00:15:54.639 Multiple Update Detection Support: N/A 00:15:54.639 Firmware Update Granularity: No Information Provided 00:15:54.639 Per-Namespace SMART Log: No 00:15:54.639 Asymmetric Namespace Access Log Page: Not Supported 00:15:54.639 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:54.639 Command Effects Log Page: Supported 00:15:54.639 Get Log Page Extended Data: Supported 00:15:54.639 Telemetry Log Pages: Not Supported 00:15:54.639 Persistent Event Log Pages: Not Supported 00:15:54.639 Supported Log Pages Log Page: May Support 00:15:54.639 Commands Supported & Effects Log Page: Not Supported 00:15:54.639 Feature Identifiers & Effects Log Page:May Support 00:15:54.639 NVMe-MI Commands & Effects Log Page: May Support 00:15:54.639 Data Area 4 for Telemetry Log: Not Supported 00:15:54.639 Error Log Page Entries Supported: 128 00:15:54.639 Keep Alive: Supported 00:15:54.639 Keep Alive Granularity: 10000 ms 00:15:54.639 00:15:54.639 NVM Command Set Attributes 00:15:54.639 ========================== 00:15:54.639 Submission Queue Entry Size 00:15:54.639 Max: 64 00:15:54.639 Min: 64 00:15:54.639 Completion Queue Entry Size 00:15:54.639 Max: 16 00:15:54.639 Min: 16 00:15:54.639 Number of Namespaces: 32 00:15:54.639 Compare Command: Supported 00:15:54.639 Write Uncorrectable Command: Not Supported 00:15:54.639 Dataset Management Command: Supported 00:15:54.639 Write Zeroes Command: Supported 00:15:54.639 Set Features Save Field: Not Supported 00:15:54.639 Reservations: Not Supported 00:15:54.639 Timestamp: Not Supported 00:15:54.639 Copy: Supported 00:15:54.639 Volatile Write Cache: Present 00:15:54.639 Atomic Write Unit (Normal): 1 00:15:54.639 Atomic Write Unit (PFail): 1 00:15:54.639 Atomic Compare & Write Unit: 1 00:15:54.639 Fused Compare & Write: Supported 00:15:54.639 Scatter-Gather List 00:15:54.639 SGL Command Set: Supported (Dword aligned) 00:15:54.639 SGL Keyed: Not Supported 00:15:54.639 SGL Bit Bucket Descriptor: Not Supported 00:15:54.639 SGL Metadata Pointer: Not Supported 00:15:54.639 Oversized SGL: Not Supported 00:15:54.639 SGL Metadata Address: Not Supported 00:15:54.639 SGL Offset: Not Supported 00:15:54.639 Transport SGL Data Block: Not Supported 00:15:54.639 Replay Protected Memory Block: Not Supported 00:15:54.639 00:15:54.639 Firmware Slot Information 00:15:54.639 ========================= 00:15:54.639 Active slot: 1 00:15:54.639 Slot 1 Firmware Revision: 24.01.1 00:15:54.639 00:15:54.639 00:15:54.639 Commands Supported and Effects 00:15:54.639 ============================== 00:15:54.639 Admin Commands 00:15:54.639 -------------- 00:15:54.639 Get Log Page (02h): Supported 00:15:54.639 Identify (06h): Supported 00:15:54.639 Abort (08h): Supported 00:15:54.639 Set Features (09h): Supported 00:15:54.639 Get Features (0Ah): Supported 00:15:54.639 Asynchronous Event Request (0Ch): Supported 00:15:54.639 Keep Alive (18h): Supported 00:15:54.639 I/O Commands 00:15:54.639 ------------ 00:15:54.639 Flush (00h): Supported LBA-Change 00:15:54.639 Write (01h): Supported LBA-Change 00:15:54.639 Read (02h): Supported 00:15:54.639 Compare (05h): Supported 00:15:54.639 Write Zeroes (08h): Supported LBA-Change 00:15:54.639 Dataset Management (09h): Supported LBA-Change 00:15:54.639 Copy (19h): Supported LBA-Change 00:15:54.639 Unknown (79h): Supported LBA-Change 00:15:54.639 Unknown (7Ah): Supported 00:15:54.639 00:15:54.639 Error Log 00:15:54.639 ========= 00:15:54.639 00:15:54.639 Arbitration 00:15:54.640 =========== 00:15:54.640 Arbitration Burst: 1 00:15:54.640 00:15:54.640 Power Management 00:15:54.640 ================ 00:15:54.640 Number of Power States: 1 00:15:54.640 Current Power State: Power State #0 00:15:54.640 Power State #0: 00:15:54.640 Max Power: 0.00 W 00:15:54.640 Non-Operational State: Operational 00:15:54.640 Entry Latency: Not Reported 00:15:54.640 Exit Latency: Not Reported 00:15:54.640 Relative Read Throughput: 0 00:15:54.640 Relative Read Latency: 0 00:15:54.640 Relative Write Throughput: 0 00:15:54.640 Relative Write Latency: 0 00:15:54.640 Idle Power: Not Reported 00:15:54.640 Active Power: Not Reported 00:15:54.640 Non-Operational Permissive Mode: Not Supported 00:15:54.640 00:15:54.640 Health Information 00:15:54.640 ================== 00:15:54.640 Critical Warnings: 00:15:54.640 Available Spare Space: OK 00:15:54.640 Temperature: OK 00:15:54.640 Device Reliability: OK 00:15:54.640 Read Only: No 00:15:54.640 Volatile Memory Backup: OK 00:15:54.640 Current Temperature: 0 Kelvin[2024-11-16 17:35:32.042828] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:54.640 [2024-11-16 17:35:32.050645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:54.640 [2024-11-16 17:35:32.050690] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:54.640 [2024-11-16 17:35:32.050708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.640 [2024-11-16 17:35:32.050720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.640 [2024-11-16 17:35:32.050730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.640 [2024-11-16 17:35:32.050740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.640 [2024-11-16 17:35:32.050824] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:54.640 [2024-11-16 17:35:32.050845] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:54.640 [2024-11-16 17:35:32.051863] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:54.640 [2024-11-16 17:35:32.051879] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:54.640 [2024-11-16 17:35:32.052830] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:54.640 [2024-11-16 17:35:32.052854] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:54.640 [2024-11-16 17:35:32.052905] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:54.640 [2024-11-16 17:35:32.055643] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:54.640 (-273 Celsius) 00:15:54.640 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:54.640 Available Spare: 0% 00:15:54.640 Available Spare Threshold: 0% 00:15:54.640 Life Percentage Used: 0% 00:15:54.640 Data Units Read: 0 00:15:54.640 Data Units Written: 0 00:15:54.640 Host Read Commands: 0 00:15:54.640 Host Write Commands: 0 00:15:54.640 Controller Busy Time: 0 minutes 00:15:54.640 Power Cycles: 0 00:15:54.640 Power On Hours: 0 hours 00:15:54.640 Unsafe Shutdowns: 0 00:15:54.640 Unrecoverable Media Errors: 0 00:15:54.640 Lifetime Error Log Entries: 0 00:15:54.640 Warning Temperature Time: 0 minutes 00:15:54.640 Critical Temperature Time: 0 minutes 00:15:54.640 00:15:54.640 Number of Queues 00:15:54.640 ================ 00:15:54.640 Number of I/O Submission Queues: 127 00:15:54.640 Number of I/O Completion Queues: 127 00:15:54.640 00:15:54.640 Active Namespaces 00:15:54.640 ================= 00:15:54.640 Namespace ID:1 00:15:54.640 Error Recovery Timeout: Unlimited 00:15:54.640 Command Set Identifier: NVM (00h) 00:15:54.640 Deallocate: Supported 00:15:54.640 Deallocated/Unwritten Error: Not Supported 00:15:54.640 Deallocated Read Value: Unknown 00:15:54.640 Deallocate in Write Zeroes: Not Supported 00:15:54.640 Deallocated Guard Field: 0xFFFF 00:15:54.640 Flush: Supported 00:15:54.640 Reservation: Supported 00:15:54.640 Namespace Sharing Capabilities: Multiple Controllers 00:15:54.640 Size (in LBAs): 131072 (0GiB) 00:15:54.640 Capacity (in LBAs): 131072 (0GiB) 00:15:54.640 Utilization (in LBAs): 131072 (0GiB) 00:15:54.640 NGUID: 0F3C86E13C7844CE89662C2DCE878DBF 00:15:54.640 UUID: 0f3c86e1-3c78-44ce-8966-2c2dce878dbf 00:15:54.640 Thin Provisioning: Not Supported 00:15:54.640 Per-NS Atomic Units: Yes 00:15:54.640 Atomic Boundary Size (Normal): 0 00:15:54.640 Atomic Boundary Size (PFail): 0 00:15:54.640 Atomic Boundary Offset: 0 00:15:54.640 Maximum Single Source Range Length: 65535 00:15:54.640 Maximum Copy Length: 65535 00:15:54.640 Maximum Source Range Count: 1 00:15:54.640 NGUID/EUI64 Never Reused: No 00:15:54.640 Namespace Write Protected: No 00:15:54.640 Number of LBA Formats: 1 00:15:54.640 Current LBA Format: LBA Format #00 00:15:54.640 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:54.640 00:15:54.640 17:35:32 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:54.640 EAL: No free 2048 kB hugepages reported on node 1 00:16:01.210 Initializing NVMe Controllers 00:16:01.210 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:01.210 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:01.210 Initialization complete. Launching workers. 00:16:01.210 ======================================================== 00:16:01.210 Latency(us) 00:16:01.210 Device Information : IOPS MiB/s Average min max 00:16:01.210 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37414.78 146.15 3420.59 1139.19 6699.83 00:16:01.210 ======================================================== 00:16:01.210 Total : 37414.78 146.15 3420.59 1139.19 6699.83 00:16:01.210 00:16:01.210 17:35:37 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:16:01.210 EAL: No free 2048 kB hugepages reported on node 1 00:16:05.404 Initializing NVMe Controllers 00:16:05.404 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:05.404 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:05.404 Initialization complete. Launching workers. 00:16:05.404 ======================================================== 00:16:05.404 Latency(us) 00:16:05.404 Device Information : IOPS MiB/s Average min max 00:16:05.404 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36085.61 140.96 3546.38 1150.68 7395.14 00:16:05.404 ======================================================== 00:16:05.404 Total : 36085.61 140.96 3546.38 1150.68 7395.14 00:16:05.404 00:16:05.404 17:35:42 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:05.404 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.682 Initializing NVMe Controllers 00:16:10.682 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:10.682 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:10.682 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:10.682 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:10.682 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:10.682 Initialization complete. Launching workers. 00:16:10.682 Starting thread on core 2 00:16:10.682 Starting thread on core 3 00:16:10.682 Starting thread on core 1 00:16:10.682 17:35:48 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:10.682 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.971 Initializing NVMe Controllers 00:16:13.971 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:13.971 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:13.971 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:13.971 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:13.971 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:13.971 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:13.971 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:13.971 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:13.971 Initialization complete. Launching workers. 00:16:13.971 Starting thread on core 1 with urgent priority queue 00:16:13.971 Starting thread on core 2 with urgent priority queue 00:16:13.971 Starting thread on core 3 with urgent priority queue 00:16:13.971 Starting thread on core 0 with urgent priority queue 00:16:13.971 SPDK bdev Controller (SPDK2 ) core 0: 5013.00 IO/s 19.95 secs/100000 ios 00:16:13.971 SPDK bdev Controller (SPDK2 ) core 1: 5482.00 IO/s 18.24 secs/100000 ios 00:16:13.971 SPDK bdev Controller (SPDK2 ) core 2: 5816.67 IO/s 17.19 secs/100000 ios 00:16:13.971 SPDK bdev Controller (SPDK2 ) core 3: 6494.67 IO/s 15.40 secs/100000 ios 00:16:13.971 ======================================================== 00:16:13.971 00:16:13.971 17:35:51 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:13.971 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.242 Initializing NVMe Controllers 00:16:14.242 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.242 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.242 Namespace ID: 1 size: 0GB 00:16:14.242 Initialization complete. 00:16:14.242 INFO: using host memory buffer for IO 00:16:14.242 Hello world! 00:16:14.242 17:35:51 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:14.504 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.885 Initializing NVMe Controllers 00:16:15.885 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:15.885 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:15.885 Initialization complete. Launching workers. 00:16:15.885 submit (in ns) avg, min, max = 8228.3, 3457.8, 4020394.4 00:16:15.885 complete (in ns) avg, min, max = 24185.8, 2034.4, 4019440.0 00:16:15.885 00:16:15.885 Submit histogram 00:16:15.885 ================ 00:16:15.885 Range in us Cumulative Count 00:16:15.885 3.437 - 3.461: 0.0147% ( 2) 00:16:15.885 3.461 - 3.484: 0.6160% ( 82) 00:16:15.885 3.484 - 3.508: 1.8480% ( 168) 00:16:15.885 3.508 - 3.532: 4.8915% ( 415) 00:16:15.885 3.532 - 3.556: 10.1056% ( 711) 00:16:15.885 3.556 - 3.579: 19.4852% ( 1279) 00:16:15.885 3.579 - 3.603: 29.0408% ( 1303) 00:16:15.885 3.603 - 3.627: 39.7331% ( 1458) 00:16:15.885 3.627 - 3.650: 47.5726% ( 1069) 00:16:15.885 3.650 - 3.674: 53.8868% ( 861) 00:16:15.885 3.674 - 3.698: 58.8956% ( 683) 00:16:15.885 3.698 - 3.721: 63.9410% ( 688) 00:16:15.885 3.721 - 3.745: 67.5858% ( 497) 00:16:15.885 3.745 - 3.769: 71.1866% ( 491) 00:16:15.885 3.769 - 3.793: 73.9953% ( 383) 00:16:15.885 3.793 - 3.816: 77.1707% ( 433) 00:16:15.885 3.816 - 3.840: 80.7055% ( 482) 00:16:15.885 3.840 - 3.864: 84.3502% ( 497) 00:16:15.885 3.864 - 3.887: 86.6970% ( 320) 00:16:15.885 3.887 - 3.911: 88.4790% ( 243) 00:16:15.885 3.911 - 3.935: 90.1291% ( 225) 00:16:15.885 3.935 - 3.959: 91.7278% ( 218) 00:16:15.885 3.959 - 3.982: 92.9891% ( 172) 00:16:15.885 3.982 - 4.006: 94.0158% ( 140) 00:16:15.885 4.006 - 4.030: 94.8445% ( 113) 00:16:15.885 4.030 - 4.053: 95.3652% ( 71) 00:16:15.885 4.053 - 4.077: 95.8419% ( 65) 00:16:15.885 4.077 - 4.101: 96.2819% ( 60) 00:16:15.885 4.101 - 4.124: 96.5019% ( 30) 00:16:15.885 4.124 - 4.148: 96.6192% ( 16) 00:16:15.885 4.148 - 4.172: 96.7439% ( 17) 00:16:15.885 4.172 - 4.196: 96.8246% ( 11) 00:16:15.885 4.196 - 4.219: 96.9273% ( 14) 00:16:15.885 4.219 - 4.243: 97.0739% ( 20) 00:16:15.885 4.243 - 4.267: 97.1473% ( 10) 00:16:15.885 4.267 - 4.290: 97.2279% ( 11) 00:16:15.885 4.290 - 4.314: 97.2793% ( 7) 00:16:15.885 4.314 - 4.338: 97.3379% ( 8) 00:16:15.885 4.338 - 4.361: 97.3746% ( 5) 00:16:15.885 4.361 - 4.385: 97.4113% ( 5) 00:16:15.885 4.385 - 4.409: 97.4553% ( 6) 00:16:15.885 4.409 - 4.433: 97.4993% ( 6) 00:16:15.885 4.433 - 4.456: 97.5213% ( 3) 00:16:15.885 4.456 - 4.480: 97.5726% ( 7) 00:16:15.885 4.480 - 4.504: 97.5946% ( 3) 00:16:15.885 4.504 - 4.527: 97.6166% ( 3) 00:16:15.885 4.551 - 4.575: 97.6386% ( 3) 00:16:15.885 4.575 - 4.599: 97.6533% ( 2) 00:16:15.885 4.599 - 4.622: 97.6753% ( 3) 00:16:15.885 4.622 - 4.646: 97.6899% ( 2) 00:16:15.885 4.646 - 4.670: 97.7193% ( 4) 00:16:15.885 4.670 - 4.693: 97.7486% ( 4) 00:16:15.885 4.693 - 4.717: 97.7779% ( 4) 00:16:15.885 4.717 - 4.741: 97.8146% ( 5) 00:16:15.885 4.741 - 4.764: 97.8439% ( 4) 00:16:15.885 4.764 - 4.788: 97.8806% ( 5) 00:16:15.885 4.788 - 4.812: 97.9246% ( 6) 00:16:15.885 4.812 - 4.836: 97.9759% ( 7) 00:16:15.885 4.836 - 4.859: 98.0639% ( 12) 00:16:15.885 4.859 - 4.883: 98.0859% ( 3) 00:16:15.885 4.883 - 4.907: 98.1373% ( 7) 00:16:15.885 4.907 - 4.930: 98.1666% ( 4) 00:16:15.885 4.930 - 4.954: 98.2106% ( 6) 00:16:15.885 4.954 - 4.978: 98.2693% ( 8) 00:16:15.885 4.978 - 5.001: 98.3353% ( 9) 00:16:15.885 5.001 - 5.025: 98.3573% ( 3) 00:16:15.885 5.025 - 5.049: 98.3940% ( 5) 00:16:15.885 5.049 - 5.073: 98.4160% ( 3) 00:16:15.885 5.073 - 5.096: 98.4673% ( 7) 00:16:15.885 5.120 - 5.144: 98.4746% ( 1) 00:16:15.885 5.144 - 5.167: 98.4966% ( 3) 00:16:15.885 5.167 - 5.191: 98.5333% ( 5) 00:16:15.885 5.191 - 5.215: 98.5553% ( 3) 00:16:15.885 5.215 - 5.239: 98.5626% ( 1) 00:16:15.885 5.239 - 5.262: 98.5773% ( 2) 00:16:15.885 5.262 - 5.286: 98.5920% ( 2) 00:16:15.885 5.286 - 5.310: 98.6066% ( 2) 00:16:15.885 5.333 - 5.357: 98.6140% ( 1) 00:16:15.885 5.357 - 5.381: 98.6286% ( 2) 00:16:15.885 5.381 - 5.404: 98.6506% ( 3) 00:16:15.885 5.428 - 5.452: 98.6580% ( 1) 00:16:15.885 5.452 - 5.476: 98.6653% ( 1) 00:16:15.885 5.570 - 5.594: 98.6726% ( 1) 00:16:15.886 5.594 - 5.618: 98.6800% ( 1) 00:16:15.886 5.618 - 5.641: 98.6873% ( 1) 00:16:15.886 5.641 - 5.665: 98.6946% ( 1) 00:16:15.886 5.784 - 5.807: 98.7020% ( 1) 00:16:15.886 5.855 - 5.879: 98.7093% ( 1) 00:16:15.886 5.902 - 5.926: 98.7166% ( 1) 00:16:15.886 6.021 - 6.044: 98.7240% ( 1) 00:16:15.886 6.044 - 6.068: 98.7313% ( 1) 00:16:15.886 6.068 - 6.116: 98.7460% ( 2) 00:16:15.886 6.163 - 6.210: 98.7533% ( 1) 00:16:15.886 6.210 - 6.258: 98.7606% ( 1) 00:16:15.886 6.495 - 6.542: 98.7753% ( 2) 00:16:15.886 7.016 - 7.064: 98.7900% ( 2) 00:16:15.886 7.206 - 7.253: 98.7973% ( 1) 00:16:15.886 7.253 - 7.301: 98.8193% ( 3) 00:16:15.886 7.490 - 7.538: 98.8266% ( 1) 00:16:15.886 7.727 - 7.775: 98.8560% ( 4) 00:16:15.886 7.870 - 7.917: 98.8633% ( 1) 00:16:15.886 7.964 - 8.012: 98.8706% ( 1) 00:16:15.886 8.012 - 8.059: 98.8926% ( 3) 00:16:15.886 8.107 - 8.154: 98.9000% ( 1) 00:16:15.886 8.154 - 8.201: 98.9073% ( 1) 00:16:15.886 8.249 - 8.296: 98.9293% ( 3) 00:16:15.886 8.486 - 8.533: 98.9366% ( 1) 00:16:15.886 8.628 - 8.676: 98.9440% ( 1) 00:16:15.886 8.865 - 8.913: 98.9513% ( 1) 00:16:15.886 8.913 - 8.960: 98.9586% ( 1) 00:16:15.886 8.960 - 9.007: 98.9660% ( 1) 00:16:15.886 9.007 - 9.055: 98.9806% ( 2) 00:16:15.886 9.150 - 9.197: 98.9880% ( 1) 00:16:15.886 9.244 - 9.292: 98.9953% ( 1) 00:16:15.886 9.339 - 9.387: 99.0026% ( 1) 00:16:15.886 9.529 - 9.576: 99.0173% ( 2) 00:16:15.886 9.576 - 9.624: 99.0246% ( 1) 00:16:15.886 9.813 - 9.861: 99.0320% ( 1) 00:16:15.886 9.861 - 9.908: 99.0393% ( 1) 00:16:15.886 9.908 - 9.956: 99.0466% ( 1) 00:16:15.886 10.003 - 10.050: 99.0540% ( 1) 00:16:15.886 10.287 - 10.335: 99.0613% ( 1) 00:16:15.886 10.809 - 10.856: 99.0686% ( 1) 00:16:15.886 10.856 - 10.904: 99.0760% ( 1) 00:16:15.886 11.283 - 11.330: 99.0833% ( 1) 00:16:15.886 11.994 - 12.041: 99.0906% ( 1) 00:16:15.886 12.326 - 12.421: 99.0980% ( 1) 00:16:15.886 14.696 - 14.791: 99.1053% ( 1) 00:16:15.886 15.360 - 15.455: 99.1126% ( 1) 00:16:15.886 16.972 - 17.067: 99.1273% ( 2) 00:16:15.886 17.067 - 17.161: 99.1420% ( 2) 00:16:15.886 17.161 - 17.256: 99.1566% ( 2) 00:16:15.886 17.256 - 17.351: 99.1933% ( 5) 00:16:15.886 17.351 - 17.446: 99.2153% ( 3) 00:16:15.886 17.446 - 17.541: 99.2226% ( 1) 00:16:15.886 17.541 - 17.636: 99.2813% ( 8) 00:16:15.886 17.636 - 17.730: 99.3253% ( 6) 00:16:15.886 17.730 - 17.825: 99.3767% ( 7) 00:16:15.886 17.825 - 17.920: 99.4573% ( 11) 00:16:15.886 17.920 - 18.015: 99.5087% ( 7) 00:16:15.886 18.015 - 18.110: 99.5600% ( 7) 00:16:15.886 18.110 - 18.204: 99.6260% ( 9) 00:16:15.886 18.204 - 18.299: 99.6847% ( 8) 00:16:15.886 18.299 - 18.394: 99.7433% ( 8) 00:16:15.886 18.394 - 18.489: 99.7873% ( 6) 00:16:15.886 18.489 - 18.584: 99.8240% ( 5) 00:16:15.886 18.584 - 18.679: 99.8460% ( 3) 00:16:15.886 18.773 - 18.868: 99.8607% ( 2) 00:16:15.886 18.963 - 19.058: 99.8753% ( 2) 00:16:15.886 19.058 - 19.153: 99.8827% ( 1) 00:16:15.886 25.790 - 25.979: 99.8900% ( 1) 00:16:15.886 3713.707 - 3737.979: 99.8973% ( 1) 00:16:15.886 3980.705 - 4004.978: 99.9413% ( 6) 00:16:15.886 4004.978 - 4029.250: 100.0000% ( 8) 00:16:15.886 00:16:15.886 Complete histogram 00:16:15.886 ================== 00:16:15.886 Range in us Cumulative Count 00:16:15.886 2.027 - 2.039: 0.2567% ( 35) 00:16:15.886 2.039 - 2.050: 12.0197% ( 1604) 00:16:15.886 2.050 - 2.062: 17.6738% ( 771) 00:16:15.886 2.062 - 2.074: 22.1326% ( 608) 00:16:15.886 2.074 - 2.086: 51.0120% ( 3938) 00:16:15.886 2.086 - 2.098: 60.5456% ( 1300) 00:16:15.886 2.098 - 2.110: 62.9950% ( 334) 00:16:15.886 2.110 - 2.121: 67.8131% ( 657) 00:16:15.886 2.121 - 2.133: 68.6565% ( 115) 00:16:15.886 2.133 - 2.145: 74.0980% ( 742) 00:16:15.886 2.145 - 2.157: 85.7583% ( 1590) 00:16:15.886 2.157 - 2.169: 88.5744% ( 384) 00:16:15.886 2.169 - 2.181: 90.2977% ( 235) 00:16:15.886 2.181 - 2.193: 91.3391% ( 142) 00:16:15.886 2.193 - 2.204: 92.2925% ( 130) 00:16:15.886 2.204 - 2.216: 93.3852% ( 149) 00:16:15.886 2.216 - 2.228: 94.6099% ( 167) 00:16:15.886 2.228 - 2.240: 94.9472% ( 46) 00:16:15.886 2.240 - 2.252: 95.2479% ( 41) 00:16:15.886 2.252 - 2.264: 95.3872% ( 19) 00:16:15.886 2.264 - 2.276: 95.5779% ( 26) 00:16:15.886 2.276 - 2.287: 95.7832% ( 28) 00:16:15.886 2.287 - 2.299: 95.9079% ( 17) 00:16:15.886 2.299 - 2.311: 95.9739% ( 9) 00:16:15.886 2.311 - 2.323: 96.0546% ( 11) 00:16:15.886 2.323 - 2.335: 96.2159% ( 22) 00:16:15.886 2.335 - 2.347: 96.3772% ( 22) 00:16:15.886 2.347 - 2.359: 96.6046% ( 31) 00:16:15.886 2.359 - 2.370: 96.8906% ( 39) 00:16:15.886 2.370 - 2.382: 97.1253% ( 32) 00:16:15.886 2.382 - 2.394: 97.3893% ( 36) 00:16:15.886 2.394 - 2.406: 97.5946% ( 28) 00:16:15.886 2.406 - 2.418: 97.6826% ( 12) 00:16:15.886 2.418 - 2.430: 97.7633% ( 11) 00:16:15.886 2.430 - 2.441: 97.8513% ( 12) 00:16:15.886 2.441 - 2.453: 97.8953% ( 6) 00:16:15.886 2.453 - 2.465: 97.9393% ( 6) 00:16:15.886 2.465 - 2.477: 97.9833% ( 6) 00:16:15.886 2.477 - 2.489: 98.0566% ( 10) 00:16:15.886 2.489 - 2.501: 98.0786% ( 3) 00:16:15.886 2.501 - 2.513: 98.1226% ( 6) 00:16:15.886 2.513 - 2.524: 98.1666% ( 6) 00:16:15.886 2.524 - 2.536: 98.1886% ( 3) 00:16:15.886 2.536 - 2.548: 98.2253% ( 5) 00:16:15.886 2.548 - 2.560: 98.2400% ( 2) 00:16:15.886 2.560 - 2.572: 98.2546% ( 2) 00:16:15.886 2.572 - 2.584: 98.2840% ( 4) 00:16:15.886 2.584 - 2.596: 98.2913% ( 1) 00:16:15.886 2.596 - 2.607: 98.3133% ( 3) 00:16:15.886 2.607 - 2.619: 98.3353% ( 3) 00:16:15.886 2.619 - 2.631: 98.3573% ( 3) 00:16:15.886 2.631 - 2.643: 98.3793% ( 3) 00:16:15.886 2.643 - 2.655: 98.3866% ( 1) 00:16:15.886 2.655 - 2.667: 98.4086% ( 3) 00:16:15.886 2.667 - 2.679: 98.4233% ( 2) 00:16:15.886 2.679 - 2.690: 98.4306% ( 1) 00:16:15.886 2.702 - 2.714: 98.4380% ( 1) 00:16:15.886 2.738 - 2.750: 98.4453% ( 1) 00:16:15.886 2.750 - 2.761: 98.4526% ( 1) 00:16:15.886 2.773 - 2.785: 98.4600% ( 1) 00:16:15.886 2.785 - 2.797: 98.4673% ( 1) 00:16:15.886 2.821 - 2.833: 98.4746% ( 1) 00:16:15.886 2.833 - 2.844: 98.4893% ( 2) 00:16:15.886 2.856 - 2.868: 98.4966% ( 1) 00:16:15.886 2.880 - 2.892: 98.5040% ( 1) 00:16:15.886 2.892 - 2.904: 98.5113% ( 1) 00:16:15.886 2.904 - 2.916: 98.5186% ( 1) 00:16:15.886 2.916 - 2.927: 98.5333% ( 2) 00:16:15.886 2.963 - 2.975: 98.5406% ( 1) 00:16:15.886 2.975 - 2.987: 98.5480% ( 1) 00:16:15.886 2.987 - 2.999: 98.5553% ( 1) 00:16:15.886 3.010 - 3.022: 98.5626% ( 1) 00:16:15.886 3.034 - 3.058: 98.5700% ( 1) 00:16:15.886 3.058 - 3.081: 98.5773% ( 1) 00:16:15.886 3.081 - 3.105: 98.5846% ( 1) 00:16:15.886 3.129 - 3.153: 98.6066% ( 3) 00:16:15.886 3.200 - 3.224: 98.6213% ( 2) 00:16:15.886 3.224 - 3.247: 98.6286% ( 1) 00:16:15.887 3.247 - 3.271: 98.6360% ( 1) 00:16:15.887 3.271 - 3.295: 98.6433% ( 1) 00:16:15.887 3.319 - 3.342: 98.6580% ( 2) 00:16:15.887 3.342 - 3.366: 98.6726% ( 2) 00:16:15.887 3.390 - 3.413: 98.6873% ( 2) 00:16:15.887 3.413 - 3.437: 98.7093% ( 3) 00:16:15.887 3.437 - 3.461: 98.7460% ( 5) 00:16:15.887 3.461 - 3.484: 98.7680% ( 3) 00:16:15.887 3.484 - 3.508: 98.7826% ( 2) 00:16:15.887 3.532 - 3.556: 98.7900% ( 1) 00:16:15.887 3.579 - 3.603: 98.7973% ( 1) 00:16:15.887 3.603 - 3.627: 98.8193% ( 3) 00:16:15.887 3.698 - 3.721: 98.8266% ( 1) 00:16:15.887 3.793 - 3.816: 98.8340% ( 1) 00:16:15.887 3.887 - 3.911: 98.8413% ( 1) 00:16:15.887 3.911 - 3.935: 98.8486% ( 1) 00:16:15.887 3.959 - 3.982: 98.8633% ( 2) 00:16:15.887 3.982 - 4.006: 98.8706% ( 1) 00:16:15.887 4.030 - 4.053: 98.8780% ( 1) 00:16:15.887 4.053 - 4.077: 98.8853% ( 1) 00:16:15.887 5.547 - 5.570: 98.8926% ( 1) 00:16:15.887 5.570 - 5.594: 98.9000% ( 1) 00:16:15.887 5.594 - 5.618: 98.9073% ( 1) 00:16:15.887 6.068 - 6.116: 98.9146% ( 1) 00:16:15.887 6.116 - 6.163: 98.9220% ( 1) 00:16:15.887 6.210 - 6.258: 98.9293% ( 1) 00:16:15.887 6.258 - 6.305: 98.9366% ( 1) 00:16:15.887 6.637 - 6.684: 98.9440% ( 1) 00:16:15.887 6.779 - 6.827: 98.9513% ( 1) 00:16:15.887 6.827 - 6.874: 98.9586% ( 1) 00:16:15.887 7.490 - 7.538: 98.9733% ( 2) 00:16:15.887 7.538 - 7.585: 98.9880% ( 2) 00:16:15.887 7.585 - 7.633: 98.9953% ( 1) 00:16:15.887 8.107 - 8.154: 99.0100% ( 2) 00:16:15.887 8.344 - 8.391: 99.0173% ( 1) 00:16:15.887 8.439 - 8.486: 99.0246% ( 1) 00:16:15.887 8.913 - 8.960: 99.0320% ( 1) 00:16:15.887 9.813 - 9.861: 99.0393% ( 1) 00:16:15.887 11.046 - 11.093: 99.0540% ( 2) 00:16:15.887 13.179 - 13.274: 99.0613% ( 1) 00:16:15.887 15.455 - 15.550: 99.0686% ( 1) 00:16:15.887 15.644 - 15.739: 99.0760% ( 1) 00:16:15.887 15.739 - 15.834: 99.0906% ( 2) 00:16:15.887 15.834 - 15.929: 99.1273% ( 5) 00:16:15.887 15.929 - 16.024: 99.1566% ( 4) 00:16:15.887 16.024 - 16.119: 99.2153% ( 8) 00:16:15.887 16.119 - 16.213: 99.2300% ( 2) 00:16:15.887 16.213 - 16.308: 99.2373% ( 1) 00:16:15.887 16.308 - 16.403: 99.2740% ( 5) 00:16:15.887 16.403 - 16.498: 99.2813% ( 1) 00:16:15.887 16.498 - 16.593: 99.2960% ( 2) 00:16:15.887 16.593 - 16.687: 99.3180% ( 3) 00:16:15.887 16.782 - 16.877: 99.3400% ( 3) 00:16:15.887 16.877 - 16.972: 99.3546% ( 2) 00:16:15.887 16.972 - 17.067: 99.3620% ( 1) 00:16:15.887 17.067 - 17.161: 99.3767% ( 2) 00:16:15.887 17.161 - 17.256: 99.3913% ( 2) 00:16:15.887 17.256 - 17.351: 99.3987% ( 1) 00:16:15.887 17.730 - 17.825: 99.4060% ( 1) 00:16:15.887 18.679 - 18.773: 99.4133% ( 1) 00:16:15.887 21.902 - 21.997: 99.4280% ( 2) 00:16:15.887 22.281 - 22.376: 99.4353% ( 1) 00:16:15.887 26.738 - 26.927: 99.4427% ( 1) 00:16:15.887 37.547 - 37.736: 99.4500% ( 1) 00:16:15.887 3980.705 - 4004.978: 99.9340% ( 66) 00:16:15.887 4004.978 - 4029.250: 100.0000% ( 9) 00:16:15.887 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:15.887 [ 00:16:15.887 { 00:16:15.887 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:15.887 "subtype": "Discovery", 00:16:15.887 "listen_addresses": [], 00:16:15.887 "allow_any_host": true, 00:16:15.887 "hosts": [] 00:16:15.887 }, 00:16:15.887 { 00:16:15.887 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:15.887 "subtype": "NVMe", 00:16:15.887 "listen_addresses": [ 00:16:15.887 { 00:16:15.887 "transport": "VFIOUSER", 00:16:15.887 "trtype": "VFIOUSER", 00:16:15.887 "adrfam": "IPv4", 00:16:15.887 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:15.887 "trsvcid": "0" 00:16:15.887 } 00:16:15.887 ], 00:16:15.887 "allow_any_host": true, 00:16:15.887 "hosts": [], 00:16:15.887 "serial_number": "SPDK1", 00:16:15.887 "model_number": "SPDK bdev Controller", 00:16:15.887 "max_namespaces": 32, 00:16:15.887 "min_cntlid": 1, 00:16:15.887 "max_cntlid": 65519, 00:16:15.887 "namespaces": [ 00:16:15.887 { 00:16:15.887 "nsid": 1, 00:16:15.887 "bdev_name": "Malloc1", 00:16:15.887 "name": "Malloc1", 00:16:15.887 "nguid": "E471CE7E6EE04FA3B81E848B5ACAE676", 00:16:15.887 "uuid": "e471ce7e-6ee0-4fa3-b81e-848b5acae676" 00:16:15.887 }, 00:16:15.887 { 00:16:15.887 "nsid": 2, 00:16:15.887 "bdev_name": "Malloc3", 00:16:15.887 "name": "Malloc3", 00:16:15.887 "nguid": "0817D9BDEBE447FCB03835E9A15FE4DA", 00:16:15.887 "uuid": "0817d9bd-ebe4-47fc-b038-35e9a15fe4da" 00:16:15.887 } 00:16:15.887 ] 00:16:15.887 }, 00:16:15.887 { 00:16:15.887 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:15.887 "subtype": "NVMe", 00:16:15.887 "listen_addresses": [ 00:16:15.887 { 00:16:15.887 "transport": "VFIOUSER", 00:16:15.887 "trtype": "VFIOUSER", 00:16:15.887 "adrfam": "IPv4", 00:16:15.887 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:15.887 "trsvcid": "0" 00:16:15.887 } 00:16:15.887 ], 00:16:15.887 "allow_any_host": true, 00:16:15.887 "hosts": [], 00:16:15.887 "serial_number": "SPDK2", 00:16:15.887 "model_number": "SPDK bdev Controller", 00:16:15.887 "max_namespaces": 32, 00:16:15.887 "min_cntlid": 1, 00:16:15.887 "max_cntlid": 65519, 00:16:15.887 "namespaces": [ 00:16:15.887 { 00:16:15.887 "nsid": 1, 00:16:15.887 "bdev_name": "Malloc2", 00:16:15.887 "name": "Malloc2", 00:16:15.887 "nguid": "0F3C86E13C7844CE89662C2DCE878DBF", 00:16:15.887 "uuid": "0f3c86e1-3c78-44ce-8966-2c2dce878dbf" 00:16:15.887 } 00:16:15.887 ] 00:16:15.887 } 00:16:15.887 ] 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@34 -- # aerpid=1561277 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:15.887 17:35:53 -- common/autotest_common.sh@1254 -- # local i=0 00:16:15.887 17:35:53 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:15.887 17:35:53 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:15.887 17:35:53 -- common/autotest_common.sh@1265 -- # return 0 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:15.887 17:35:53 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:16.145 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.404 Malloc4 00:16:16.404 17:35:53 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:16.664 17:35:53 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:16.664 Asynchronous Event Request test 00:16:16.664 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:16.664 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:16.664 Registering asynchronous event callbacks... 00:16:16.664 Starting namespace attribute notice tests for all controllers... 00:16:16.664 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:16.664 aer_cb - Changed Namespace 00:16:16.664 Cleaning up... 00:16:16.664 [ 00:16:16.664 { 00:16:16.664 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:16.664 "subtype": "Discovery", 00:16:16.664 "listen_addresses": [], 00:16:16.664 "allow_any_host": true, 00:16:16.664 "hosts": [] 00:16:16.664 }, 00:16:16.664 { 00:16:16.664 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:16.664 "subtype": "NVMe", 00:16:16.664 "listen_addresses": [ 00:16:16.664 { 00:16:16.664 "transport": "VFIOUSER", 00:16:16.664 "trtype": "VFIOUSER", 00:16:16.664 "adrfam": "IPv4", 00:16:16.664 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:16.664 "trsvcid": "0" 00:16:16.664 } 00:16:16.664 ], 00:16:16.664 "allow_any_host": true, 00:16:16.664 "hosts": [], 00:16:16.664 "serial_number": "SPDK1", 00:16:16.664 "model_number": "SPDK bdev Controller", 00:16:16.664 "max_namespaces": 32, 00:16:16.664 "min_cntlid": 1, 00:16:16.664 "max_cntlid": 65519, 00:16:16.664 "namespaces": [ 00:16:16.664 { 00:16:16.664 "nsid": 1, 00:16:16.664 "bdev_name": "Malloc1", 00:16:16.664 "name": "Malloc1", 00:16:16.664 "nguid": "E471CE7E6EE04FA3B81E848B5ACAE676", 00:16:16.664 "uuid": "e471ce7e-6ee0-4fa3-b81e-848b5acae676" 00:16:16.664 }, 00:16:16.664 { 00:16:16.664 "nsid": 2, 00:16:16.664 "bdev_name": "Malloc3", 00:16:16.664 "name": "Malloc3", 00:16:16.664 "nguid": "0817D9BDEBE447FCB03835E9A15FE4DA", 00:16:16.664 "uuid": "0817d9bd-ebe4-47fc-b038-35e9a15fe4da" 00:16:16.664 } 00:16:16.664 ] 00:16:16.664 }, 00:16:16.664 { 00:16:16.664 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:16.664 "subtype": "NVMe", 00:16:16.664 "listen_addresses": [ 00:16:16.664 { 00:16:16.664 "transport": "VFIOUSER", 00:16:16.664 "trtype": "VFIOUSER", 00:16:16.664 "adrfam": "IPv4", 00:16:16.664 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:16.664 "trsvcid": "0" 00:16:16.664 } 00:16:16.664 ], 00:16:16.664 "allow_any_host": true, 00:16:16.664 "hosts": [], 00:16:16.664 "serial_number": "SPDK2", 00:16:16.664 "model_number": "SPDK bdev Controller", 00:16:16.664 "max_namespaces": 32, 00:16:16.664 "min_cntlid": 1, 00:16:16.664 "max_cntlid": 65519, 00:16:16.664 "namespaces": [ 00:16:16.664 { 00:16:16.664 "nsid": 1, 00:16:16.664 "bdev_name": "Malloc2", 00:16:16.664 "name": "Malloc2", 00:16:16.664 "nguid": "0F3C86E13C7844CE89662C2DCE878DBF", 00:16:16.664 "uuid": "0f3c86e1-3c78-44ce-8966-2c2dce878dbf" 00:16:16.664 }, 00:16:16.664 { 00:16:16.664 "nsid": 2, 00:16:16.664 "bdev_name": "Malloc4", 00:16:16.664 "name": "Malloc4", 00:16:16.664 "nguid": "E4C88BD796104B8C8FE407DC8032B131", 00:16:16.664 "uuid": "e4c88bd7-9610-4b8c-8fe4-07dc8032b131" 00:16:16.664 } 00:16:16.664 ] 00:16:16.664 } 00:16:16.664 ] 00:16:16.925 17:35:54 -- target/nvmf_vfio_user.sh@44 -- # wait 1561277 00:16:16.925 17:35:54 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:16.925 17:35:54 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1555508 00:16:16.925 17:35:54 -- common/autotest_common.sh@936 -- # '[' -z 1555508 ']' 00:16:16.925 17:35:54 -- common/autotest_common.sh@940 -- # kill -0 1555508 00:16:16.925 17:35:54 -- common/autotest_common.sh@941 -- # uname 00:16:16.925 17:35:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:16.925 17:35:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1555508 00:16:16.925 17:35:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:16.925 17:35:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:16.925 17:35:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1555508' 00:16:16.925 killing process with pid 1555508 00:16:16.925 17:35:54 -- common/autotest_common.sh@955 -- # kill 1555508 00:16:16.925 [2024-11-16 17:35:54.202874] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:16.925 17:35:54 -- common/autotest_common.sh@960 -- # wait 1555508 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=1561425 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 1561425' 00:16:17.183 Process pid: 1561425 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:17.183 17:35:54 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 1561425 00:16:17.183 17:35:54 -- common/autotest_common.sh@829 -- # '[' -z 1561425 ']' 00:16:17.183 17:35:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:17.183 17:35:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:17.183 17:35:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:17.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:17.183 17:35:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:17.183 17:35:54 -- common/autotest_common.sh@10 -- # set +x 00:16:17.183 [2024-11-16 17:35:54.579632] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:17.183 [2024-11-16 17:35:54.580697] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:17.183 [2024-11-16 17:35:54.580754] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:17.183 EAL: No free 2048 kB hugepages reported on node 1 00:16:17.183 [2024-11-16 17:35:54.644571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:17.443 [2024-11-16 17:35:54.738599] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:17.443 [2024-11-16 17:35:54.738756] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:17.443 [2024-11-16 17:35:54.738776] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:17.443 [2024-11-16 17:35:54.738789] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:17.443 [2024-11-16 17:35:54.738846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:17.443 [2024-11-16 17:35:54.738909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:17.443 [2024-11-16 17:35:54.738867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:17.443 [2024-11-16 17:35:54.738912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:17.443 [2024-11-16 17:35:54.840013] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:17.443 [2024-11-16 17:35:54.840232] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:17.443 [2024-11-16 17:35:54.840517] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:17.443 [2024-11-16 17:35:54.841296] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:17.443 [2024-11-16 17:35:54.841392] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:18.378 17:35:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:18.378 17:35:55 -- common/autotest_common.sh@862 -- # return 0 00:16:18.378 17:35:55 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:19.317 17:35:56 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:19.577 17:35:56 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:19.577 17:35:56 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:19.577 17:35:56 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:19.577 17:35:56 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:19.577 17:35:56 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:19.835 Malloc1 00:16:19.835 17:35:57 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:20.093 17:35:57 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:20.353 17:35:57 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:20.612 17:35:57 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:20.612 17:35:57 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:20.612 17:35:57 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:20.870 Malloc2 00:16:20.870 17:35:58 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:21.128 17:35:58 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:21.386 17:35:58 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:21.644 17:35:58 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:21.644 17:35:58 -- target/nvmf_vfio_user.sh@95 -- # killprocess 1561425 00:16:21.644 17:35:58 -- common/autotest_common.sh@936 -- # '[' -z 1561425 ']' 00:16:21.644 17:35:58 -- common/autotest_common.sh@940 -- # kill -0 1561425 00:16:21.644 17:35:58 -- common/autotest_common.sh@941 -- # uname 00:16:21.644 17:35:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:21.644 17:35:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1561425 00:16:21.644 17:35:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:21.644 17:35:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:21.644 17:35:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1561425' 00:16:21.644 killing process with pid 1561425 00:16:21.644 17:35:58 -- common/autotest_common.sh@955 -- # kill 1561425 00:16:21.644 17:35:58 -- common/autotest_common.sh@960 -- # wait 1561425 00:16:21.905 17:35:59 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:21.905 17:35:59 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:21.905 00:16:21.905 real 0m53.949s 00:16:21.905 user 3m33.142s 00:16:21.905 sys 0m4.591s 00:16:21.905 17:35:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:21.905 17:35:59 -- common/autotest_common.sh@10 -- # set +x 00:16:21.905 ************************************ 00:16:21.905 END TEST nvmf_vfio_user 00:16:21.905 ************************************ 00:16:21.905 17:35:59 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:21.905 17:35:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:21.905 17:35:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:21.905 17:35:59 -- common/autotest_common.sh@10 -- # set +x 00:16:21.905 ************************************ 00:16:21.905 START TEST nvmf_vfio_user_nvme_compliance 00:16:21.905 ************************************ 00:16:21.905 17:35:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:21.905 * Looking for test storage... 00:16:21.905 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:21.905 17:35:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:21.905 17:35:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:21.905 17:35:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:21.905 17:35:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:21.905 17:35:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:21.905 17:35:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:21.905 17:35:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:21.905 17:35:59 -- scripts/common.sh@335 -- # IFS=.-: 00:16:21.905 17:35:59 -- scripts/common.sh@335 -- # read -ra ver1 00:16:21.905 17:35:59 -- scripts/common.sh@336 -- # IFS=.-: 00:16:21.905 17:35:59 -- scripts/common.sh@336 -- # read -ra ver2 00:16:21.905 17:35:59 -- scripts/common.sh@337 -- # local 'op=<' 00:16:21.905 17:35:59 -- scripts/common.sh@339 -- # ver1_l=2 00:16:21.905 17:35:59 -- scripts/common.sh@340 -- # ver2_l=1 00:16:21.905 17:35:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:21.905 17:35:59 -- scripts/common.sh@343 -- # case "$op" in 00:16:21.905 17:35:59 -- scripts/common.sh@344 -- # : 1 00:16:21.905 17:35:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:21.905 17:35:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:21.905 17:35:59 -- scripts/common.sh@364 -- # decimal 1 00:16:21.905 17:35:59 -- scripts/common.sh@352 -- # local d=1 00:16:21.905 17:35:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:21.905 17:35:59 -- scripts/common.sh@354 -- # echo 1 00:16:21.905 17:35:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:21.905 17:35:59 -- scripts/common.sh@365 -- # decimal 2 00:16:21.905 17:35:59 -- scripts/common.sh@352 -- # local d=2 00:16:21.905 17:35:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:21.905 17:35:59 -- scripts/common.sh@354 -- # echo 2 00:16:21.905 17:35:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:21.905 17:35:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:21.905 17:35:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:21.905 17:35:59 -- scripts/common.sh@367 -- # return 0 00:16:21.905 17:35:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:21.905 17:35:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:21.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.905 --rc genhtml_branch_coverage=1 00:16:21.905 --rc genhtml_function_coverage=1 00:16:21.905 --rc genhtml_legend=1 00:16:21.905 --rc geninfo_all_blocks=1 00:16:21.905 --rc geninfo_unexecuted_blocks=1 00:16:21.905 00:16:21.905 ' 00:16:21.905 17:35:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:21.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.905 --rc genhtml_branch_coverage=1 00:16:21.905 --rc genhtml_function_coverage=1 00:16:21.905 --rc genhtml_legend=1 00:16:21.905 --rc geninfo_all_blocks=1 00:16:21.905 --rc geninfo_unexecuted_blocks=1 00:16:21.905 00:16:21.905 ' 00:16:21.905 17:35:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:21.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.905 --rc genhtml_branch_coverage=1 00:16:21.905 --rc genhtml_function_coverage=1 00:16:21.905 --rc genhtml_legend=1 00:16:21.905 --rc geninfo_all_blocks=1 00:16:21.905 --rc geninfo_unexecuted_blocks=1 00:16:21.905 00:16:21.905 ' 00:16:21.905 17:35:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:21.905 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:21.905 --rc genhtml_branch_coverage=1 00:16:21.905 --rc genhtml_function_coverage=1 00:16:21.905 --rc genhtml_legend=1 00:16:21.905 --rc geninfo_all_blocks=1 00:16:21.905 --rc geninfo_unexecuted_blocks=1 00:16:21.905 00:16:21.905 ' 00:16:21.905 17:35:59 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:21.905 17:35:59 -- nvmf/common.sh@7 -- # uname -s 00:16:21.905 17:35:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:21.905 17:35:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:21.905 17:35:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:21.905 17:35:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:21.905 17:35:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:21.905 17:35:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:21.905 17:35:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:21.905 17:35:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:21.905 17:35:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:21.905 17:35:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:22.163 17:35:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:22.164 17:35:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:22.164 17:35:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:22.164 17:35:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:22.164 17:35:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:22.164 17:35:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:22.164 17:35:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:22.164 17:35:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:22.164 17:35:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:22.164 17:35:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:22.164 17:35:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:22.164 17:35:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:22.164 17:35:59 -- paths/export.sh@5 -- # export PATH 00:16:22.164 17:35:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:22.164 17:35:59 -- nvmf/common.sh@46 -- # : 0 00:16:22.164 17:35:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:22.164 17:35:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:22.164 17:35:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:22.164 17:35:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:22.164 17:35:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:22.164 17:35:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:22.164 17:35:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:22.164 17:35:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:22.164 17:35:59 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:22.164 17:35:59 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:22.164 17:35:59 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:22.164 17:35:59 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:22.164 17:35:59 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:22.164 17:35:59 -- compliance/compliance.sh@20 -- # nvmfpid=1562174 00:16:22.164 17:35:59 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:22.164 17:35:59 -- compliance/compliance.sh@21 -- # echo 'Process pid: 1562174' 00:16:22.164 Process pid: 1562174 00:16:22.164 17:35:59 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:22.164 17:35:59 -- compliance/compliance.sh@24 -- # waitforlisten 1562174 00:16:22.164 17:35:59 -- common/autotest_common.sh@829 -- # '[' -z 1562174 ']' 00:16:22.164 17:35:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:22.164 17:35:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:22.164 17:35:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:22.164 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:22.164 17:35:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:22.164 17:35:59 -- common/autotest_common.sh@10 -- # set +x 00:16:22.164 [2024-11-16 17:35:59.455131] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:22.164 [2024-11-16 17:35:59.455222] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:22.164 EAL: No free 2048 kB hugepages reported on node 1 00:16:22.164 [2024-11-16 17:35:59.514521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:22.164 [2024-11-16 17:35:59.597829] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:22.164 [2024-11-16 17:35:59.597980] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:22.164 [2024-11-16 17:35:59.597998] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:22.164 [2024-11-16 17:35:59.598012] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:22.164 [2024-11-16 17:35:59.598071] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:22.164 [2024-11-16 17:35:59.598133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:22.164 [2024-11-16 17:35:59.598136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:23.098 17:36:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:23.098 17:36:00 -- common/autotest_common.sh@862 -- # return 0 00:16:23.098 17:36:00 -- compliance/compliance.sh@26 -- # sleep 1 00:16:24.033 17:36:01 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:24.033 17:36:01 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:24.033 17:36:01 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:24.033 17:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.033 17:36:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.033 17:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.033 17:36:01 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:24.033 17:36:01 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:24.033 17:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.033 17:36:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.033 malloc0 00:16:24.033 17:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.033 17:36:01 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:24.033 17:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.033 17:36:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.033 17:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.033 17:36:01 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:24.033 17:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.033 17:36:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.033 17:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.034 17:36:01 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:24.034 17:36:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:24.034 17:36:01 -- common/autotest_common.sh@10 -- # set +x 00:16:24.034 17:36:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:24.034 17:36:01 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:24.292 EAL: No free 2048 kB hugepages reported on node 1 00:16:24.292 00:16:24.292 00:16:24.292 CUnit - A unit testing framework for C - Version 2.1-3 00:16:24.292 http://cunit.sourceforge.net/ 00:16:24.292 00:16:24.292 00:16:24.292 Suite: nvme_compliance 00:16:24.292 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-16 17:36:01.657537] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:24.292 [2024-11-16 17:36:01.657613] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:24.292 [2024-11-16 17:36:01.657635] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:24.292 passed 00:16:24.292 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:24.552 Test: admin_identify_ns ...[2024-11-16 17:36:01.893664] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:24.552 [2024-11-16 17:36:01.901676] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:24.552 passed 00:16:24.552 Test: admin_get_features_mandatory_features ...passed 00:16:24.811 Test: admin_get_features_optional_features ...passed 00:16:25.069 Test: admin_set_features_number_of_queues ...passed 00:16:25.069 Test: admin_get_log_page_mandatory_logs ...passed 00:16:25.069 Test: admin_get_log_page_with_lpo ...[2024-11-16 17:36:02.530639] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:25.329 passed 00:16:25.329 Test: fabric_property_get ...passed 00:16:25.329 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-16 17:36:02.720171] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:25.329 passed 00:16:25.589 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-16 17:36:02.890624] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.589 [2024-11-16 17:36:02.906642] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.589 passed 00:16:25.589 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-16 17:36:02.996250] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:25.589 passed 00:16:25.850 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-16 17:36:03.159643] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:25.850 [2024-11-16 17:36:03.183644] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.850 passed 00:16:25.850 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-16 17:36:03.276378] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:25.850 [2024-11-16 17:36:03.276421] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:25.850 passed 00:16:26.113 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-16 17:36:03.456626] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:26.113 [2024-11-16 17:36:03.464632] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:26.113 [2024-11-16 17:36:03.472648] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:26.113 [2024-11-16 17:36:03.480630] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:26.113 passed 00:16:26.372 Test: admin_create_io_sq_verify_pc ...[2024-11-16 17:36:03.609654] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:26.372 passed 00:16:27.751 Test: admin_create_io_qp_max_qps ...[2024-11-16 17:36:04.808633] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:27.751 passed 00:16:28.009 Test: admin_create_io_sq_shared_cq ...[2024-11-16 17:36:05.404639] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:28.009 passed 00:16:28.009 00:16:28.009 Run Summary: Type Total Ran Passed Failed Inactive 00:16:28.009 suites 1 1 n/a 0 0 00:16:28.009 tests 18 18 18 0 0 00:16:28.009 asserts 360 360 360 0 n/a 00:16:28.009 00:16:28.009 Elapsed time = 1.569 seconds 00:16:28.009 17:36:05 -- compliance/compliance.sh@42 -- # killprocess 1562174 00:16:28.009 17:36:05 -- common/autotest_common.sh@936 -- # '[' -z 1562174 ']' 00:16:28.009 17:36:05 -- common/autotest_common.sh@940 -- # kill -0 1562174 00:16:28.009 17:36:05 -- common/autotest_common.sh@941 -- # uname 00:16:28.009 17:36:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:28.009 17:36:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1562174 00:16:28.269 17:36:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:28.269 17:36:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:28.269 17:36:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1562174' 00:16:28.269 killing process with pid 1562174 00:16:28.269 17:36:05 -- common/autotest_common.sh@955 -- # kill 1562174 00:16:28.269 17:36:05 -- common/autotest_common.sh@960 -- # wait 1562174 00:16:28.528 17:36:05 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:28.528 17:36:05 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:28.528 00:16:28.528 real 0m6.517s 00:16:28.528 user 0m18.548s 00:16:28.528 sys 0m0.591s 00:16:28.528 17:36:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:28.528 17:36:05 -- common/autotest_common.sh@10 -- # set +x 00:16:28.528 ************************************ 00:16:28.528 END TEST nvmf_vfio_user_nvme_compliance 00:16:28.528 ************************************ 00:16:28.528 17:36:05 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:28.528 17:36:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:28.528 17:36:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:28.528 17:36:05 -- common/autotest_common.sh@10 -- # set +x 00:16:28.528 ************************************ 00:16:28.528 START TEST nvmf_vfio_user_fuzz 00:16:28.528 ************************************ 00:16:28.528 17:36:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:28.528 * Looking for test storage... 00:16:28.528 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:28.528 17:36:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:28.528 17:36:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:28.528 17:36:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:28.528 17:36:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:28.528 17:36:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:28.528 17:36:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:28.528 17:36:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:28.528 17:36:05 -- scripts/common.sh@335 -- # IFS=.-: 00:16:28.528 17:36:05 -- scripts/common.sh@335 -- # read -ra ver1 00:16:28.528 17:36:05 -- scripts/common.sh@336 -- # IFS=.-: 00:16:28.528 17:36:05 -- scripts/common.sh@336 -- # read -ra ver2 00:16:28.528 17:36:05 -- scripts/common.sh@337 -- # local 'op=<' 00:16:28.528 17:36:05 -- scripts/common.sh@339 -- # ver1_l=2 00:16:28.528 17:36:05 -- scripts/common.sh@340 -- # ver2_l=1 00:16:28.528 17:36:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:28.528 17:36:05 -- scripts/common.sh@343 -- # case "$op" in 00:16:28.528 17:36:05 -- scripts/common.sh@344 -- # : 1 00:16:28.528 17:36:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:28.528 17:36:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:28.528 17:36:05 -- scripts/common.sh@364 -- # decimal 1 00:16:28.528 17:36:05 -- scripts/common.sh@352 -- # local d=1 00:16:28.528 17:36:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:28.528 17:36:05 -- scripts/common.sh@354 -- # echo 1 00:16:28.528 17:36:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:28.528 17:36:05 -- scripts/common.sh@365 -- # decimal 2 00:16:28.528 17:36:05 -- scripts/common.sh@352 -- # local d=2 00:16:28.528 17:36:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:28.528 17:36:05 -- scripts/common.sh@354 -- # echo 2 00:16:28.528 17:36:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:28.528 17:36:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:28.528 17:36:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:28.528 17:36:05 -- scripts/common.sh@367 -- # return 0 00:16:28.528 17:36:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:28.528 17:36:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:28.528 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.528 --rc genhtml_branch_coverage=1 00:16:28.528 --rc genhtml_function_coverage=1 00:16:28.528 --rc genhtml_legend=1 00:16:28.528 --rc geninfo_all_blocks=1 00:16:28.528 --rc geninfo_unexecuted_blocks=1 00:16:28.528 00:16:28.528 ' 00:16:28.528 17:36:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:28.528 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.528 --rc genhtml_branch_coverage=1 00:16:28.528 --rc genhtml_function_coverage=1 00:16:28.528 --rc genhtml_legend=1 00:16:28.529 --rc geninfo_all_blocks=1 00:16:28.529 --rc geninfo_unexecuted_blocks=1 00:16:28.529 00:16:28.529 ' 00:16:28.529 17:36:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:28.529 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.529 --rc genhtml_branch_coverage=1 00:16:28.529 --rc genhtml_function_coverage=1 00:16:28.529 --rc genhtml_legend=1 00:16:28.529 --rc geninfo_all_blocks=1 00:16:28.529 --rc geninfo_unexecuted_blocks=1 00:16:28.529 00:16:28.529 ' 00:16:28.529 17:36:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:28.529 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.529 --rc genhtml_branch_coverage=1 00:16:28.529 --rc genhtml_function_coverage=1 00:16:28.529 --rc genhtml_legend=1 00:16:28.529 --rc geninfo_all_blocks=1 00:16:28.529 --rc geninfo_unexecuted_blocks=1 00:16:28.529 00:16:28.529 ' 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:28.529 17:36:05 -- nvmf/common.sh@7 -- # uname -s 00:16:28.529 17:36:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:28.529 17:36:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:28.529 17:36:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:28.529 17:36:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:28.529 17:36:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:28.529 17:36:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:28.529 17:36:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:28.529 17:36:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:28.529 17:36:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:28.529 17:36:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:28.529 17:36:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.529 17:36:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.529 17:36:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:28.529 17:36:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:28.529 17:36:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:28.529 17:36:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:28.529 17:36:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:28.529 17:36:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:28.529 17:36:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:28.529 17:36:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.529 17:36:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.529 17:36:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.529 17:36:05 -- paths/export.sh@5 -- # export PATH 00:16:28.529 17:36:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.529 17:36:05 -- nvmf/common.sh@46 -- # : 0 00:16:28.529 17:36:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:28.529 17:36:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:28.529 17:36:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:28.529 17:36:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:28.529 17:36:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:28.529 17:36:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:28.529 17:36:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:28.529 17:36:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=1563088 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 1563088' 00:16:28.529 Process pid: 1563088 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:28.529 17:36:05 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 1563088 00:16:28.529 17:36:05 -- common/autotest_common.sh@829 -- # '[' -z 1563088 ']' 00:16:28.529 17:36:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:28.529 17:36:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:28.529 17:36:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:28.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:28.529 17:36:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:28.529 17:36:05 -- common/autotest_common.sh@10 -- # set +x 00:16:29.909 17:36:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:29.909 17:36:06 -- common/autotest_common.sh@862 -- # return 0 00:16:29.909 17:36:06 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:30.845 17:36:07 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:30.845 17:36:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.845 17:36:07 -- common/autotest_common.sh@10 -- # set +x 00:16:30.845 17:36:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.845 17:36:07 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:30.845 17:36:07 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:30.845 17:36:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.845 17:36:07 -- common/autotest_common.sh@10 -- # set +x 00:16:30.845 malloc0 00:16:30.845 17:36:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.845 17:36:08 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:30.845 17:36:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.845 17:36:08 -- common/autotest_common.sh@10 -- # set +x 00:16:30.845 17:36:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.845 17:36:08 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:30.845 17:36:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.845 17:36:08 -- common/autotest_common.sh@10 -- # set +x 00:16:30.845 17:36:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.845 17:36:08 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:30.845 17:36:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.845 17:36:08 -- common/autotest_common.sh@10 -- # set +x 00:16:30.845 17:36:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.845 17:36:08 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:30.845 17:36:08 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:02.927 Fuzzing completed. Shutting down the fuzz application 00:17:02.927 00:17:02.927 Dumping successful admin opcodes: 00:17:02.927 8, 9, 10, 24, 00:17:02.927 Dumping successful io opcodes: 00:17:02.927 0, 00:17:02.928 NS: 0x200003a1ef00 I/O qp, Total commands completed: 562315, total successful commands: 2160, random_seed: 4034758400 00:17:02.928 NS: 0x200003a1ef00 admin qp, Total commands completed: 139880, total successful commands: 1132, random_seed: 4034810368 00:17:02.928 17:36:38 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:02.928 17:36:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.928 17:36:38 -- common/autotest_common.sh@10 -- # set +x 00:17:02.928 17:36:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.928 17:36:38 -- target/vfio_user_fuzz.sh@46 -- # killprocess 1563088 00:17:02.928 17:36:38 -- common/autotest_common.sh@936 -- # '[' -z 1563088 ']' 00:17:02.928 17:36:38 -- common/autotest_common.sh@940 -- # kill -0 1563088 00:17:02.928 17:36:38 -- common/autotest_common.sh@941 -- # uname 00:17:02.928 17:36:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:02.928 17:36:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1563088 00:17:02.928 17:36:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:02.928 17:36:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:02.928 17:36:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1563088' 00:17:02.928 killing process with pid 1563088 00:17:02.928 17:36:38 -- common/autotest_common.sh@955 -- # kill 1563088 00:17:02.928 17:36:38 -- common/autotest_common.sh@960 -- # wait 1563088 00:17:02.928 17:36:38 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:02.928 17:36:38 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:02.928 00:17:02.928 real 0m33.093s 00:17:02.928 user 0m33.635s 00:17:02.928 sys 0m25.837s 00:17:02.928 17:36:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:02.928 17:36:38 -- common/autotest_common.sh@10 -- # set +x 00:17:02.928 ************************************ 00:17:02.928 END TEST nvmf_vfio_user_fuzz 00:17:02.928 ************************************ 00:17:02.928 17:36:38 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:02.928 17:36:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:02.928 17:36:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:02.928 17:36:38 -- common/autotest_common.sh@10 -- # set +x 00:17:02.928 ************************************ 00:17:02.928 START TEST nvmf_host_management 00:17:02.928 ************************************ 00:17:02.928 17:36:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:02.928 * Looking for test storage... 00:17:02.928 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:02.928 17:36:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:02.928 17:36:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:02.928 17:36:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:02.928 17:36:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:02.928 17:36:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:02.928 17:36:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:02.928 17:36:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:02.928 17:36:39 -- scripts/common.sh@335 -- # IFS=.-: 00:17:02.928 17:36:39 -- scripts/common.sh@335 -- # read -ra ver1 00:17:02.928 17:36:39 -- scripts/common.sh@336 -- # IFS=.-: 00:17:02.928 17:36:39 -- scripts/common.sh@336 -- # read -ra ver2 00:17:02.928 17:36:39 -- scripts/common.sh@337 -- # local 'op=<' 00:17:02.928 17:36:39 -- scripts/common.sh@339 -- # ver1_l=2 00:17:02.928 17:36:39 -- scripts/common.sh@340 -- # ver2_l=1 00:17:02.928 17:36:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:02.928 17:36:39 -- scripts/common.sh@343 -- # case "$op" in 00:17:02.928 17:36:39 -- scripts/common.sh@344 -- # : 1 00:17:02.928 17:36:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:02.928 17:36:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:02.928 17:36:39 -- scripts/common.sh@364 -- # decimal 1 00:17:02.928 17:36:39 -- scripts/common.sh@352 -- # local d=1 00:17:02.928 17:36:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:02.928 17:36:39 -- scripts/common.sh@354 -- # echo 1 00:17:02.928 17:36:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:02.928 17:36:39 -- scripts/common.sh@365 -- # decimal 2 00:17:02.928 17:36:39 -- scripts/common.sh@352 -- # local d=2 00:17:02.928 17:36:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:02.928 17:36:39 -- scripts/common.sh@354 -- # echo 2 00:17:02.928 17:36:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:02.928 17:36:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:02.928 17:36:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:02.928 17:36:39 -- scripts/common.sh@367 -- # return 0 00:17:02.928 17:36:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:02.928 17:36:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:02.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.928 --rc genhtml_branch_coverage=1 00:17:02.928 --rc genhtml_function_coverage=1 00:17:02.928 --rc genhtml_legend=1 00:17:02.928 --rc geninfo_all_blocks=1 00:17:02.928 --rc geninfo_unexecuted_blocks=1 00:17:02.928 00:17:02.928 ' 00:17:02.928 17:36:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:02.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.928 --rc genhtml_branch_coverage=1 00:17:02.928 --rc genhtml_function_coverage=1 00:17:02.928 --rc genhtml_legend=1 00:17:02.928 --rc geninfo_all_blocks=1 00:17:02.928 --rc geninfo_unexecuted_blocks=1 00:17:02.928 00:17:02.928 ' 00:17:02.928 17:36:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:02.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.928 --rc genhtml_branch_coverage=1 00:17:02.928 --rc genhtml_function_coverage=1 00:17:02.928 --rc genhtml_legend=1 00:17:02.928 --rc geninfo_all_blocks=1 00:17:02.928 --rc geninfo_unexecuted_blocks=1 00:17:02.928 00:17:02.928 ' 00:17:02.928 17:36:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:02.928 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.928 --rc genhtml_branch_coverage=1 00:17:02.928 --rc genhtml_function_coverage=1 00:17:02.928 --rc genhtml_legend=1 00:17:02.928 --rc geninfo_all_blocks=1 00:17:02.928 --rc geninfo_unexecuted_blocks=1 00:17:02.928 00:17:02.928 ' 00:17:02.928 17:36:39 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:02.928 17:36:39 -- nvmf/common.sh@7 -- # uname -s 00:17:02.928 17:36:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:02.928 17:36:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:02.928 17:36:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:02.928 17:36:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:02.928 17:36:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:02.928 17:36:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:02.928 17:36:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:02.928 17:36:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:02.928 17:36:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:02.928 17:36:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:02.928 17:36:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:02.928 17:36:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:02.928 17:36:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:02.928 17:36:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:02.928 17:36:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:02.928 17:36:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:02.928 17:36:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:02.928 17:36:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:02.928 17:36:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:02.928 17:36:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.928 17:36:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.928 17:36:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.928 17:36:39 -- paths/export.sh@5 -- # export PATH 00:17:02.928 17:36:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.928 17:36:39 -- nvmf/common.sh@46 -- # : 0 00:17:02.928 17:36:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:02.928 17:36:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:02.928 17:36:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:02.928 17:36:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:02.928 17:36:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:02.928 17:36:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:02.928 17:36:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:02.929 17:36:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:02.929 17:36:39 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:02.929 17:36:39 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:02.929 17:36:39 -- target/host_management.sh@104 -- # nvmftestinit 00:17:02.929 17:36:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:02.929 17:36:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:02.929 17:36:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:02.929 17:36:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:02.929 17:36:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:02.929 17:36:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.929 17:36:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.929 17:36:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:02.929 17:36:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:02.929 17:36:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:02.929 17:36:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:02.929 17:36:39 -- common/autotest_common.sh@10 -- # set +x 00:17:03.865 17:36:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:03.865 17:36:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:03.866 17:36:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:03.866 17:36:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:03.866 17:36:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:03.866 17:36:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:03.866 17:36:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:03.866 17:36:41 -- nvmf/common.sh@294 -- # net_devs=() 00:17:03.866 17:36:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:03.866 17:36:41 -- nvmf/common.sh@295 -- # e810=() 00:17:03.866 17:36:41 -- nvmf/common.sh@295 -- # local -ga e810 00:17:03.866 17:36:41 -- nvmf/common.sh@296 -- # x722=() 00:17:03.866 17:36:41 -- nvmf/common.sh@296 -- # local -ga x722 00:17:03.866 17:36:41 -- nvmf/common.sh@297 -- # mlx=() 00:17:03.866 17:36:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:03.866 17:36:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:03.866 17:36:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:03.866 17:36:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:03.866 17:36:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:03.866 17:36:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:03.866 17:36:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:03.866 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:03.866 17:36:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:03.866 17:36:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:03.866 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:03.866 17:36:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:03.866 17:36:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:03.866 17:36:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:03.866 17:36:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:03.866 17:36:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:03.866 17:36:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:03.866 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:03.866 17:36:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:03.866 17:36:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:03.866 17:36:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:03.866 17:36:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:03.866 17:36:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:03.866 17:36:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:03.866 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:03.866 17:36:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:03.866 17:36:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:03.866 17:36:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:03.866 17:36:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:03.866 17:36:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:03.866 17:36:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:03.866 17:36:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:03.866 17:36:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:03.866 17:36:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:03.866 17:36:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:03.866 17:36:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:03.866 17:36:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:03.866 17:36:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:03.866 17:36:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:03.866 17:36:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:03.866 17:36:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:03.866 17:36:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:03.866 17:36:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:03.866 17:36:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:03.866 17:36:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:03.866 17:36:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:03.866 17:36:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:03.866 17:36:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:03.866 17:36:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:03.866 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:03.866 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:17:03.866 00:17:03.866 --- 10.0.0.2 ping statistics --- 00:17:03.866 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:03.866 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:17:03.866 17:36:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:03.866 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:03.866 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:17:03.866 00:17:03.866 --- 10.0.0.1 ping statistics --- 00:17:03.866 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:03.866 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:17:03.866 17:36:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:03.866 17:36:41 -- nvmf/common.sh@410 -- # return 0 00:17:03.866 17:36:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:03.866 17:36:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:03.866 17:36:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:03.866 17:36:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:03.866 17:36:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:03.866 17:36:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:03.866 17:36:41 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:03.866 17:36:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:03.866 17:36:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:03.866 17:36:41 -- common/autotest_common.sh@10 -- # set +x 00:17:03.866 ************************************ 00:17:03.866 START TEST nvmf_host_management 00:17:03.866 ************************************ 00:17:03.866 17:36:41 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:03.866 17:36:41 -- target/host_management.sh@69 -- # starttarget 00:17:03.866 17:36:41 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:03.866 17:36:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:03.866 17:36:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:03.866 17:36:41 -- common/autotest_common.sh@10 -- # set +x 00:17:03.866 17:36:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:03.866 17:36:41 -- nvmf/common.sh@469 -- # nvmfpid=1569259 00:17:03.866 17:36:41 -- nvmf/common.sh@470 -- # waitforlisten 1569259 00:17:03.866 17:36:41 -- common/autotest_common.sh@829 -- # '[' -z 1569259 ']' 00:17:03.866 17:36:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:03.866 17:36:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:03.866 17:36:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:03.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:03.866 17:36:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:03.866 17:36:41 -- common/autotest_common.sh@10 -- # set +x 00:17:03.866 [2024-11-16 17:36:41.306524] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:03.866 [2024-11-16 17:36:41.306588] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:03.866 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.130 [2024-11-16 17:36:41.371286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:04.130 [2024-11-16 17:36:41.459377] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:04.130 [2024-11-16 17:36:41.459517] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:04.130 [2024-11-16 17:36:41.459535] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:04.130 [2024-11-16 17:36:41.459548] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:04.130 [2024-11-16 17:36:41.459655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:04.130 [2024-11-16 17:36:41.459716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:04.130 [2024-11-16 17:36:41.459784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:04.130 [2024-11-16 17:36:41.459786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:05.133 17:36:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:05.133 17:36:42 -- common/autotest_common.sh@862 -- # return 0 00:17:05.133 17:36:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:05.133 17:36:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:05.133 17:36:42 -- common/autotest_common.sh@10 -- # set +x 00:17:05.133 17:36:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:05.133 17:36:42 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:05.133 17:36:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.133 17:36:42 -- common/autotest_common.sh@10 -- # set +x 00:17:05.133 [2024-11-16 17:36:42.296261] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:05.133 17:36:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.133 17:36:42 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:05.133 17:36:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:05.133 17:36:42 -- common/autotest_common.sh@10 -- # set +x 00:17:05.133 17:36:42 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:05.133 17:36:42 -- target/host_management.sh@23 -- # cat 00:17:05.133 17:36:42 -- target/host_management.sh@30 -- # rpc_cmd 00:17:05.133 17:36:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.133 17:36:42 -- common/autotest_common.sh@10 -- # set +x 00:17:05.133 Malloc0 00:17:05.133 [2024-11-16 17:36:42.357642] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:05.133 17:36:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.133 17:36:42 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:05.133 17:36:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:05.133 17:36:42 -- common/autotest_common.sh@10 -- # set +x 00:17:05.133 17:36:42 -- target/host_management.sh@73 -- # perfpid=1569443 00:17:05.133 17:36:42 -- target/host_management.sh@74 -- # waitforlisten 1569443 /var/tmp/bdevperf.sock 00:17:05.133 17:36:42 -- common/autotest_common.sh@829 -- # '[' -z 1569443 ']' 00:17:05.133 17:36:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:05.133 17:36:42 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:05.133 17:36:42 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:05.133 17:36:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:05.133 17:36:42 -- nvmf/common.sh@520 -- # config=() 00:17:05.133 17:36:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:05.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:05.133 17:36:42 -- nvmf/common.sh@520 -- # local subsystem config 00:17:05.133 17:36:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:05.133 17:36:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:05.133 17:36:42 -- common/autotest_common.sh@10 -- # set +x 00:17:05.133 17:36:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:05.133 { 00:17:05.133 "params": { 00:17:05.133 "name": "Nvme$subsystem", 00:17:05.133 "trtype": "$TEST_TRANSPORT", 00:17:05.133 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:05.133 "adrfam": "ipv4", 00:17:05.133 "trsvcid": "$NVMF_PORT", 00:17:05.133 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:05.133 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:05.133 "hdgst": ${hdgst:-false}, 00:17:05.133 "ddgst": ${ddgst:-false} 00:17:05.133 }, 00:17:05.133 "method": "bdev_nvme_attach_controller" 00:17:05.133 } 00:17:05.133 EOF 00:17:05.133 )") 00:17:05.133 17:36:42 -- nvmf/common.sh@542 -- # cat 00:17:05.133 17:36:42 -- nvmf/common.sh@544 -- # jq . 00:17:05.133 17:36:42 -- nvmf/common.sh@545 -- # IFS=, 00:17:05.133 17:36:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:05.133 "params": { 00:17:05.133 "name": "Nvme0", 00:17:05.133 "trtype": "tcp", 00:17:05.133 "traddr": "10.0.0.2", 00:17:05.133 "adrfam": "ipv4", 00:17:05.133 "trsvcid": "4420", 00:17:05.133 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:05.133 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:05.133 "hdgst": false, 00:17:05.133 "ddgst": false 00:17:05.133 }, 00:17:05.133 "method": "bdev_nvme_attach_controller" 00:17:05.133 }' 00:17:05.134 [2024-11-16 17:36:42.435181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:05.134 [2024-11-16 17:36:42.435269] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1569443 ] 00:17:05.134 EAL: No free 2048 kB hugepages reported on node 1 00:17:05.134 [2024-11-16 17:36:42.496193] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:05.134 [2024-11-16 17:36:42.581370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:05.390 Running I/O for 10 seconds... 00:17:05.959 17:36:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:05.959 17:36:43 -- common/autotest_common.sh@862 -- # return 0 00:17:05.959 17:36:43 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:05.959 17:36:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.959 17:36:43 -- common/autotest_common.sh@10 -- # set +x 00:17:05.959 17:36:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.960 17:36:43 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:05.960 17:36:43 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:05.960 17:36:43 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:05.960 17:36:43 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:05.960 17:36:43 -- target/host_management.sh@52 -- # local ret=1 00:17:05.960 17:36:43 -- target/host_management.sh@53 -- # local i 00:17:05.960 17:36:43 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:05.960 17:36:43 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:05.960 17:36:43 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:05.960 17:36:43 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:05.960 17:36:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.960 17:36:43 -- common/autotest_common.sh@10 -- # set +x 00:17:05.960 17:36:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.960 17:36:43 -- target/host_management.sh@55 -- # read_io_count=2397 00:17:05.960 17:36:43 -- target/host_management.sh@58 -- # '[' 2397 -ge 100 ']' 00:17:05.960 17:36:43 -- target/host_management.sh@59 -- # ret=0 00:17:05.960 17:36:43 -- target/host_management.sh@60 -- # break 00:17:05.960 17:36:43 -- target/host_management.sh@64 -- # return 0 00:17:05.960 17:36:43 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:05.960 17:36:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.960 17:36:43 -- common/autotest_common.sh@10 -- # set +x 00:17:05.960 [2024-11-16 17:36:43.438536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.438995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.439139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1073f40 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.440020] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:05.960 [2024-11-16 17:36:43.440061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440085] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:05.960 [2024-11-16 17:36:43.440099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440114] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:05.960 [2024-11-16 17:36:43.440128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440143] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:05.960 [2024-11-16 17:36:43.440157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1af6870 is same with the state(5) to be set 00:17:05.960 [2024-11-16 17:36:43.440230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:63360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.960 [2024-11-16 17:36:43.440252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:63616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.960 [2024-11-16 17:36:43.440294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:63744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.960 [2024-11-16 17:36:43.440326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:63872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.960 [2024-11-16 17:36:43.440357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:57984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.960 [2024-11-16 17:36:43.440406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:58112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.960 [2024-11-16 17:36:43.440444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.960 [2024-11-16 17:36:43.440462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:58240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:58368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:64000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:64128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:64256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:64384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:64512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:64640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:64768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:64896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:65024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:65152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:65280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:65408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.440972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:65536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.440987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:65664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:65792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:65920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:66048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:66176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:66304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:58624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:58752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:59136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:59520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:59776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:66688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:66944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:67200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:67328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:67456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:67584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.961 [2024-11-16 17:36:43.441705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.961 [2024-11-16 17:36:43.441722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:67712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.441738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.441759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:60160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.441775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.441792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:67840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.441807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.441825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:67968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.441841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.441858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.441873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.441890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.441916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.441933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:60288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.441949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.441966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.441982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.441999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:60800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 17:36:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.962 [2024-11-16 17:36:43.442048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:61312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:61568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 17:36:43 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:05.962 [2024-11-16 17:36:43.442200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:68864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 17:36:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.962 [2024-11-16 17:36:43.442314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:69376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:62848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 17:36:43 -- common/autotest_common.sh@10 -- # set +x 00:17:05.962 [2024-11-16 17:36:43.442430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:69632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.962 [2024-11-16 17:36:43.442446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.962 [2024-11-16 17:36:43.442534] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1af3f30 was disconnected and freed. reset controller. 00:17:05.962 [2024-11-16 17:36:43.443682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:05.962 task offset: 63360 on job bdev=Nvme0n1 fails 00:17:05.962 00:17:05.962 Latency(us) 00:17:05.962 [2024-11-16T16:36:43.454Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:05.962 [2024-11-16T16:36:43.454Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:05.962 [2024-11-16T16:36:43.454Z] Job: Nvme0n1 ended in about 0.65 seconds with error 00:17:05.962 Verification LBA range: start 0x0 length 0x400 00:17:05.962 Nvme0n1 : 0.65 3898.00 243.63 98.64 0.00 15773.13 2936.98 22816.24 00:17:05.962 [2024-11-16T16:36:43.454Z] =================================================================================================================== 00:17:05.962 [2024-11-16T16:36:43.454Z] Total : 3898.00 243.63 98.64 0.00 15773.13 2936.98 22816.24 00:17:05.962 [2024-11-16 17:36:43.445642] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:05.962 [2024-11-16 17:36:43.445673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1af6870 (9): Bad file descriptor 00:17:05.962 17:36:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.962 17:36:43 -- target/host_management.sh@87 -- # sleep 1 00:17:06.220 [2024-11-16 17:36:43.453324] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:07.157 17:36:44 -- target/host_management.sh@91 -- # kill -9 1569443 00:17:07.157 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1569443) - No such process 00:17:07.157 17:36:44 -- target/host_management.sh@91 -- # true 00:17:07.157 17:36:44 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:07.157 17:36:44 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:07.157 17:36:44 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:07.157 17:36:44 -- nvmf/common.sh@520 -- # config=() 00:17:07.158 17:36:44 -- nvmf/common.sh@520 -- # local subsystem config 00:17:07.158 17:36:44 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:07.158 17:36:44 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:07.158 { 00:17:07.158 "params": { 00:17:07.158 "name": "Nvme$subsystem", 00:17:07.158 "trtype": "$TEST_TRANSPORT", 00:17:07.158 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:07.158 "adrfam": "ipv4", 00:17:07.158 "trsvcid": "$NVMF_PORT", 00:17:07.158 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:07.158 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:07.158 "hdgst": ${hdgst:-false}, 00:17:07.158 "ddgst": ${ddgst:-false} 00:17:07.158 }, 00:17:07.158 "method": "bdev_nvme_attach_controller" 00:17:07.158 } 00:17:07.158 EOF 00:17:07.158 )") 00:17:07.158 17:36:44 -- nvmf/common.sh@542 -- # cat 00:17:07.158 17:36:44 -- nvmf/common.sh@544 -- # jq . 00:17:07.158 17:36:44 -- nvmf/common.sh@545 -- # IFS=, 00:17:07.158 17:36:44 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:07.158 "params": { 00:17:07.158 "name": "Nvme0", 00:17:07.158 "trtype": "tcp", 00:17:07.158 "traddr": "10.0.0.2", 00:17:07.158 "adrfam": "ipv4", 00:17:07.158 "trsvcid": "4420", 00:17:07.158 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:07.158 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:07.158 "hdgst": false, 00:17:07.158 "ddgst": false 00:17:07.158 }, 00:17:07.158 "method": "bdev_nvme_attach_controller" 00:17:07.158 }' 00:17:07.158 [2024-11-16 17:36:44.496129] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:07.158 [2024-11-16 17:36:44.496216] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1569727 ] 00:17:07.158 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.158 [2024-11-16 17:36:44.557177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:07.158 [2024-11-16 17:36:44.643292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:07.725 Running I/O for 1 seconds... 00:17:08.663 00:17:08.663 Latency(us) 00:17:08.663 [2024-11-16T16:36:46.155Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:08.663 [2024-11-16T16:36:46.155Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:08.663 Verification LBA range: start 0x0 length 0x400 00:17:08.663 Nvme0n1 : 1.01 3883.90 242.74 0.00 0.00 16206.53 649.29 23787.14 00:17:08.663 [2024-11-16T16:36:46.155Z] =================================================================================================================== 00:17:08.663 [2024-11-16T16:36:46.155Z] Total : 3883.90 242.74 0.00 0.00 16206.53 649.29 23787.14 00:17:08.921 17:36:46 -- target/host_management.sh@101 -- # stoptarget 00:17:08.921 17:36:46 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:08.921 17:36:46 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:08.921 17:36:46 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:08.921 17:36:46 -- target/host_management.sh@40 -- # nvmftestfini 00:17:08.921 17:36:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:08.921 17:36:46 -- nvmf/common.sh@116 -- # sync 00:17:08.921 17:36:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:08.921 17:36:46 -- nvmf/common.sh@119 -- # set +e 00:17:08.921 17:36:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:08.921 17:36:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:08.921 rmmod nvme_tcp 00:17:08.921 rmmod nvme_fabrics 00:17:08.921 rmmod nvme_keyring 00:17:08.921 17:36:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:08.921 17:36:46 -- nvmf/common.sh@123 -- # set -e 00:17:08.921 17:36:46 -- nvmf/common.sh@124 -- # return 0 00:17:08.921 17:36:46 -- nvmf/common.sh@477 -- # '[' -n 1569259 ']' 00:17:08.921 17:36:46 -- nvmf/common.sh@478 -- # killprocess 1569259 00:17:08.921 17:36:46 -- common/autotest_common.sh@936 -- # '[' -z 1569259 ']' 00:17:08.921 17:36:46 -- common/autotest_common.sh@940 -- # kill -0 1569259 00:17:08.921 17:36:46 -- common/autotest_common.sh@941 -- # uname 00:17:08.921 17:36:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:08.921 17:36:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1569259 00:17:08.921 17:36:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:08.921 17:36:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:08.921 17:36:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1569259' 00:17:08.921 killing process with pid 1569259 00:17:08.921 17:36:46 -- common/autotest_common.sh@955 -- # kill 1569259 00:17:08.921 17:36:46 -- common/autotest_common.sh@960 -- # wait 1569259 00:17:09.180 [2024-11-16 17:36:46.514095] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:09.180 17:36:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:09.180 17:36:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:09.180 17:36:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:09.180 17:36:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:09.180 17:36:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:09.180 17:36:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:09.180 17:36:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:09.180 17:36:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.088 17:36:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:11.088 00:17:11.088 real 0m7.320s 00:17:11.088 user 0m22.534s 00:17:11.088 sys 0m1.541s 00:17:11.088 17:36:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:11.088 17:36:48 -- common/autotest_common.sh@10 -- # set +x 00:17:11.088 ************************************ 00:17:11.088 END TEST nvmf_host_management 00:17:11.088 ************************************ 00:17:11.347 17:36:48 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:11.347 00:17:11.347 real 0m9.692s 00:17:11.347 user 0m23.423s 00:17:11.347 sys 0m3.060s 00:17:11.347 17:36:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:11.347 17:36:48 -- common/autotest_common.sh@10 -- # set +x 00:17:11.347 ************************************ 00:17:11.347 END TEST nvmf_host_management 00:17:11.347 ************************************ 00:17:11.347 17:36:48 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:11.347 17:36:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:11.347 17:36:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:11.347 17:36:48 -- common/autotest_common.sh@10 -- # set +x 00:17:11.347 ************************************ 00:17:11.347 START TEST nvmf_lvol 00:17:11.347 ************************************ 00:17:11.347 17:36:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:11.347 * Looking for test storage... 00:17:11.347 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:11.347 17:36:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:11.347 17:36:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:11.347 17:36:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:11.347 17:36:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:11.347 17:36:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:11.347 17:36:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:11.347 17:36:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:11.347 17:36:48 -- scripts/common.sh@335 -- # IFS=.-: 00:17:11.347 17:36:48 -- scripts/common.sh@335 -- # read -ra ver1 00:17:11.347 17:36:48 -- scripts/common.sh@336 -- # IFS=.-: 00:17:11.347 17:36:48 -- scripts/common.sh@336 -- # read -ra ver2 00:17:11.347 17:36:48 -- scripts/common.sh@337 -- # local 'op=<' 00:17:11.347 17:36:48 -- scripts/common.sh@339 -- # ver1_l=2 00:17:11.347 17:36:48 -- scripts/common.sh@340 -- # ver2_l=1 00:17:11.347 17:36:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:11.347 17:36:48 -- scripts/common.sh@343 -- # case "$op" in 00:17:11.347 17:36:48 -- scripts/common.sh@344 -- # : 1 00:17:11.347 17:36:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:11.347 17:36:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:11.347 17:36:48 -- scripts/common.sh@364 -- # decimal 1 00:17:11.347 17:36:48 -- scripts/common.sh@352 -- # local d=1 00:17:11.347 17:36:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:11.347 17:36:48 -- scripts/common.sh@354 -- # echo 1 00:17:11.347 17:36:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:11.347 17:36:48 -- scripts/common.sh@365 -- # decimal 2 00:17:11.347 17:36:48 -- scripts/common.sh@352 -- # local d=2 00:17:11.347 17:36:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:11.347 17:36:48 -- scripts/common.sh@354 -- # echo 2 00:17:11.347 17:36:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:11.347 17:36:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:11.347 17:36:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:11.347 17:36:48 -- scripts/common.sh@367 -- # return 0 00:17:11.347 17:36:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:11.347 17:36:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:11.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.347 --rc genhtml_branch_coverage=1 00:17:11.347 --rc genhtml_function_coverage=1 00:17:11.347 --rc genhtml_legend=1 00:17:11.347 --rc geninfo_all_blocks=1 00:17:11.347 --rc geninfo_unexecuted_blocks=1 00:17:11.347 00:17:11.347 ' 00:17:11.347 17:36:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:11.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.347 --rc genhtml_branch_coverage=1 00:17:11.347 --rc genhtml_function_coverage=1 00:17:11.347 --rc genhtml_legend=1 00:17:11.347 --rc geninfo_all_blocks=1 00:17:11.347 --rc geninfo_unexecuted_blocks=1 00:17:11.347 00:17:11.347 ' 00:17:11.347 17:36:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:11.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.347 --rc genhtml_branch_coverage=1 00:17:11.347 --rc genhtml_function_coverage=1 00:17:11.347 --rc genhtml_legend=1 00:17:11.347 --rc geninfo_all_blocks=1 00:17:11.347 --rc geninfo_unexecuted_blocks=1 00:17:11.347 00:17:11.347 ' 00:17:11.347 17:36:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:11.347 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:11.347 --rc genhtml_branch_coverage=1 00:17:11.347 --rc genhtml_function_coverage=1 00:17:11.347 --rc genhtml_legend=1 00:17:11.347 --rc geninfo_all_blocks=1 00:17:11.347 --rc geninfo_unexecuted_blocks=1 00:17:11.347 00:17:11.347 ' 00:17:11.347 17:36:48 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:11.347 17:36:48 -- nvmf/common.sh@7 -- # uname -s 00:17:11.347 17:36:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:11.347 17:36:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:11.347 17:36:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:11.348 17:36:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:11.348 17:36:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:11.348 17:36:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:11.348 17:36:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:11.348 17:36:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:11.348 17:36:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:11.348 17:36:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:11.348 17:36:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.348 17:36:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:11.348 17:36:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:11.348 17:36:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:11.348 17:36:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:11.348 17:36:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:11.348 17:36:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:11.348 17:36:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:11.348 17:36:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:11.348 17:36:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.348 17:36:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.348 17:36:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.348 17:36:48 -- paths/export.sh@5 -- # export PATH 00:17:11.348 17:36:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:11.348 17:36:48 -- nvmf/common.sh@46 -- # : 0 00:17:11.348 17:36:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:11.348 17:36:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:11.348 17:36:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:11.348 17:36:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:11.348 17:36:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:11.348 17:36:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:11.348 17:36:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:11.348 17:36:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:11.348 17:36:48 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:11.348 17:36:48 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:11.348 17:36:48 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:11.348 17:36:48 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:11.348 17:36:48 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:11.348 17:36:48 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:11.348 17:36:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:11.348 17:36:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:11.348 17:36:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:11.348 17:36:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:11.348 17:36:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:11.348 17:36:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:11.348 17:36:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:11.348 17:36:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:11.348 17:36:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:11.348 17:36:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:11.348 17:36:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:11.348 17:36:48 -- common/autotest_common.sh@10 -- # set +x 00:17:13.880 17:36:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:13.880 17:36:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:13.880 17:36:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:13.880 17:36:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:13.880 17:36:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:13.880 17:36:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:13.880 17:36:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:13.880 17:36:50 -- nvmf/common.sh@294 -- # net_devs=() 00:17:13.880 17:36:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:13.880 17:36:50 -- nvmf/common.sh@295 -- # e810=() 00:17:13.880 17:36:50 -- nvmf/common.sh@295 -- # local -ga e810 00:17:13.880 17:36:50 -- nvmf/common.sh@296 -- # x722=() 00:17:13.880 17:36:50 -- nvmf/common.sh@296 -- # local -ga x722 00:17:13.880 17:36:50 -- nvmf/common.sh@297 -- # mlx=() 00:17:13.880 17:36:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:13.880 17:36:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:13.880 17:36:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:13.880 17:36:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:13.880 17:36:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:13.880 17:36:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:13.880 17:36:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:13.880 17:36:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:13.880 17:36:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:13.880 17:36:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:13.880 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:13.881 17:36:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:13.881 17:36:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:13.881 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:13.881 17:36:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:13.881 17:36:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:13.881 17:36:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:13.881 17:36:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:13.881 17:36:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:13.881 17:36:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:13.881 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:13.881 17:36:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:13.881 17:36:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:13.881 17:36:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:13.881 17:36:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:13.881 17:36:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:13.881 17:36:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:13.881 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:13.881 17:36:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:13.881 17:36:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:13.881 17:36:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:13.881 17:36:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:13.881 17:36:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:13.881 17:36:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:13.881 17:36:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:13.881 17:36:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:13.881 17:36:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:13.881 17:36:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:13.881 17:36:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:13.881 17:36:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:13.881 17:36:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:13.881 17:36:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:13.881 17:36:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:13.881 17:36:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:13.881 17:36:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:13.881 17:36:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:13.881 17:36:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:13.881 17:36:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:13.881 17:36:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:13.881 17:36:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:13.881 17:36:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:13.881 17:36:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:13.881 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:13.881 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.190 ms 00:17:13.881 00:17:13.881 --- 10.0.0.2 ping statistics --- 00:17:13.881 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:13.881 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:17:13.881 17:36:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:13.881 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:13.881 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:17:13.881 00:17:13.881 --- 10.0.0.1 ping statistics --- 00:17:13.881 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:13.881 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:17:13.881 17:36:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:13.881 17:36:50 -- nvmf/common.sh@410 -- # return 0 00:17:13.881 17:36:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:13.881 17:36:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:13.881 17:36:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:13.881 17:36:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:13.881 17:36:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:13.881 17:36:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:13.881 17:36:50 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:13.881 17:36:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:13.881 17:36:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:13.881 17:36:50 -- common/autotest_common.sh@10 -- # set +x 00:17:13.881 17:36:50 -- nvmf/common.sh@469 -- # nvmfpid=1571966 00:17:13.881 17:36:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:13.881 17:36:50 -- nvmf/common.sh@470 -- # waitforlisten 1571966 00:17:13.881 17:36:50 -- common/autotest_common.sh@829 -- # '[' -z 1571966 ']' 00:17:13.881 17:36:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:13.881 17:36:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:13.881 17:36:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:13.881 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:13.881 17:36:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:13.881 17:36:50 -- common/autotest_common.sh@10 -- # set +x 00:17:13.881 [2024-11-16 17:36:51.001925] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:13.881 [2024-11-16 17:36:51.002006] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:13.881 EAL: No free 2048 kB hugepages reported on node 1 00:17:13.881 [2024-11-16 17:36:51.070632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:13.881 [2024-11-16 17:36:51.163869] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:13.881 [2024-11-16 17:36:51.164057] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:13.881 [2024-11-16 17:36:51.164078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:13.881 [2024-11-16 17:36:51.164093] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:13.881 [2024-11-16 17:36:51.164156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:13.881 [2024-11-16 17:36:51.164225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:13.881 [2024-11-16 17:36:51.164228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:14.816 17:36:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:14.816 17:36:52 -- common/autotest_common.sh@862 -- # return 0 00:17:14.816 17:36:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:14.816 17:36:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:14.816 17:36:52 -- common/autotest_common.sh@10 -- # set +x 00:17:14.816 17:36:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:14.816 17:36:52 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:14.816 [2024-11-16 17:36:52.280969] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:14.816 17:36:52 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:15.382 17:36:52 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:15.382 17:36:52 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:15.640 17:36:52 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:15.640 17:36:52 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:15.899 17:36:53 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:16.157 17:36:53 -- target/nvmf_lvol.sh@29 -- # lvs=e4ff3677-337a-4b36-b4ad-7bd871a84d16 00:17:16.157 17:36:53 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e4ff3677-337a-4b36-b4ad-7bd871a84d16 lvol 20 00:17:16.415 17:36:53 -- target/nvmf_lvol.sh@32 -- # lvol=8b81c8d1-be71-4de4-a717-0e3d12ad0cae 00:17:16.415 17:36:53 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:16.673 17:36:54 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 8b81c8d1-be71-4de4-a717-0e3d12ad0cae 00:17:16.931 17:36:54 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:17.189 [2024-11-16 17:36:54.538906] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:17.189 17:36:54 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:17.447 17:36:54 -- target/nvmf_lvol.sh@42 -- # perf_pid=1572415 00:17:17.447 17:36:54 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:17.447 17:36:54 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:17.447 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.380 17:36:55 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 8b81c8d1-be71-4de4-a717-0e3d12ad0cae MY_SNAPSHOT 00:17:18.638 17:36:56 -- target/nvmf_lvol.sh@47 -- # snapshot=b125bc6a-52a8-4877-a164-6654e4082b9b 00:17:18.638 17:36:56 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 8b81c8d1-be71-4de4-a717-0e3d12ad0cae 30 00:17:18.896 17:36:56 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone b125bc6a-52a8-4877-a164-6654e4082b9b MY_CLONE 00:17:19.154 17:36:56 -- target/nvmf_lvol.sh@49 -- # clone=22ea81e5-a746-408f-8b31-0df384855a9d 00:17:19.154 17:36:56 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 22ea81e5-a746-408f-8b31-0df384855a9d 00:17:19.720 17:36:57 -- target/nvmf_lvol.sh@53 -- # wait 1572415 00:17:27.830 Initializing NVMe Controllers 00:17:27.830 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:27.830 Controller IO queue size 128, less than required. 00:17:27.830 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:27.830 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:27.830 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:27.830 Initialization complete. Launching workers. 00:17:27.830 ======================================================== 00:17:27.830 Latency(us) 00:17:27.830 Device Information : IOPS MiB/s Average min max 00:17:27.830 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10539.09 41.17 12148.91 1855.82 78803.61 00:17:27.830 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10761.69 42.04 11899.93 1997.46 64307.34 00:17:27.830 ======================================================== 00:17:27.830 Total : 21300.79 83.21 12023.12 1855.82 78803.61 00:17:27.830 00:17:27.830 17:37:05 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:28.088 17:37:05 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8b81c8d1-be71-4de4-a717-0e3d12ad0cae 00:17:28.346 17:37:05 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e4ff3677-337a-4b36-b4ad-7bd871a84d16 00:17:28.604 17:37:05 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:28.604 17:37:05 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:28.604 17:37:05 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:28.604 17:37:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:28.604 17:37:05 -- nvmf/common.sh@116 -- # sync 00:17:28.604 17:37:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:28.604 17:37:05 -- nvmf/common.sh@119 -- # set +e 00:17:28.604 17:37:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:28.604 17:37:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:28.604 rmmod nvme_tcp 00:17:28.604 rmmod nvme_fabrics 00:17:28.604 rmmod nvme_keyring 00:17:28.604 17:37:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:28.604 17:37:06 -- nvmf/common.sh@123 -- # set -e 00:17:28.604 17:37:06 -- nvmf/common.sh@124 -- # return 0 00:17:28.604 17:37:06 -- nvmf/common.sh@477 -- # '[' -n 1571966 ']' 00:17:28.604 17:37:06 -- nvmf/common.sh@478 -- # killprocess 1571966 00:17:28.604 17:37:06 -- common/autotest_common.sh@936 -- # '[' -z 1571966 ']' 00:17:28.604 17:37:06 -- common/autotest_common.sh@940 -- # kill -0 1571966 00:17:28.604 17:37:06 -- common/autotest_common.sh@941 -- # uname 00:17:28.604 17:37:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:28.604 17:37:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1571966 00:17:28.604 17:37:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:28.604 17:37:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:28.604 17:37:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1571966' 00:17:28.604 killing process with pid 1571966 00:17:28.604 17:37:06 -- common/autotest_common.sh@955 -- # kill 1571966 00:17:28.604 17:37:06 -- common/autotest_common.sh@960 -- # wait 1571966 00:17:28.863 17:37:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:28.863 17:37:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:28.863 17:37:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:28.863 17:37:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:28.863 17:37:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:28.863 17:37:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:28.863 17:37:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:28.863 17:37:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:31.396 17:37:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:31.396 00:17:31.396 real 0m19.747s 00:17:31.396 user 1m7.515s 00:17:31.396 sys 0m5.325s 00:17:31.396 17:37:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:31.396 17:37:08 -- common/autotest_common.sh@10 -- # set +x 00:17:31.396 ************************************ 00:17:31.396 END TEST nvmf_lvol 00:17:31.396 ************************************ 00:17:31.396 17:37:08 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:31.396 17:37:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:31.396 17:37:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:31.396 17:37:08 -- common/autotest_common.sh@10 -- # set +x 00:17:31.396 ************************************ 00:17:31.396 START TEST nvmf_lvs_grow 00:17:31.396 ************************************ 00:17:31.396 17:37:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:31.396 * Looking for test storage... 00:17:31.397 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:31.397 17:37:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:31.397 17:37:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:31.397 17:37:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:31.397 17:37:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:31.397 17:37:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:31.397 17:37:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:31.397 17:37:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:31.397 17:37:08 -- scripts/common.sh@335 -- # IFS=.-: 00:17:31.397 17:37:08 -- scripts/common.sh@335 -- # read -ra ver1 00:17:31.397 17:37:08 -- scripts/common.sh@336 -- # IFS=.-: 00:17:31.397 17:37:08 -- scripts/common.sh@336 -- # read -ra ver2 00:17:31.397 17:37:08 -- scripts/common.sh@337 -- # local 'op=<' 00:17:31.397 17:37:08 -- scripts/common.sh@339 -- # ver1_l=2 00:17:31.397 17:37:08 -- scripts/common.sh@340 -- # ver2_l=1 00:17:31.397 17:37:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:31.397 17:37:08 -- scripts/common.sh@343 -- # case "$op" in 00:17:31.397 17:37:08 -- scripts/common.sh@344 -- # : 1 00:17:31.397 17:37:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:31.397 17:37:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:31.397 17:37:08 -- scripts/common.sh@364 -- # decimal 1 00:17:31.397 17:37:08 -- scripts/common.sh@352 -- # local d=1 00:17:31.397 17:37:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:31.397 17:37:08 -- scripts/common.sh@354 -- # echo 1 00:17:31.397 17:37:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:31.397 17:37:08 -- scripts/common.sh@365 -- # decimal 2 00:17:31.397 17:37:08 -- scripts/common.sh@352 -- # local d=2 00:17:31.397 17:37:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:31.397 17:37:08 -- scripts/common.sh@354 -- # echo 2 00:17:31.397 17:37:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:31.397 17:37:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:31.397 17:37:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:31.397 17:37:08 -- scripts/common.sh@367 -- # return 0 00:17:31.397 17:37:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:31.397 17:37:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:31.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.397 --rc genhtml_branch_coverage=1 00:17:31.397 --rc genhtml_function_coverage=1 00:17:31.397 --rc genhtml_legend=1 00:17:31.397 --rc geninfo_all_blocks=1 00:17:31.397 --rc geninfo_unexecuted_blocks=1 00:17:31.397 00:17:31.397 ' 00:17:31.397 17:37:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:31.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.397 --rc genhtml_branch_coverage=1 00:17:31.397 --rc genhtml_function_coverage=1 00:17:31.397 --rc genhtml_legend=1 00:17:31.397 --rc geninfo_all_blocks=1 00:17:31.397 --rc geninfo_unexecuted_blocks=1 00:17:31.397 00:17:31.397 ' 00:17:31.397 17:37:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:31.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.397 --rc genhtml_branch_coverage=1 00:17:31.397 --rc genhtml_function_coverage=1 00:17:31.397 --rc genhtml_legend=1 00:17:31.397 --rc geninfo_all_blocks=1 00:17:31.397 --rc geninfo_unexecuted_blocks=1 00:17:31.397 00:17:31.397 ' 00:17:31.397 17:37:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:31.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.397 --rc genhtml_branch_coverage=1 00:17:31.397 --rc genhtml_function_coverage=1 00:17:31.397 --rc genhtml_legend=1 00:17:31.397 --rc geninfo_all_blocks=1 00:17:31.397 --rc geninfo_unexecuted_blocks=1 00:17:31.397 00:17:31.397 ' 00:17:31.397 17:37:08 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:31.397 17:37:08 -- nvmf/common.sh@7 -- # uname -s 00:17:31.397 17:37:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:31.397 17:37:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:31.397 17:37:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:31.397 17:37:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:31.397 17:37:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:31.397 17:37:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:31.397 17:37:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:31.397 17:37:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:31.397 17:37:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:31.397 17:37:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:31.397 17:37:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:31.397 17:37:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:31.397 17:37:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:31.397 17:37:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:31.397 17:37:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:31.397 17:37:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:31.397 17:37:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:31.397 17:37:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:31.397 17:37:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:31.397 17:37:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.397 17:37:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.397 17:37:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.397 17:37:08 -- paths/export.sh@5 -- # export PATH 00:17:31.397 17:37:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.397 17:37:08 -- nvmf/common.sh@46 -- # : 0 00:17:31.397 17:37:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:31.397 17:37:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:31.397 17:37:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:31.397 17:37:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:31.397 17:37:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:31.397 17:37:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:31.397 17:37:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:31.397 17:37:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:31.397 17:37:08 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:31.397 17:37:08 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:31.397 17:37:08 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:31.397 17:37:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:31.397 17:37:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:31.397 17:37:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:31.397 17:37:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:31.397 17:37:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:31.397 17:37:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:31.397 17:37:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:31.397 17:37:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:31.397 17:37:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:31.397 17:37:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:31.397 17:37:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:31.397 17:37:08 -- common/autotest_common.sh@10 -- # set +x 00:17:33.297 17:37:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:33.297 17:37:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:33.297 17:37:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:33.297 17:37:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:33.297 17:37:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:33.297 17:37:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:33.297 17:37:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:33.297 17:37:10 -- nvmf/common.sh@294 -- # net_devs=() 00:17:33.297 17:37:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:33.297 17:37:10 -- nvmf/common.sh@295 -- # e810=() 00:17:33.297 17:37:10 -- nvmf/common.sh@295 -- # local -ga e810 00:17:33.297 17:37:10 -- nvmf/common.sh@296 -- # x722=() 00:17:33.297 17:37:10 -- nvmf/common.sh@296 -- # local -ga x722 00:17:33.297 17:37:10 -- nvmf/common.sh@297 -- # mlx=() 00:17:33.297 17:37:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:33.297 17:37:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:33.297 17:37:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:33.297 17:37:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:33.297 17:37:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:33.297 17:37:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:33.297 17:37:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:33.297 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:33.297 17:37:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:33.297 17:37:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:33.297 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:33.297 17:37:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:33.297 17:37:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:33.297 17:37:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:33.297 17:37:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:33.297 17:37:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:33.297 17:37:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:33.297 17:37:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:33.297 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:33.297 17:37:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:33.297 17:37:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:33.297 17:37:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:33.297 17:37:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:33.297 17:37:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:33.297 17:37:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:33.297 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:33.297 17:37:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:33.297 17:37:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:33.298 17:37:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:33.298 17:37:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:33.298 17:37:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:33.298 17:37:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:33.298 17:37:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:33.298 17:37:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:33.298 17:37:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:33.298 17:37:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:33.298 17:37:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:33.298 17:37:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:33.298 17:37:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:33.298 17:37:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:33.298 17:37:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:33.298 17:37:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:33.298 17:37:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:33.298 17:37:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:33.298 17:37:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:33.298 17:37:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:33.298 17:37:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:33.298 17:37:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:33.298 17:37:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:33.298 17:37:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:33.298 17:37:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:33.298 17:37:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:33.298 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:33.298 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:17:33.298 00:17:33.298 --- 10.0.0.2 ping statistics --- 00:17:33.298 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:33.298 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:17:33.298 17:37:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:33.298 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:33.298 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:17:33.298 00:17:33.298 --- 10.0.0.1 ping statistics --- 00:17:33.298 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:33.298 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:17:33.298 17:37:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:33.298 17:37:10 -- nvmf/common.sh@410 -- # return 0 00:17:33.298 17:37:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:33.298 17:37:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:33.298 17:37:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:33.298 17:37:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:33.298 17:37:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:33.298 17:37:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:33.298 17:37:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:33.298 17:37:10 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:33.298 17:37:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:33.298 17:37:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:33.298 17:37:10 -- common/autotest_common.sh@10 -- # set +x 00:17:33.298 17:37:10 -- nvmf/common.sh@469 -- # nvmfpid=1575734 00:17:33.298 17:37:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:33.298 17:37:10 -- nvmf/common.sh@470 -- # waitforlisten 1575734 00:17:33.298 17:37:10 -- common/autotest_common.sh@829 -- # '[' -z 1575734 ']' 00:17:33.298 17:37:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:33.298 17:37:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:33.298 17:37:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:33.298 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:33.298 17:37:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:33.298 17:37:10 -- common/autotest_common.sh@10 -- # set +x 00:17:33.298 [2024-11-16 17:37:10.621975] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:33.298 [2024-11-16 17:37:10.622052] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:33.298 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.298 [2024-11-16 17:37:10.690256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.298 [2024-11-16 17:37:10.777254] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:33.298 [2024-11-16 17:37:10.777438] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:33.298 [2024-11-16 17:37:10.777459] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:33.298 [2024-11-16 17:37:10.777474] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:33.298 [2024-11-16 17:37:10.777504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:34.232 17:37:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:34.232 17:37:11 -- common/autotest_common.sh@862 -- # return 0 00:17:34.232 17:37:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:34.232 17:37:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:34.232 17:37:11 -- common/autotest_common.sh@10 -- # set +x 00:17:34.232 17:37:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:34.232 17:37:11 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:34.500 [2024-11-16 17:37:11.825730] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:34.500 17:37:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:34.500 17:37:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:34.500 17:37:11 -- common/autotest_common.sh@10 -- # set +x 00:17:34.500 ************************************ 00:17:34.500 START TEST lvs_grow_clean 00:17:34.500 ************************************ 00:17:34.500 17:37:11 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:34.500 17:37:11 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:34.762 17:37:12 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:34.762 17:37:12 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:35.022 17:37:12 -- target/nvmf_lvs_grow.sh@28 -- # lvs=1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:35.022 17:37:12 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:35.022 17:37:12 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:35.280 17:37:12 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:35.280 17:37:12 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:35.280 17:37:12 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 lvol 150 00:17:35.538 17:37:12 -- target/nvmf_lvs_grow.sh@33 -- # lvol=b3fb5b04-0816-4eeb-8510-6ba55589caee 00:17:35.538 17:37:12 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:35.538 17:37:12 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:35.797 [2024-11-16 17:37:13.229144] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:35.797 [2024-11-16 17:37:13.229247] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:35.797 true 00:17:35.797 17:37:13 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:35.797 17:37:13 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:36.057 17:37:13 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:36.057 17:37:13 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:36.340 17:37:13 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 b3fb5b04-0816-4eeb-8510-6ba55589caee 00:17:36.601 17:37:14 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:36.861 [2024-11-16 17:37:14.288476] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:36.861 17:37:14 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:37.119 17:37:14 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1576316 00:17:37.119 17:37:14 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:37.119 17:37:14 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:37.119 17:37:14 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1576316 /var/tmp/bdevperf.sock 00:17:37.119 17:37:14 -- common/autotest_common.sh@829 -- # '[' -z 1576316 ']' 00:17:37.119 17:37:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:37.119 17:37:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:37.119 17:37:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:37.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:37.119 17:37:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:37.119 17:37:14 -- common/autotest_common.sh@10 -- # set +x 00:17:37.119 [2024-11-16 17:37:14.602985] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:37.120 [2024-11-16 17:37:14.603068] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1576316 ] 00:17:37.377 EAL: No free 2048 kB hugepages reported on node 1 00:17:37.377 [2024-11-16 17:37:14.670826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:37.377 [2024-11-16 17:37:14.759991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:38.313 17:37:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:38.313 17:37:15 -- common/autotest_common.sh@862 -- # return 0 00:17:38.313 17:37:15 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:38.571 Nvme0n1 00:17:38.571 17:37:15 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:38.829 [ 00:17:38.829 { 00:17:38.829 "name": "Nvme0n1", 00:17:38.829 "aliases": [ 00:17:38.829 "b3fb5b04-0816-4eeb-8510-6ba55589caee" 00:17:38.829 ], 00:17:38.829 "product_name": "NVMe disk", 00:17:38.829 "block_size": 4096, 00:17:38.829 "num_blocks": 38912, 00:17:38.829 "uuid": "b3fb5b04-0816-4eeb-8510-6ba55589caee", 00:17:38.829 "assigned_rate_limits": { 00:17:38.829 "rw_ios_per_sec": 0, 00:17:38.829 "rw_mbytes_per_sec": 0, 00:17:38.829 "r_mbytes_per_sec": 0, 00:17:38.829 "w_mbytes_per_sec": 0 00:17:38.829 }, 00:17:38.829 "claimed": false, 00:17:38.829 "zoned": false, 00:17:38.829 "supported_io_types": { 00:17:38.829 "read": true, 00:17:38.829 "write": true, 00:17:38.829 "unmap": true, 00:17:38.829 "write_zeroes": true, 00:17:38.829 "flush": true, 00:17:38.829 "reset": true, 00:17:38.829 "compare": true, 00:17:38.829 "compare_and_write": true, 00:17:38.829 "abort": true, 00:17:38.829 "nvme_admin": true, 00:17:38.829 "nvme_io": true 00:17:38.829 }, 00:17:38.829 "driver_specific": { 00:17:38.829 "nvme": [ 00:17:38.829 { 00:17:38.829 "trid": { 00:17:38.829 "trtype": "TCP", 00:17:38.829 "adrfam": "IPv4", 00:17:38.829 "traddr": "10.0.0.2", 00:17:38.829 "trsvcid": "4420", 00:17:38.829 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:38.829 }, 00:17:38.829 "ctrlr_data": { 00:17:38.829 "cntlid": 1, 00:17:38.829 "vendor_id": "0x8086", 00:17:38.829 "model_number": "SPDK bdev Controller", 00:17:38.829 "serial_number": "SPDK0", 00:17:38.829 "firmware_revision": "24.01.1", 00:17:38.829 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:38.829 "oacs": { 00:17:38.829 "security": 0, 00:17:38.829 "format": 0, 00:17:38.829 "firmware": 0, 00:17:38.829 "ns_manage": 0 00:17:38.829 }, 00:17:38.829 "multi_ctrlr": true, 00:17:38.829 "ana_reporting": false 00:17:38.829 }, 00:17:38.829 "vs": { 00:17:38.829 "nvme_version": "1.3" 00:17:38.829 }, 00:17:38.829 "ns_data": { 00:17:38.829 "id": 1, 00:17:38.829 "can_share": true 00:17:38.829 } 00:17:38.829 } 00:17:38.829 ], 00:17:38.829 "mp_policy": "active_passive" 00:17:38.829 } 00:17:38.829 } 00:17:38.829 ] 00:17:38.829 17:37:16 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1576463 00:17:38.829 17:37:16 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:38.829 17:37:16 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:39.088 Running I/O for 10 seconds... 00:17:40.026 Latency(us) 00:17:40.026 [2024-11-16T16:37:17.518Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.026 [2024-11-16T16:37:17.518Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.026 Nvme0n1 : 1.00 14798.00 57.80 0.00 0.00 0.00 0.00 0.00 00:17:40.026 [2024-11-16T16:37:17.518Z] =================================================================================================================== 00:17:40.026 [2024-11-16T16:37:17.518Z] Total : 14798.00 57.80 0.00 0.00 0.00 0.00 0.00 00:17:40.026 00:17:40.961 17:37:18 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:40.961 [2024-11-16T16:37:18.453Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.961 Nvme0n1 : 2.00 14892.00 58.17 0.00 0.00 0.00 0.00 0.00 00:17:40.961 [2024-11-16T16:37:18.453Z] =================================================================================================================== 00:17:40.961 [2024-11-16T16:37:18.453Z] Total : 14892.00 58.17 0.00 0.00 0.00 0.00 0.00 00:17:40.961 00:17:41.220 true 00:17:41.220 17:37:18 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:41.220 17:37:18 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:41.478 17:37:18 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:41.478 17:37:18 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:41.478 17:37:18 -- target/nvmf_lvs_grow.sh@65 -- # wait 1576463 00:17:42.046 [2024-11-16T16:37:19.539Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.047 Nvme0n1 : 3.00 15008.00 58.62 0.00 0.00 0.00 0.00 0.00 00:17:42.047 [2024-11-16T16:37:19.539Z] =================================================================================================================== 00:17:42.047 [2024-11-16T16:37:19.539Z] Total : 15008.00 58.62 0.00 0.00 0.00 0.00 0.00 00:17:42.047 00:17:42.987 [2024-11-16T16:37:20.479Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.987 Nvme0n1 : 4.00 15050.75 58.79 0.00 0.00 0.00 0.00 0.00 00:17:42.987 [2024-11-16T16:37:20.479Z] =================================================================================================================== 00:17:42.987 [2024-11-16T16:37:20.479Z] Total : 15050.75 58.79 0.00 0.00 0.00 0.00 0.00 00:17:42.987 00:17:43.921 [2024-11-16T16:37:21.413Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.921 Nvme0n1 : 5.00 15117.00 59.05 0.00 0.00 0.00 0.00 0.00 00:17:43.921 [2024-11-16T16:37:21.413Z] =================================================================================================================== 00:17:43.921 [2024-11-16T16:37:21.413Z] Total : 15117.00 59.05 0.00 0.00 0.00 0.00 0.00 00:17:43.921 00:17:45.302 [2024-11-16T16:37:22.794Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.302 Nvme0n1 : 6.00 15180.33 59.30 0.00 0.00 0.00 0.00 0.00 00:17:45.302 [2024-11-16T16:37:22.794Z] =================================================================================================================== 00:17:45.302 [2024-11-16T16:37:22.794Z] Total : 15180.33 59.30 0.00 0.00 0.00 0.00 0.00 00:17:45.302 00:17:46.241 [2024-11-16T16:37:23.733Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:46.241 Nvme0n1 : 7.00 15225.57 59.47 0.00 0.00 0.00 0.00 0.00 00:17:46.241 [2024-11-16T16:37:23.733Z] =================================================================================================================== 00:17:46.241 [2024-11-16T16:37:23.733Z] Total : 15225.57 59.47 0.00 0.00 0.00 0.00 0.00 00:17:46.241 00:17:47.176 [2024-11-16T16:37:24.668Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:47.176 Nvme0n1 : 8.00 15259.50 59.61 0.00 0.00 0.00 0.00 0.00 00:17:47.176 [2024-11-16T16:37:24.668Z] =================================================================================================================== 00:17:47.176 [2024-11-16T16:37:24.668Z] Total : 15259.50 59.61 0.00 0.00 0.00 0.00 0.00 00:17:47.176 00:17:48.112 [2024-11-16T16:37:25.604Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.112 Nvme0n1 : 9.00 15299.67 59.76 0.00 0.00 0.00 0.00 0.00 00:17:48.112 [2024-11-16T16:37:25.604Z] =================================================================================================================== 00:17:48.112 [2024-11-16T16:37:25.604Z] Total : 15299.67 59.76 0.00 0.00 0.00 0.00 0.00 00:17:48.112 00:17:49.051 [2024-11-16T16:37:26.543Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:49.051 Nvme0n1 : 10.00 15325.80 59.87 0.00 0.00 0.00 0.00 0.00 00:17:49.051 [2024-11-16T16:37:26.543Z] =================================================================================================================== 00:17:49.051 [2024-11-16T16:37:26.543Z] Total : 15325.80 59.87 0.00 0.00 0.00 0.00 0.00 00:17:49.051 00:17:49.051 00:17:49.051 Latency(us) 00:17:49.051 [2024-11-16T16:37:26.543Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.051 [2024-11-16T16:37:26.543Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:49.051 Nvme0n1 : 10.01 15332.08 59.89 0.00 0.00 8342.84 3980.71 17670.45 00:17:49.051 [2024-11-16T16:37:26.543Z] =================================================================================================================== 00:17:49.051 [2024-11-16T16:37:26.543Z] Total : 15332.08 59.89 0.00 0.00 8342.84 3980.71 17670.45 00:17:49.051 0 00:17:49.051 17:37:26 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1576316 00:17:49.051 17:37:26 -- common/autotest_common.sh@936 -- # '[' -z 1576316 ']' 00:17:49.051 17:37:26 -- common/autotest_common.sh@940 -- # kill -0 1576316 00:17:49.051 17:37:26 -- common/autotest_common.sh@941 -- # uname 00:17:49.051 17:37:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.051 17:37:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1576316 00:17:49.051 17:37:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:49.051 17:37:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:49.051 17:37:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1576316' 00:17:49.051 killing process with pid 1576316 00:17:49.051 17:37:26 -- common/autotest_common.sh@955 -- # kill 1576316 00:17:49.051 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.051 00:17:49.051 Latency(us) 00:17:49.051 [2024-11-16T16:37:26.543Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.051 [2024-11-16T16:37:26.543Z] =================================================================================================================== 00:17:49.051 [2024-11-16T16:37:26.543Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:49.051 17:37:26 -- common/autotest_common.sh@960 -- # wait 1576316 00:17:49.310 17:37:26 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:49.568 17:37:26 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:49.568 17:37:26 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:49.826 17:37:27 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:49.826 17:37:27 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:49.826 17:37:27 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:50.085 [2024-11-16 17:37:27.433407] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:50.085 17:37:27 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:50.085 17:37:27 -- common/autotest_common.sh@650 -- # local es=0 00:17:50.085 17:37:27 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:50.085 17:37:27 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:50.085 17:37:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.085 17:37:27 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:50.085 17:37:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.085 17:37:27 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:50.085 17:37:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:50.085 17:37:27 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:50.085 17:37:27 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:50.085 17:37:27 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:50.344 request: 00:17:50.344 { 00:17:50.344 "uuid": "1a2d5dc8-7009-4491-bf3b-42300c57c102", 00:17:50.344 "method": "bdev_lvol_get_lvstores", 00:17:50.344 "req_id": 1 00:17:50.344 } 00:17:50.344 Got JSON-RPC error response 00:17:50.344 response: 00:17:50.344 { 00:17:50.344 "code": -19, 00:17:50.344 "message": "No such device" 00:17:50.344 } 00:17:50.344 17:37:27 -- common/autotest_common.sh@653 -- # es=1 00:17:50.344 17:37:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:50.344 17:37:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:50.344 17:37:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:50.344 17:37:27 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:50.603 aio_bdev 00:17:50.603 17:37:27 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev b3fb5b04-0816-4eeb-8510-6ba55589caee 00:17:50.603 17:37:27 -- common/autotest_common.sh@897 -- # local bdev_name=b3fb5b04-0816-4eeb-8510-6ba55589caee 00:17:50.603 17:37:27 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:50.603 17:37:27 -- common/autotest_common.sh@899 -- # local i 00:17:50.603 17:37:27 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:50.603 17:37:27 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:50.603 17:37:27 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:50.862 17:37:28 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b b3fb5b04-0816-4eeb-8510-6ba55589caee -t 2000 00:17:51.121 [ 00:17:51.121 { 00:17:51.121 "name": "b3fb5b04-0816-4eeb-8510-6ba55589caee", 00:17:51.121 "aliases": [ 00:17:51.121 "lvs/lvol" 00:17:51.121 ], 00:17:51.121 "product_name": "Logical Volume", 00:17:51.121 "block_size": 4096, 00:17:51.121 "num_blocks": 38912, 00:17:51.121 "uuid": "b3fb5b04-0816-4eeb-8510-6ba55589caee", 00:17:51.121 "assigned_rate_limits": { 00:17:51.121 "rw_ios_per_sec": 0, 00:17:51.121 "rw_mbytes_per_sec": 0, 00:17:51.121 "r_mbytes_per_sec": 0, 00:17:51.121 "w_mbytes_per_sec": 0 00:17:51.121 }, 00:17:51.121 "claimed": false, 00:17:51.121 "zoned": false, 00:17:51.121 "supported_io_types": { 00:17:51.121 "read": true, 00:17:51.121 "write": true, 00:17:51.121 "unmap": true, 00:17:51.121 "write_zeroes": true, 00:17:51.121 "flush": false, 00:17:51.121 "reset": true, 00:17:51.121 "compare": false, 00:17:51.121 "compare_and_write": false, 00:17:51.121 "abort": false, 00:17:51.121 "nvme_admin": false, 00:17:51.121 "nvme_io": false 00:17:51.121 }, 00:17:51.121 "driver_specific": { 00:17:51.121 "lvol": { 00:17:51.121 "lvol_store_uuid": "1a2d5dc8-7009-4491-bf3b-42300c57c102", 00:17:51.121 "base_bdev": "aio_bdev", 00:17:51.121 "thin_provision": false, 00:17:51.121 "snapshot": false, 00:17:51.121 "clone": false, 00:17:51.121 "esnap_clone": false 00:17:51.121 } 00:17:51.121 } 00:17:51.121 } 00:17:51.121 ] 00:17:51.121 17:37:28 -- common/autotest_common.sh@905 -- # return 0 00:17:51.121 17:37:28 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:51.121 17:37:28 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:51.381 17:37:28 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:51.381 17:37:28 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:51.381 17:37:28 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:51.641 17:37:29 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:51.642 17:37:29 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b3fb5b04-0816-4eeb-8510-6ba55589caee 00:17:51.911 17:37:29 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 1a2d5dc8-7009-4491-bf3b-42300c57c102 00:17:52.173 17:37:29 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:52.432 17:37:29 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:52.432 00:17:52.432 real 0m18.058s 00:17:52.432 user 0m17.767s 00:17:52.432 sys 0m1.899s 00:17:52.432 17:37:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:52.432 17:37:29 -- common/autotest_common.sh@10 -- # set +x 00:17:52.432 ************************************ 00:17:52.432 END TEST lvs_grow_clean 00:17:52.432 ************************************ 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:52.690 17:37:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:52.690 17:37:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:52.690 17:37:29 -- common/autotest_common.sh@10 -- # set +x 00:17:52.690 ************************************ 00:17:52.690 START TEST lvs_grow_dirty 00:17:52.690 ************************************ 00:17:52.690 17:37:29 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:52.690 17:37:29 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:52.949 17:37:30 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:52.949 17:37:30 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:53.208 17:37:30 -- target/nvmf_lvs_grow.sh@28 -- # lvs=c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:17:53.208 17:37:30 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:17:53.208 17:37:30 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:53.468 17:37:30 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:53.468 17:37:30 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:53.468 17:37:30 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b lvol 150 00:17:53.727 17:37:30 -- target/nvmf_lvs_grow.sh@33 -- # lvol=852fa4c9-cf53-4c5e-a6ed-f21e30495acf 00:17:53.727 17:37:30 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:53.727 17:37:30 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:53.985 [2024-11-16 17:37:31.236042] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:53.985 [2024-11-16 17:37:31.236147] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:53.985 true 00:17:53.985 17:37:31 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:17:53.985 17:37:31 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:54.243 17:37:31 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:54.243 17:37:31 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:54.503 17:37:31 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 852fa4c9-cf53-4c5e-a6ed-f21e30495acf 00:17:54.763 17:37:32 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:55.022 17:37:32 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:55.280 17:37:32 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1578449 00:17:55.280 17:37:32 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:55.280 17:37:32 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:55.280 17:37:32 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1578449 /var/tmp/bdevperf.sock 00:17:55.280 17:37:32 -- common/autotest_common.sh@829 -- # '[' -z 1578449 ']' 00:17:55.280 17:37:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:55.280 17:37:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:55.280 17:37:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:55.281 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:55.281 17:37:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:55.281 17:37:32 -- common/autotest_common.sh@10 -- # set +x 00:17:55.281 [2024-11-16 17:37:32.617235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:55.281 [2024-11-16 17:37:32.617316] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1578449 ] 00:17:55.281 EAL: No free 2048 kB hugepages reported on node 1 00:17:55.281 [2024-11-16 17:37:32.682055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:55.539 [2024-11-16 17:37:32.774888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:56.107 17:37:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.107 17:37:33 -- common/autotest_common.sh@862 -- # return 0 00:17:56.107 17:37:33 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:56.678 Nvme0n1 00:17:56.678 17:37:33 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:56.678 [ 00:17:56.678 { 00:17:56.678 "name": "Nvme0n1", 00:17:56.678 "aliases": [ 00:17:56.678 "852fa4c9-cf53-4c5e-a6ed-f21e30495acf" 00:17:56.678 ], 00:17:56.678 "product_name": "NVMe disk", 00:17:56.678 "block_size": 4096, 00:17:56.678 "num_blocks": 38912, 00:17:56.678 "uuid": "852fa4c9-cf53-4c5e-a6ed-f21e30495acf", 00:17:56.678 "assigned_rate_limits": { 00:17:56.678 "rw_ios_per_sec": 0, 00:17:56.678 "rw_mbytes_per_sec": 0, 00:17:56.678 "r_mbytes_per_sec": 0, 00:17:56.678 "w_mbytes_per_sec": 0 00:17:56.678 }, 00:17:56.678 "claimed": false, 00:17:56.678 "zoned": false, 00:17:56.678 "supported_io_types": { 00:17:56.678 "read": true, 00:17:56.678 "write": true, 00:17:56.678 "unmap": true, 00:17:56.678 "write_zeroes": true, 00:17:56.678 "flush": true, 00:17:56.678 "reset": true, 00:17:56.678 "compare": true, 00:17:56.678 "compare_and_write": true, 00:17:56.678 "abort": true, 00:17:56.678 "nvme_admin": true, 00:17:56.678 "nvme_io": true 00:17:56.678 }, 00:17:56.678 "driver_specific": { 00:17:56.678 "nvme": [ 00:17:56.678 { 00:17:56.678 "trid": { 00:17:56.678 "trtype": "TCP", 00:17:56.678 "adrfam": "IPv4", 00:17:56.678 "traddr": "10.0.0.2", 00:17:56.678 "trsvcid": "4420", 00:17:56.678 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:56.678 }, 00:17:56.678 "ctrlr_data": { 00:17:56.678 "cntlid": 1, 00:17:56.678 "vendor_id": "0x8086", 00:17:56.678 "model_number": "SPDK bdev Controller", 00:17:56.678 "serial_number": "SPDK0", 00:17:56.678 "firmware_revision": "24.01.1", 00:17:56.678 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:56.678 "oacs": { 00:17:56.678 "security": 0, 00:17:56.678 "format": 0, 00:17:56.678 "firmware": 0, 00:17:56.678 "ns_manage": 0 00:17:56.678 }, 00:17:56.678 "multi_ctrlr": true, 00:17:56.678 "ana_reporting": false 00:17:56.678 }, 00:17:56.678 "vs": { 00:17:56.678 "nvme_version": "1.3" 00:17:56.678 }, 00:17:56.678 "ns_data": { 00:17:56.678 "id": 1, 00:17:56.678 "can_share": true 00:17:56.678 } 00:17:56.678 } 00:17:56.678 ], 00:17:56.678 "mp_policy": "active_passive" 00:17:56.678 } 00:17:56.678 } 00:17:56.678 ] 00:17:56.938 17:37:34 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1578722 00:17:56.938 17:37:34 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:56.938 17:37:34 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:56.938 Running I/O for 10 seconds... 00:17:57.877 Latency(us) 00:17:57.877 [2024-11-16T16:37:35.369Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.877 [2024-11-16T16:37:35.369Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:57.877 Nvme0n1 : 1.00 13852.00 54.11 0.00 0.00 0.00 0.00 0.00 00:17:57.877 [2024-11-16T16:37:35.369Z] =================================================================================================================== 00:17:57.877 [2024-11-16T16:37:35.369Z] Total : 13852.00 54.11 0.00 0.00 0.00 0.00 0.00 00:17:57.877 00:17:58.812 17:37:36 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:17:58.812 [2024-11-16T16:37:36.304Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.812 Nvme0n1 : 2.00 14026.00 54.79 0.00 0.00 0.00 0.00 0.00 00:17:58.812 [2024-11-16T16:37:36.304Z] =================================================================================================================== 00:17:58.812 [2024-11-16T16:37:36.304Z] Total : 14026.00 54.79 0.00 0.00 0.00 0.00 0.00 00:17:58.812 00:17:59.071 true 00:17:59.071 17:37:36 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:17:59.071 17:37:36 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:59.330 17:37:36 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:59.330 17:37:36 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:59.330 17:37:36 -- target/nvmf_lvs_grow.sh@65 -- # wait 1578722 00:17:59.898 [2024-11-16T16:37:37.390Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.898 Nvme0n1 : 3.00 14089.33 55.04 0.00 0.00 0.00 0.00 0.00 00:17:59.898 [2024-11-16T16:37:37.390Z] =================================================================================================================== 00:17:59.898 [2024-11-16T16:37:37.390Z] Total : 14089.33 55.04 0.00 0.00 0.00 0.00 0.00 00:17:59.898 00:18:00.835 [2024-11-16T16:37:38.327Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.835 Nvme0n1 : 4.00 14163.00 55.32 0.00 0.00 0.00 0.00 0.00 00:18:00.835 [2024-11-16T16:37:38.327Z] =================================================================================================================== 00:18:00.835 [2024-11-16T16:37:38.327Z] Total : 14163.00 55.32 0.00 0.00 0.00 0.00 0.00 00:18:00.835 00:18:02.221 [2024-11-16T16:37:39.713Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.221 Nvme0n1 : 5.00 14221.60 55.55 0.00 0.00 0.00 0.00 0.00 00:18:02.221 [2024-11-16T16:37:39.713Z] =================================================================================================================== 00:18:02.221 [2024-11-16T16:37:39.713Z] Total : 14221.60 55.55 0.00 0.00 0.00 0.00 0.00 00:18:02.221 00:18:03.162 [2024-11-16T16:37:40.654Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:03.162 Nvme0n1 : 6.00 14274.00 55.76 0.00 0.00 0.00 0.00 0.00 00:18:03.162 [2024-11-16T16:37:40.654Z] =================================================================================================================== 00:18:03.162 [2024-11-16T16:37:40.654Z] Total : 14274.00 55.76 0.00 0.00 0.00 0.00 0.00 00:18:03.162 00:18:04.101 [2024-11-16T16:37:41.593Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.101 Nvme0n1 : 7.00 14324.00 55.95 0.00 0.00 0.00 0.00 0.00 00:18:04.101 [2024-11-16T16:37:41.593Z] =================================================================================================================== 00:18:04.101 [2024-11-16T16:37:41.593Z] Total : 14324.00 55.95 0.00 0.00 0.00 0.00 0.00 00:18:04.101 00:18:05.042 [2024-11-16T16:37:42.534Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.042 Nvme0n1 : 8.00 14359.50 56.09 0.00 0.00 0.00 0.00 0.00 00:18:05.042 [2024-11-16T16:37:42.534Z] =================================================================================================================== 00:18:05.042 [2024-11-16T16:37:42.534Z] Total : 14359.50 56.09 0.00 0.00 0.00 0.00 0.00 00:18:05.042 00:18:05.981 [2024-11-16T16:37:43.473Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.981 Nvme0n1 : 9.00 14388.89 56.21 0.00 0.00 0.00 0.00 0.00 00:18:05.981 [2024-11-16T16:37:43.473Z] =================================================================================================================== 00:18:05.981 [2024-11-16T16:37:43.473Z] Total : 14388.89 56.21 0.00 0.00 0.00 0.00 0.00 00:18:05.981 00:18:06.914 [2024-11-16T16:37:44.406Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:06.914 Nvme0n1 : 10.00 14417.20 56.32 0.00 0.00 0.00 0.00 0.00 00:18:06.914 [2024-11-16T16:37:44.406Z] =================================================================================================================== 00:18:06.914 [2024-11-16T16:37:44.406Z] Total : 14417.20 56.32 0.00 0.00 0.00 0.00 0.00 00:18:06.914 00:18:06.914 00:18:06.914 Latency(us) 00:18:06.914 [2024-11-16T16:37:44.406Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:06.914 [2024-11-16T16:37:44.406Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:06.914 Nvme0n1 : 10.01 14417.92 56.32 0.00 0.00 8870.35 4636.07 13883.92 00:18:06.914 [2024-11-16T16:37:44.406Z] =================================================================================================================== 00:18:06.914 [2024-11-16T16:37:44.406Z] Total : 14417.92 56.32 0.00 0.00 8870.35 4636.07 13883.92 00:18:06.914 0 00:18:06.914 17:37:44 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1578449 00:18:06.914 17:37:44 -- common/autotest_common.sh@936 -- # '[' -z 1578449 ']' 00:18:06.914 17:37:44 -- common/autotest_common.sh@940 -- # kill -0 1578449 00:18:06.914 17:37:44 -- common/autotest_common.sh@941 -- # uname 00:18:06.914 17:37:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:06.914 17:37:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1578449 00:18:06.914 17:37:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:06.914 17:37:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:06.914 17:37:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1578449' 00:18:06.914 killing process with pid 1578449 00:18:06.914 17:37:44 -- common/autotest_common.sh@955 -- # kill 1578449 00:18:06.914 Received shutdown signal, test time was about 10.000000 seconds 00:18:06.914 00:18:06.914 Latency(us) 00:18:06.914 [2024-11-16T16:37:44.406Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:06.914 [2024-11-16T16:37:44.406Z] =================================================================================================================== 00:18:06.914 [2024-11-16T16:37:44.406Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:06.914 17:37:44 -- common/autotest_common.sh@960 -- # wait 1578449 00:18:07.171 17:37:44 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:07.429 17:37:44 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:07.429 17:37:44 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:07.687 17:37:45 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:07.687 17:37:45 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:07.687 17:37:45 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1575734 00:18:07.687 17:37:45 -- target/nvmf_lvs_grow.sh@74 -- # wait 1575734 00:18:07.945 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1575734 Killed "${NVMF_APP[@]}" "$@" 00:18:07.945 17:37:45 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:07.945 17:37:45 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:07.945 17:37:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:07.945 17:37:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:07.945 17:37:45 -- common/autotest_common.sh@10 -- # set +x 00:18:07.945 17:37:45 -- nvmf/common.sh@469 -- # nvmfpid=1580082 00:18:07.945 17:37:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:07.945 17:37:45 -- nvmf/common.sh@470 -- # waitforlisten 1580082 00:18:07.945 17:37:45 -- common/autotest_common.sh@829 -- # '[' -z 1580082 ']' 00:18:07.945 17:37:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:07.945 17:37:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:07.945 17:37:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:07.945 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:07.945 17:37:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:07.945 17:37:45 -- common/autotest_common.sh@10 -- # set +x 00:18:07.945 [2024-11-16 17:37:45.231798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:07.945 [2024-11-16 17:37:45.231895] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:07.945 EAL: No free 2048 kB hugepages reported on node 1 00:18:07.945 [2024-11-16 17:37:45.296223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:07.945 [2024-11-16 17:37:45.378309] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:07.945 [2024-11-16 17:37:45.378465] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:07.945 [2024-11-16 17:37:45.378482] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:07.945 [2024-11-16 17:37:45.378494] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:07.945 [2024-11-16 17:37:45.378531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:08.884 17:37:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:08.884 17:37:46 -- common/autotest_common.sh@862 -- # return 0 00:18:08.884 17:37:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:08.884 17:37:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:08.884 17:37:46 -- common/autotest_common.sh@10 -- # set +x 00:18:08.884 17:37:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:08.884 17:37:46 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:09.146 [2024-11-16 17:37:46.457393] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:09.146 [2024-11-16 17:37:46.457553] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:09.146 [2024-11-16 17:37:46.457611] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:09.146 17:37:46 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:09.146 17:37:46 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 852fa4c9-cf53-4c5e-a6ed-f21e30495acf 00:18:09.146 17:37:46 -- common/autotest_common.sh@897 -- # local bdev_name=852fa4c9-cf53-4c5e-a6ed-f21e30495acf 00:18:09.146 17:37:46 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:09.146 17:37:46 -- common/autotest_common.sh@899 -- # local i 00:18:09.146 17:37:46 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:09.146 17:37:46 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:09.146 17:37:46 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:09.451 17:37:46 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 852fa4c9-cf53-4c5e-a6ed-f21e30495acf -t 2000 00:18:09.743 [ 00:18:09.743 { 00:18:09.743 "name": "852fa4c9-cf53-4c5e-a6ed-f21e30495acf", 00:18:09.743 "aliases": [ 00:18:09.743 "lvs/lvol" 00:18:09.743 ], 00:18:09.743 "product_name": "Logical Volume", 00:18:09.743 "block_size": 4096, 00:18:09.743 "num_blocks": 38912, 00:18:09.743 "uuid": "852fa4c9-cf53-4c5e-a6ed-f21e30495acf", 00:18:09.743 "assigned_rate_limits": { 00:18:09.743 "rw_ios_per_sec": 0, 00:18:09.743 "rw_mbytes_per_sec": 0, 00:18:09.743 "r_mbytes_per_sec": 0, 00:18:09.743 "w_mbytes_per_sec": 0 00:18:09.743 }, 00:18:09.743 "claimed": false, 00:18:09.743 "zoned": false, 00:18:09.743 "supported_io_types": { 00:18:09.743 "read": true, 00:18:09.743 "write": true, 00:18:09.743 "unmap": true, 00:18:09.743 "write_zeroes": true, 00:18:09.743 "flush": false, 00:18:09.743 "reset": true, 00:18:09.743 "compare": false, 00:18:09.743 "compare_and_write": false, 00:18:09.743 "abort": false, 00:18:09.743 "nvme_admin": false, 00:18:09.743 "nvme_io": false 00:18:09.743 }, 00:18:09.743 "driver_specific": { 00:18:09.743 "lvol": { 00:18:09.743 "lvol_store_uuid": "c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b", 00:18:09.743 "base_bdev": "aio_bdev", 00:18:09.743 "thin_provision": false, 00:18:09.743 "snapshot": false, 00:18:09.743 "clone": false, 00:18:09.743 "esnap_clone": false 00:18:09.743 } 00:18:09.743 } 00:18:09.743 } 00:18:09.743 ] 00:18:09.743 17:37:47 -- common/autotest_common.sh@905 -- # return 0 00:18:09.743 17:37:47 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:09.743 17:37:47 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:10.003 17:37:47 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:10.003 17:37:47 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:10.003 17:37:47 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:10.263 17:37:47 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:10.263 17:37:47 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:10.522 [2024-11-16 17:37:47.786545] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:10.522 17:37:47 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:10.522 17:37:47 -- common/autotest_common.sh@650 -- # local es=0 00:18:10.522 17:37:47 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:10.522 17:37:47 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.522 17:37:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:10.522 17:37:47 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.522 17:37:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:10.522 17:37:47 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.522 17:37:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:10.522 17:37:47 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:10.522 17:37:47 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:10.522 17:37:47 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:10.780 request: 00:18:10.780 { 00:18:10.780 "uuid": "c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b", 00:18:10.781 "method": "bdev_lvol_get_lvstores", 00:18:10.781 "req_id": 1 00:18:10.781 } 00:18:10.781 Got JSON-RPC error response 00:18:10.781 response: 00:18:10.781 { 00:18:10.781 "code": -19, 00:18:10.781 "message": "No such device" 00:18:10.781 } 00:18:10.781 17:37:48 -- common/autotest_common.sh@653 -- # es=1 00:18:10.781 17:37:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:10.781 17:37:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:10.781 17:37:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:10.781 17:37:48 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:11.038 aio_bdev 00:18:11.038 17:37:48 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 852fa4c9-cf53-4c5e-a6ed-f21e30495acf 00:18:11.038 17:37:48 -- common/autotest_common.sh@897 -- # local bdev_name=852fa4c9-cf53-4c5e-a6ed-f21e30495acf 00:18:11.038 17:37:48 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:11.038 17:37:48 -- common/autotest_common.sh@899 -- # local i 00:18:11.038 17:37:48 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:11.038 17:37:48 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:11.038 17:37:48 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:11.298 17:37:48 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 852fa4c9-cf53-4c5e-a6ed-f21e30495acf -t 2000 00:18:11.557 [ 00:18:11.557 { 00:18:11.557 "name": "852fa4c9-cf53-4c5e-a6ed-f21e30495acf", 00:18:11.557 "aliases": [ 00:18:11.557 "lvs/lvol" 00:18:11.557 ], 00:18:11.557 "product_name": "Logical Volume", 00:18:11.557 "block_size": 4096, 00:18:11.557 "num_blocks": 38912, 00:18:11.557 "uuid": "852fa4c9-cf53-4c5e-a6ed-f21e30495acf", 00:18:11.557 "assigned_rate_limits": { 00:18:11.557 "rw_ios_per_sec": 0, 00:18:11.557 "rw_mbytes_per_sec": 0, 00:18:11.557 "r_mbytes_per_sec": 0, 00:18:11.557 "w_mbytes_per_sec": 0 00:18:11.557 }, 00:18:11.557 "claimed": false, 00:18:11.557 "zoned": false, 00:18:11.557 "supported_io_types": { 00:18:11.557 "read": true, 00:18:11.557 "write": true, 00:18:11.557 "unmap": true, 00:18:11.558 "write_zeroes": true, 00:18:11.558 "flush": false, 00:18:11.558 "reset": true, 00:18:11.558 "compare": false, 00:18:11.558 "compare_and_write": false, 00:18:11.558 "abort": false, 00:18:11.558 "nvme_admin": false, 00:18:11.558 "nvme_io": false 00:18:11.558 }, 00:18:11.558 "driver_specific": { 00:18:11.558 "lvol": { 00:18:11.558 "lvol_store_uuid": "c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b", 00:18:11.558 "base_bdev": "aio_bdev", 00:18:11.558 "thin_provision": false, 00:18:11.558 "snapshot": false, 00:18:11.558 "clone": false, 00:18:11.558 "esnap_clone": false 00:18:11.558 } 00:18:11.558 } 00:18:11.558 } 00:18:11.558 ] 00:18:11.558 17:37:48 -- common/autotest_common.sh@905 -- # return 0 00:18:11.558 17:37:48 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:11.558 17:37:48 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:11.817 17:37:49 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:11.817 17:37:49 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:11.817 17:37:49 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:12.077 17:37:49 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:12.077 17:37:49 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 852fa4c9-cf53-4c5e-a6ed-f21e30495acf 00:18:12.336 17:37:49 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c2bc0fdf-c649-45ed-b242-6ac0c62c4f9b 00:18:12.595 17:37:49 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:12.852 17:37:50 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:12.852 00:18:12.852 real 0m20.273s 00:18:12.852 user 0m50.538s 00:18:12.852 sys 0m4.932s 00:18:12.852 17:37:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:12.852 17:37:50 -- common/autotest_common.sh@10 -- # set +x 00:18:12.852 ************************************ 00:18:12.852 END TEST lvs_grow_dirty 00:18:12.852 ************************************ 00:18:12.852 17:37:50 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:12.852 17:37:50 -- common/autotest_common.sh@806 -- # type=--id 00:18:12.852 17:37:50 -- common/autotest_common.sh@807 -- # id=0 00:18:12.852 17:37:50 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:12.852 17:37:50 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:12.852 17:37:50 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:12.852 17:37:50 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:12.852 17:37:50 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:12.853 17:37:50 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:12.853 nvmf_trace.0 00:18:12.853 17:37:50 -- common/autotest_common.sh@821 -- # return 0 00:18:12.853 17:37:50 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:12.853 17:37:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:12.853 17:37:50 -- nvmf/common.sh@116 -- # sync 00:18:12.853 17:37:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:12.853 17:37:50 -- nvmf/common.sh@119 -- # set +e 00:18:12.853 17:37:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:12.853 17:37:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:12.853 rmmod nvme_tcp 00:18:12.853 rmmod nvme_fabrics 00:18:12.853 rmmod nvme_keyring 00:18:12.853 17:37:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:12.853 17:37:50 -- nvmf/common.sh@123 -- # set -e 00:18:12.853 17:37:50 -- nvmf/common.sh@124 -- # return 0 00:18:12.853 17:37:50 -- nvmf/common.sh@477 -- # '[' -n 1580082 ']' 00:18:12.853 17:37:50 -- nvmf/common.sh@478 -- # killprocess 1580082 00:18:12.853 17:37:50 -- common/autotest_common.sh@936 -- # '[' -z 1580082 ']' 00:18:12.853 17:37:50 -- common/autotest_common.sh@940 -- # kill -0 1580082 00:18:12.853 17:37:50 -- common/autotest_common.sh@941 -- # uname 00:18:12.853 17:37:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.853 17:37:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1580082 00:18:13.111 17:37:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:13.111 17:37:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:13.111 17:37:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1580082' 00:18:13.111 killing process with pid 1580082 00:18:13.111 17:37:50 -- common/autotest_common.sh@955 -- # kill 1580082 00:18:13.111 17:37:50 -- common/autotest_common.sh@960 -- # wait 1580082 00:18:13.111 17:37:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:13.111 17:37:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:13.111 17:37:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:13.111 17:37:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:13.111 17:37:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:13.111 17:37:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.111 17:37:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.111 17:37:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.651 17:37:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:15.651 00:18:15.651 real 0m44.218s 00:18:15.651 user 1m14.921s 00:18:15.651 sys 0m8.679s 00:18:15.651 17:37:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:15.651 17:37:52 -- common/autotest_common.sh@10 -- # set +x 00:18:15.651 ************************************ 00:18:15.651 END TEST nvmf_lvs_grow 00:18:15.651 ************************************ 00:18:15.651 17:37:52 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:15.651 17:37:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:15.651 17:37:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:15.651 17:37:52 -- common/autotest_common.sh@10 -- # set +x 00:18:15.652 ************************************ 00:18:15.652 START TEST nvmf_bdev_io_wait 00:18:15.652 ************************************ 00:18:15.652 17:37:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:15.652 * Looking for test storage... 00:18:15.652 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:15.652 17:37:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:15.652 17:37:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:15.652 17:37:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:15.652 17:37:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:15.652 17:37:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:15.652 17:37:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:15.652 17:37:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:15.652 17:37:52 -- scripts/common.sh@335 -- # IFS=.-: 00:18:15.652 17:37:52 -- scripts/common.sh@335 -- # read -ra ver1 00:18:15.652 17:37:52 -- scripts/common.sh@336 -- # IFS=.-: 00:18:15.652 17:37:52 -- scripts/common.sh@336 -- # read -ra ver2 00:18:15.652 17:37:52 -- scripts/common.sh@337 -- # local 'op=<' 00:18:15.652 17:37:52 -- scripts/common.sh@339 -- # ver1_l=2 00:18:15.652 17:37:52 -- scripts/common.sh@340 -- # ver2_l=1 00:18:15.652 17:37:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:15.652 17:37:52 -- scripts/common.sh@343 -- # case "$op" in 00:18:15.652 17:37:52 -- scripts/common.sh@344 -- # : 1 00:18:15.652 17:37:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:15.652 17:37:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:15.652 17:37:52 -- scripts/common.sh@364 -- # decimal 1 00:18:15.652 17:37:52 -- scripts/common.sh@352 -- # local d=1 00:18:15.652 17:37:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:15.652 17:37:52 -- scripts/common.sh@354 -- # echo 1 00:18:15.652 17:37:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:15.652 17:37:52 -- scripts/common.sh@365 -- # decimal 2 00:18:15.652 17:37:52 -- scripts/common.sh@352 -- # local d=2 00:18:15.652 17:37:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:15.652 17:37:52 -- scripts/common.sh@354 -- # echo 2 00:18:15.652 17:37:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:15.652 17:37:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:15.652 17:37:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:15.652 17:37:52 -- scripts/common.sh@367 -- # return 0 00:18:15.652 17:37:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:15.652 17:37:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:15.652 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.652 --rc genhtml_branch_coverage=1 00:18:15.652 --rc genhtml_function_coverage=1 00:18:15.652 --rc genhtml_legend=1 00:18:15.652 --rc geninfo_all_blocks=1 00:18:15.652 --rc geninfo_unexecuted_blocks=1 00:18:15.652 00:18:15.652 ' 00:18:15.652 17:37:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:15.652 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.652 --rc genhtml_branch_coverage=1 00:18:15.652 --rc genhtml_function_coverage=1 00:18:15.652 --rc genhtml_legend=1 00:18:15.652 --rc geninfo_all_blocks=1 00:18:15.652 --rc geninfo_unexecuted_blocks=1 00:18:15.652 00:18:15.652 ' 00:18:15.652 17:37:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:15.652 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.652 --rc genhtml_branch_coverage=1 00:18:15.652 --rc genhtml_function_coverage=1 00:18:15.652 --rc genhtml_legend=1 00:18:15.652 --rc geninfo_all_blocks=1 00:18:15.652 --rc geninfo_unexecuted_blocks=1 00:18:15.652 00:18:15.652 ' 00:18:15.652 17:37:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:15.652 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:15.652 --rc genhtml_branch_coverage=1 00:18:15.652 --rc genhtml_function_coverage=1 00:18:15.652 --rc genhtml_legend=1 00:18:15.652 --rc geninfo_all_blocks=1 00:18:15.652 --rc geninfo_unexecuted_blocks=1 00:18:15.652 00:18:15.652 ' 00:18:15.652 17:37:52 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:15.652 17:37:52 -- nvmf/common.sh@7 -- # uname -s 00:18:15.652 17:37:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:15.652 17:37:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:15.652 17:37:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:15.652 17:37:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:15.652 17:37:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:15.652 17:37:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:15.652 17:37:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:15.652 17:37:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:15.652 17:37:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:15.652 17:37:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:15.652 17:37:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:15.652 17:37:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:15.652 17:37:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:15.652 17:37:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:15.652 17:37:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:15.652 17:37:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:15.652 17:37:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:15.652 17:37:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:15.652 17:37:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:15.652 17:37:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.652 17:37:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.652 17:37:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.652 17:37:52 -- paths/export.sh@5 -- # export PATH 00:18:15.652 17:37:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:15.652 17:37:52 -- nvmf/common.sh@46 -- # : 0 00:18:15.652 17:37:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:15.652 17:37:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:15.652 17:37:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:15.652 17:37:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:15.652 17:37:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:15.652 17:37:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:15.652 17:37:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:15.652 17:37:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:15.652 17:37:52 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:15.652 17:37:52 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:15.652 17:37:52 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:15.652 17:37:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:15.652 17:37:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:15.652 17:37:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:15.652 17:37:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:15.652 17:37:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:15.652 17:37:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:15.652 17:37:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:15.652 17:37:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:15.652 17:37:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:15.652 17:37:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:15.652 17:37:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:15.652 17:37:52 -- common/autotest_common.sh@10 -- # set +x 00:18:17.559 17:37:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:17.559 17:37:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:17.559 17:37:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:17.559 17:37:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:17.559 17:37:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:17.559 17:37:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:17.559 17:37:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:17.559 17:37:54 -- nvmf/common.sh@294 -- # net_devs=() 00:18:17.559 17:37:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:17.559 17:37:54 -- nvmf/common.sh@295 -- # e810=() 00:18:17.559 17:37:54 -- nvmf/common.sh@295 -- # local -ga e810 00:18:17.559 17:37:54 -- nvmf/common.sh@296 -- # x722=() 00:18:17.559 17:37:54 -- nvmf/common.sh@296 -- # local -ga x722 00:18:17.559 17:37:54 -- nvmf/common.sh@297 -- # mlx=() 00:18:17.559 17:37:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:17.559 17:37:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:17.559 17:37:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:17.559 17:37:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:17.559 17:37:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:17.559 17:37:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:17.559 17:37:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:17.559 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:17.559 17:37:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:17.559 17:37:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:17.559 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:17.559 17:37:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:17.559 17:37:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:17.559 17:37:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:17.559 17:37:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:17.559 17:37:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:17.559 17:37:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:17.559 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:17.559 17:37:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:17.559 17:37:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:17.559 17:37:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:17.559 17:37:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:17.559 17:37:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:17.559 17:37:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:17.559 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:17.559 17:37:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:17.559 17:37:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:17.559 17:37:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:17.559 17:37:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:17.559 17:37:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:17.559 17:37:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:17.559 17:37:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:17.559 17:37:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:17.559 17:37:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:17.559 17:37:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:17.559 17:37:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:17.559 17:37:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:17.559 17:37:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:17.559 17:37:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:17.559 17:37:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:17.559 17:37:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:17.559 17:37:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:17.559 17:37:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:17.559 17:37:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:17.560 17:37:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:17.560 17:37:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:17.560 17:37:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:17.560 17:37:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:17.560 17:37:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:17.560 17:37:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:17.560 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:17.560 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:18:17.560 00:18:17.560 --- 10.0.0.2 ping statistics --- 00:18:17.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:17.560 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:18:17.560 17:37:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:17.560 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:17.560 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:18:17.560 00:18:17.560 --- 10.0.0.1 ping statistics --- 00:18:17.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:17.560 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:18:17.560 17:37:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:17.560 17:37:54 -- nvmf/common.sh@410 -- # return 0 00:18:17.560 17:37:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:17.560 17:37:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:17.560 17:37:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:17.560 17:37:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:17.560 17:37:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:17.560 17:37:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:17.560 17:37:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:17.560 17:37:54 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:17.560 17:37:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:17.560 17:37:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:17.560 17:37:54 -- common/autotest_common.sh@10 -- # set +x 00:18:17.560 17:37:54 -- nvmf/common.sh@469 -- # nvmfpid=1582647 00:18:17.560 17:37:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:17.560 17:37:54 -- nvmf/common.sh@470 -- # waitforlisten 1582647 00:18:17.560 17:37:54 -- common/autotest_common.sh@829 -- # '[' -z 1582647 ']' 00:18:17.560 17:37:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:17.560 17:37:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:17.560 17:37:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:17.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:17.560 17:37:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:17.560 17:37:54 -- common/autotest_common.sh@10 -- # set +x 00:18:17.560 [2024-11-16 17:37:55.026009] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:17.560 [2024-11-16 17:37:55.026084] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:17.818 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.818 [2024-11-16 17:37:55.096422] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:17.818 [2024-11-16 17:37:55.187362] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:17.818 [2024-11-16 17:37:55.187526] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:17.818 [2024-11-16 17:37:55.187545] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:17.818 [2024-11-16 17:37:55.187559] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:17.818 [2024-11-16 17:37:55.187681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:17.818 [2024-11-16 17:37:55.187708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:17.818 [2024-11-16 17:37:55.187778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:17.818 [2024-11-16 17:37:55.187780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:17.818 17:37:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:17.818 17:37:55 -- common/autotest_common.sh@862 -- # return 0 00:18:17.818 17:37:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:17.818 17:37:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:17.818 17:37:55 -- common/autotest_common.sh@10 -- # set +x 00:18:17.818 17:37:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:17.818 17:37:55 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:17.818 17:37:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.818 17:37:55 -- common/autotest_common.sh@10 -- # set +x 00:18:17.818 17:37:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.818 17:37:55 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:17.818 17:37:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.818 17:37:55 -- common/autotest_common.sh@10 -- # set +x 00:18:18.077 17:37:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:18.077 17:37:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.077 17:37:55 -- common/autotest_common.sh@10 -- # set +x 00:18:18.077 [2024-11-16 17:37:55.340410] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:18.077 17:37:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:18.077 17:37:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.077 17:37:55 -- common/autotest_common.sh@10 -- # set +x 00:18:18.077 Malloc0 00:18:18.077 17:37:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:18.077 17:37:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.077 17:37:55 -- common/autotest_common.sh@10 -- # set +x 00:18:18.077 17:37:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:18.077 17:37:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.077 17:37:55 -- common/autotest_common.sh@10 -- # set +x 00:18:18.077 17:37:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:18.077 17:37:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:18.077 17:37:55 -- common/autotest_common.sh@10 -- # set +x 00:18:18.077 [2024-11-16 17:37:55.403164] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:18.077 17:37:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1582795 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@30 -- # READ_PID=1582797 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:18.077 17:37:55 -- nvmf/common.sh@520 -- # config=() 00:18:18.077 17:37:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1582799 00:18:18.077 17:37:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:18.077 17:37:55 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:18.078 17:37:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.078 { 00:18:18.078 "params": { 00:18:18.078 "name": "Nvme$subsystem", 00:18:18.078 "trtype": "$TEST_TRANSPORT", 00:18:18.078 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.078 "adrfam": "ipv4", 00:18:18.078 "trsvcid": "$NVMF_PORT", 00:18:18.078 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.078 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.078 "hdgst": ${hdgst:-false}, 00:18:18.078 "ddgst": ${ddgst:-false} 00:18:18.078 }, 00:18:18.078 "method": "bdev_nvme_attach_controller" 00:18:18.078 } 00:18:18.078 EOF 00:18:18.078 )") 00:18:18.078 17:37:55 -- nvmf/common.sh@520 -- # config=() 00:18:18.078 17:37:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.078 17:37:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.078 17:37:55 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1582801 00:18:18.078 17:37:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.078 { 00:18:18.078 "params": { 00:18:18.078 "name": "Nvme$subsystem", 00:18:18.078 "trtype": "$TEST_TRANSPORT", 00:18:18.078 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.078 "adrfam": "ipv4", 00:18:18.078 "trsvcid": "$NVMF_PORT", 00:18:18.078 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.078 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.078 "hdgst": ${hdgst:-false}, 00:18:18.078 "ddgst": ${ddgst:-false} 00:18:18.078 }, 00:18:18.078 "method": "bdev_nvme_attach_controller" 00:18:18.078 } 00:18:18.078 EOF 00:18:18.078 )") 00:18:18.078 17:37:55 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:18.078 17:37:55 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:18.078 17:37:55 -- target/bdev_io_wait.sh@35 -- # sync 00:18:18.078 17:37:55 -- nvmf/common.sh@520 -- # config=() 00:18:18.078 17:37:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.078 17:37:55 -- nvmf/common.sh@542 -- # cat 00:18:18.078 17:37:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.078 17:37:55 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:18.078 17:37:55 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:18.078 17:37:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.078 { 00:18:18.078 "params": { 00:18:18.078 "name": "Nvme$subsystem", 00:18:18.078 "trtype": "$TEST_TRANSPORT", 00:18:18.078 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.078 "adrfam": "ipv4", 00:18:18.078 "trsvcid": "$NVMF_PORT", 00:18:18.078 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.078 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.078 "hdgst": ${hdgst:-false}, 00:18:18.078 "ddgst": ${ddgst:-false} 00:18:18.078 }, 00:18:18.078 "method": "bdev_nvme_attach_controller" 00:18:18.078 } 00:18:18.078 EOF 00:18:18.078 )") 00:18:18.078 17:37:55 -- nvmf/common.sh@520 -- # config=() 00:18:18.078 17:37:55 -- nvmf/common.sh@520 -- # local subsystem config 00:18:18.078 17:37:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:18.078 17:37:55 -- nvmf/common.sh@542 -- # cat 00:18:18.078 17:37:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:18.078 { 00:18:18.078 "params": { 00:18:18.078 "name": "Nvme$subsystem", 00:18:18.078 "trtype": "$TEST_TRANSPORT", 00:18:18.078 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:18.078 "adrfam": "ipv4", 00:18:18.078 "trsvcid": "$NVMF_PORT", 00:18:18.078 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:18.078 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:18.078 "hdgst": ${hdgst:-false}, 00:18:18.078 "ddgst": ${ddgst:-false} 00:18:18.078 }, 00:18:18.078 "method": "bdev_nvme_attach_controller" 00:18:18.078 } 00:18:18.078 EOF 00:18:18.078 )") 00:18:18.078 17:37:55 -- nvmf/common.sh@542 -- # cat 00:18:18.078 17:37:55 -- target/bdev_io_wait.sh@37 -- # wait 1582795 00:18:18.078 17:37:55 -- nvmf/common.sh@542 -- # cat 00:18:18.078 17:37:55 -- nvmf/common.sh@544 -- # jq . 00:18:18.078 17:37:55 -- nvmf/common.sh@544 -- # jq . 00:18:18.078 17:37:55 -- nvmf/common.sh@544 -- # jq . 00:18:18.078 17:37:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.078 17:37:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.078 "params": { 00:18:18.078 "name": "Nvme1", 00:18:18.078 "trtype": "tcp", 00:18:18.078 "traddr": "10.0.0.2", 00:18:18.078 "adrfam": "ipv4", 00:18:18.078 "trsvcid": "4420", 00:18:18.078 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.078 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.078 "hdgst": false, 00:18:18.078 "ddgst": false 00:18:18.078 }, 00:18:18.078 "method": "bdev_nvme_attach_controller" 00:18:18.078 }' 00:18:18.078 17:37:55 -- nvmf/common.sh@544 -- # jq . 00:18:18.078 17:37:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.078 17:37:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.078 "params": { 00:18:18.078 "name": "Nvme1", 00:18:18.078 "trtype": "tcp", 00:18:18.078 "traddr": "10.0.0.2", 00:18:18.078 "adrfam": "ipv4", 00:18:18.078 "trsvcid": "4420", 00:18:18.078 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.078 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.078 "hdgst": false, 00:18:18.078 "ddgst": false 00:18:18.078 }, 00:18:18.078 "method": "bdev_nvme_attach_controller" 00:18:18.078 }' 00:18:18.078 17:37:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.078 17:37:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.078 "params": { 00:18:18.078 "name": "Nvme1", 00:18:18.078 "trtype": "tcp", 00:18:18.078 "traddr": "10.0.0.2", 00:18:18.078 "adrfam": "ipv4", 00:18:18.078 "trsvcid": "4420", 00:18:18.078 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.078 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.078 "hdgst": false, 00:18:18.078 "ddgst": false 00:18:18.078 }, 00:18:18.078 "method": "bdev_nvme_attach_controller" 00:18:18.078 }' 00:18:18.078 17:37:55 -- nvmf/common.sh@545 -- # IFS=, 00:18:18.078 17:37:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:18.078 "params": { 00:18:18.078 "name": "Nvme1", 00:18:18.078 "trtype": "tcp", 00:18:18.078 "traddr": "10.0.0.2", 00:18:18.078 "adrfam": "ipv4", 00:18:18.078 "trsvcid": "4420", 00:18:18.078 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:18.078 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:18.079 "hdgst": false, 00:18:18.079 "ddgst": false 00:18:18.079 }, 00:18:18.079 "method": "bdev_nvme_attach_controller" 00:18:18.079 }' 00:18:18.079 [2024-11-16 17:37:55.448444] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.079 [2024-11-16 17:37:55.448517] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:18.079 [2024-11-16 17:37:55.448876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.079 [2024-11-16 17:37:55.448877] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.079 [2024-11-16 17:37:55.448876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:18.079 [2024-11-16 17:37:55.448959] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-16 17:37:55.448960] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-16 17:37:55.448960] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:18.079 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:18.079 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:18.079 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.337 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.337 [2024-11-16 17:37:55.624405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.337 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.337 [2024-11-16 17:37:55.698064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:18.337 [2024-11-16 17:37:55.724151] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.337 EAL: No free 2048 kB hugepages reported on node 1 00:18:18.337 [2024-11-16 17:37:55.797241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:18.337 [2024-11-16 17:37:55.823622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.596 [2024-11-16 17:37:55.893390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.596 [2024-11-16 17:37:55.894488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:18.596 [2024-11-16 17:37:55.958723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:18.596 Running I/O for 1 seconds... 00:18:18.855 Running I/O for 1 seconds... 00:18:18.855 Running I/O for 1 seconds... 00:18:18.855 Running I/O for 1 seconds... 00:18:19.794 00:18:19.794 Latency(us) 00:18:19.794 [2024-11-16T16:37:57.286Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.794 [2024-11-16T16:37:57.286Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:19.794 Nvme1n1 : 1.02 6197.91 24.21 0.00 0.00 20523.42 8398.32 29321.29 00:18:19.794 [2024-11-16T16:37:57.287Z] =================================================================================================================== 00:18:19.795 [2024-11-16T16:37:57.287Z] Total : 6197.91 24.21 0.00 0.00 20523.42 8398.32 29321.29 00:18:19.795 00:18:19.795 Latency(us) 00:18:19.795 [2024-11-16T16:37:57.287Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.795 [2024-11-16T16:37:57.287Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:19.795 Nvme1n1 : 1.00 193212.10 754.73 0.00 0.00 659.94 263.96 904.15 00:18:19.795 [2024-11-16T16:37:57.287Z] =================================================================================================================== 00:18:19.795 [2024-11-16T16:37:57.287Z] Total : 193212.10 754.73 0.00 0.00 659.94 263.96 904.15 00:18:19.795 00:18:19.795 Latency(us) 00:18:19.795 [2024-11-16T16:37:57.287Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.795 [2024-11-16T16:37:57.287Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:19.795 Nvme1n1 : 1.01 6132.14 23.95 0.00 0.00 20796.52 6941.96 40777.96 00:18:19.795 [2024-11-16T16:37:57.287Z] =================================================================================================================== 00:18:19.795 [2024-11-16T16:37:57.287Z] Total : 6132.14 23.95 0.00 0.00 20796.52 6941.96 40777.96 00:18:19.795 00:18:19.795 Latency(us) 00:18:19.795 [2024-11-16T16:37:57.287Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.795 [2024-11-16T16:37:57.287Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:19.795 Nvme1n1 : 1.01 10484.60 40.96 0.00 0.00 12165.40 6019.60 23398.78 00:18:19.795 [2024-11-16T16:37:57.287Z] =================================================================================================================== 00:18:19.795 [2024-11-16T16:37:57.287Z] Total : 10484.60 40.96 0.00 0.00 12165.40 6019.60 23398.78 00:18:20.053 17:37:57 -- target/bdev_io_wait.sh@38 -- # wait 1582797 00:18:20.313 17:37:57 -- target/bdev_io_wait.sh@39 -- # wait 1582799 00:18:20.313 17:37:57 -- target/bdev_io_wait.sh@40 -- # wait 1582801 00:18:20.313 17:37:57 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:20.314 17:37:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:20.314 17:37:57 -- common/autotest_common.sh@10 -- # set +x 00:18:20.314 17:37:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:20.314 17:37:57 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:20.314 17:37:57 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:20.314 17:37:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:20.314 17:37:57 -- nvmf/common.sh@116 -- # sync 00:18:20.314 17:37:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:20.314 17:37:57 -- nvmf/common.sh@119 -- # set +e 00:18:20.314 17:37:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:20.314 17:37:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:20.314 rmmod nvme_tcp 00:18:20.314 rmmod nvme_fabrics 00:18:20.314 rmmod nvme_keyring 00:18:20.314 17:37:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:20.314 17:37:57 -- nvmf/common.sh@123 -- # set -e 00:18:20.314 17:37:57 -- nvmf/common.sh@124 -- # return 0 00:18:20.314 17:37:57 -- nvmf/common.sh@477 -- # '[' -n 1582647 ']' 00:18:20.314 17:37:57 -- nvmf/common.sh@478 -- # killprocess 1582647 00:18:20.314 17:37:57 -- common/autotest_common.sh@936 -- # '[' -z 1582647 ']' 00:18:20.314 17:37:57 -- common/autotest_common.sh@940 -- # kill -0 1582647 00:18:20.314 17:37:57 -- common/autotest_common.sh@941 -- # uname 00:18:20.314 17:37:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.314 17:37:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1582647 00:18:20.314 17:37:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:20.314 17:37:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:20.314 17:37:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1582647' 00:18:20.314 killing process with pid 1582647 00:18:20.314 17:37:57 -- common/autotest_common.sh@955 -- # kill 1582647 00:18:20.314 17:37:57 -- common/autotest_common.sh@960 -- # wait 1582647 00:18:20.574 17:37:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:20.574 17:37:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:20.575 17:37:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:20.575 17:37:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:20.575 17:37:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:20.575 17:37:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.575 17:37:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.575 17:37:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.485 17:37:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:22.485 00:18:22.485 real 0m7.283s 00:18:22.485 user 0m16.412s 00:18:22.485 sys 0m3.656s 00:18:22.485 17:37:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:22.485 17:37:59 -- common/autotest_common.sh@10 -- # set +x 00:18:22.485 ************************************ 00:18:22.485 END TEST nvmf_bdev_io_wait 00:18:22.485 ************************************ 00:18:22.485 17:37:59 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:22.485 17:37:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:22.485 17:37:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:22.485 17:37:59 -- common/autotest_common.sh@10 -- # set +x 00:18:22.485 ************************************ 00:18:22.485 START TEST nvmf_queue_depth 00:18:22.485 ************************************ 00:18:22.485 17:37:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:22.744 * Looking for test storage... 00:18:22.744 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:22.744 17:38:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:22.744 17:38:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:22.744 17:38:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:22.744 17:38:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:22.744 17:38:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:22.744 17:38:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:22.744 17:38:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:22.744 17:38:00 -- scripts/common.sh@335 -- # IFS=.-: 00:18:22.744 17:38:00 -- scripts/common.sh@335 -- # read -ra ver1 00:18:22.744 17:38:00 -- scripts/common.sh@336 -- # IFS=.-: 00:18:22.744 17:38:00 -- scripts/common.sh@336 -- # read -ra ver2 00:18:22.744 17:38:00 -- scripts/common.sh@337 -- # local 'op=<' 00:18:22.744 17:38:00 -- scripts/common.sh@339 -- # ver1_l=2 00:18:22.744 17:38:00 -- scripts/common.sh@340 -- # ver2_l=1 00:18:22.744 17:38:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:22.744 17:38:00 -- scripts/common.sh@343 -- # case "$op" in 00:18:22.744 17:38:00 -- scripts/common.sh@344 -- # : 1 00:18:22.744 17:38:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:22.744 17:38:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.744 17:38:00 -- scripts/common.sh@364 -- # decimal 1 00:18:22.744 17:38:00 -- scripts/common.sh@352 -- # local d=1 00:18:22.744 17:38:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:22.744 17:38:00 -- scripts/common.sh@354 -- # echo 1 00:18:22.744 17:38:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:22.744 17:38:00 -- scripts/common.sh@365 -- # decimal 2 00:18:22.744 17:38:00 -- scripts/common.sh@352 -- # local d=2 00:18:22.744 17:38:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:22.744 17:38:00 -- scripts/common.sh@354 -- # echo 2 00:18:22.744 17:38:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:22.744 17:38:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.744 17:38:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:22.744 17:38:00 -- scripts/common.sh@367 -- # return 0 00:18:22.744 17:38:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:22.744 17:38:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:22.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.744 --rc genhtml_branch_coverage=1 00:18:22.744 --rc genhtml_function_coverage=1 00:18:22.744 --rc genhtml_legend=1 00:18:22.744 --rc geninfo_all_blocks=1 00:18:22.744 --rc geninfo_unexecuted_blocks=1 00:18:22.744 00:18:22.744 ' 00:18:22.744 17:38:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:22.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.744 --rc genhtml_branch_coverage=1 00:18:22.744 --rc genhtml_function_coverage=1 00:18:22.744 --rc genhtml_legend=1 00:18:22.744 --rc geninfo_all_blocks=1 00:18:22.744 --rc geninfo_unexecuted_blocks=1 00:18:22.744 00:18:22.745 ' 00:18:22.745 17:38:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:22.745 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.745 --rc genhtml_branch_coverage=1 00:18:22.745 --rc genhtml_function_coverage=1 00:18:22.745 --rc genhtml_legend=1 00:18:22.745 --rc geninfo_all_blocks=1 00:18:22.745 --rc geninfo_unexecuted_blocks=1 00:18:22.745 00:18:22.745 ' 00:18:22.745 17:38:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:22.745 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.745 --rc genhtml_branch_coverage=1 00:18:22.745 --rc genhtml_function_coverage=1 00:18:22.745 --rc genhtml_legend=1 00:18:22.745 --rc geninfo_all_blocks=1 00:18:22.745 --rc geninfo_unexecuted_blocks=1 00:18:22.745 00:18:22.745 ' 00:18:22.745 17:38:00 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:22.745 17:38:00 -- nvmf/common.sh@7 -- # uname -s 00:18:22.745 17:38:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:22.745 17:38:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:22.745 17:38:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:22.745 17:38:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:22.745 17:38:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:22.745 17:38:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:22.745 17:38:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:22.745 17:38:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:22.745 17:38:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:22.745 17:38:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:22.745 17:38:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.745 17:38:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.745 17:38:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:22.745 17:38:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:22.745 17:38:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:22.745 17:38:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:22.745 17:38:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:22.745 17:38:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:22.745 17:38:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:22.745 17:38:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.745 17:38:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.745 17:38:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.745 17:38:00 -- paths/export.sh@5 -- # export PATH 00:18:22.745 17:38:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.745 17:38:00 -- nvmf/common.sh@46 -- # : 0 00:18:22.745 17:38:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:22.745 17:38:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:22.745 17:38:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:22.745 17:38:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:22.745 17:38:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:22.745 17:38:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:22.745 17:38:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:22.745 17:38:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:22.745 17:38:00 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:22.745 17:38:00 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:22.745 17:38:00 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:22.745 17:38:00 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:22.745 17:38:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:22.745 17:38:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:22.745 17:38:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:22.745 17:38:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:22.745 17:38:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:22.745 17:38:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:22.745 17:38:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:22.745 17:38:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.745 17:38:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:22.745 17:38:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:22.745 17:38:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:22.745 17:38:00 -- common/autotest_common.sh@10 -- # set +x 00:18:25.277 17:38:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:25.277 17:38:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:25.277 17:38:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:25.277 17:38:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:25.277 17:38:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:25.277 17:38:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:25.277 17:38:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:25.277 17:38:02 -- nvmf/common.sh@294 -- # net_devs=() 00:18:25.277 17:38:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:25.277 17:38:02 -- nvmf/common.sh@295 -- # e810=() 00:18:25.277 17:38:02 -- nvmf/common.sh@295 -- # local -ga e810 00:18:25.277 17:38:02 -- nvmf/common.sh@296 -- # x722=() 00:18:25.277 17:38:02 -- nvmf/common.sh@296 -- # local -ga x722 00:18:25.277 17:38:02 -- nvmf/common.sh@297 -- # mlx=() 00:18:25.277 17:38:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:25.277 17:38:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:25.277 17:38:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:25.277 17:38:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:25.277 17:38:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:25.277 17:38:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.277 17:38:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:25.277 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:25.277 17:38:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:25.277 17:38:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:25.277 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:25.277 17:38:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:25.277 17:38:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:25.277 17:38:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.277 17:38:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.277 17:38:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.277 17:38:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.277 17:38:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:25.277 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:25.277 17:38:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.277 17:38:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:25.278 17:38:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:25.278 17:38:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:25.278 17:38:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:25.278 17:38:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:25.278 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:25.278 17:38:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:25.278 17:38:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:25.278 17:38:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:25.278 17:38:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:25.278 17:38:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:25.278 17:38:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:25.278 17:38:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:25.278 17:38:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:25.278 17:38:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:25.278 17:38:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:25.278 17:38:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:25.278 17:38:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:25.278 17:38:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:25.278 17:38:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:25.278 17:38:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:25.278 17:38:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:25.278 17:38:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:25.278 17:38:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:25.278 17:38:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:25.278 17:38:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:25.278 17:38:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:25.278 17:38:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:25.278 17:38:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:25.278 17:38:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:25.278 17:38:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:25.278 17:38:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:25.278 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:25.278 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.188 ms 00:18:25.278 00:18:25.278 --- 10.0.0.2 ping statistics --- 00:18:25.278 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.278 rtt min/avg/max/mdev = 0.188/0.188/0.188/0.000 ms 00:18:25.278 17:38:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:25.278 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:25.278 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:18:25.278 00:18:25.278 --- 10.0.0.1 ping statistics --- 00:18:25.278 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:25.278 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:18:25.278 17:38:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:25.278 17:38:02 -- nvmf/common.sh@410 -- # return 0 00:18:25.278 17:38:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:25.278 17:38:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:25.278 17:38:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:25.278 17:38:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:25.278 17:38:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:25.278 17:38:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:25.278 17:38:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:25.278 17:38:02 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:25.278 17:38:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:25.278 17:38:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:25.278 17:38:02 -- common/autotest_common.sh@10 -- # set +x 00:18:25.278 17:38:02 -- nvmf/common.sh@469 -- # nvmfpid=1585046 00:18:25.278 17:38:02 -- nvmf/common.sh@470 -- # waitforlisten 1585046 00:18:25.278 17:38:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:25.278 17:38:02 -- common/autotest_common.sh@829 -- # '[' -z 1585046 ']' 00:18:25.278 17:38:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:25.278 17:38:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:25.278 17:38:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:25.278 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:25.278 17:38:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:25.278 17:38:02 -- common/autotest_common.sh@10 -- # set +x 00:18:25.278 [2024-11-16 17:38:02.471920] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:25.278 [2024-11-16 17:38:02.472034] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:25.278 EAL: No free 2048 kB hugepages reported on node 1 00:18:25.278 [2024-11-16 17:38:02.540159] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:25.278 [2024-11-16 17:38:02.635422] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:25.278 [2024-11-16 17:38:02.635599] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:25.278 [2024-11-16 17:38:02.635623] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:25.278 [2024-11-16 17:38:02.635637] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:25.278 [2024-11-16 17:38:02.635686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:26.210 17:38:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:26.210 17:38:03 -- common/autotest_common.sh@862 -- # return 0 00:18:26.210 17:38:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:26.210 17:38:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:26.210 17:38:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.210 17:38:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:26.210 17:38:03 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:26.210 17:38:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.211 17:38:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.211 [2024-11-16 17:38:03.512289] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:26.211 17:38:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.211 17:38:03 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:26.211 17:38:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.211 17:38:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.211 Malloc0 00:18:26.211 17:38:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.211 17:38:03 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:26.211 17:38:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.211 17:38:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.211 17:38:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.211 17:38:03 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:26.211 17:38:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.211 17:38:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.211 17:38:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.211 17:38:03 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:26.211 17:38:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.211 17:38:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.211 [2024-11-16 17:38:03.570600] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:26.211 17:38:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.211 17:38:03 -- target/queue_depth.sh@30 -- # bdevperf_pid=1585203 00:18:26.211 17:38:03 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:26.211 17:38:03 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:26.211 17:38:03 -- target/queue_depth.sh@33 -- # waitforlisten 1585203 /var/tmp/bdevperf.sock 00:18:26.211 17:38:03 -- common/autotest_common.sh@829 -- # '[' -z 1585203 ']' 00:18:26.211 17:38:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:26.211 17:38:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:26.211 17:38:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:26.211 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:26.211 17:38:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:26.211 17:38:03 -- common/autotest_common.sh@10 -- # set +x 00:18:26.211 [2024-11-16 17:38:03.614043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:26.211 [2024-11-16 17:38:03.614106] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1585203 ] 00:18:26.211 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.211 [2024-11-16 17:38:03.676064] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.468 [2024-11-16 17:38:03.765110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:27.400 17:38:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:27.400 17:38:04 -- common/autotest_common.sh@862 -- # return 0 00:18:27.400 17:38:04 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:27.400 17:38:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.400 17:38:04 -- common/autotest_common.sh@10 -- # set +x 00:18:27.400 NVMe0n1 00:18:27.400 17:38:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.400 17:38:04 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:27.400 Running I/O for 10 seconds... 00:18:39.602 00:18:39.602 Latency(us) 00:18:39.602 [2024-11-16T16:38:17.094Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.602 [2024-11-16T16:38:17.094Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:39.602 Verification LBA range: start 0x0 length 0x4000 00:18:39.602 NVMe0n1 : 10.07 12308.39 48.08 0.00 0.00 82861.63 15534.46 61749.48 00:18:39.602 [2024-11-16T16:38:17.094Z] =================================================================================================================== 00:18:39.602 [2024-11-16T16:38:17.094Z] Total : 12308.39 48.08 0.00 0.00 82861.63 15534.46 61749.48 00:18:39.602 0 00:18:39.602 17:38:14 -- target/queue_depth.sh@39 -- # killprocess 1585203 00:18:39.602 17:38:14 -- common/autotest_common.sh@936 -- # '[' -z 1585203 ']' 00:18:39.602 17:38:14 -- common/autotest_common.sh@940 -- # kill -0 1585203 00:18:39.602 17:38:14 -- common/autotest_common.sh@941 -- # uname 00:18:39.602 17:38:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.602 17:38:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1585203 00:18:39.602 17:38:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:39.602 17:38:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:39.602 17:38:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1585203' 00:18:39.602 killing process with pid 1585203 00:18:39.602 17:38:15 -- common/autotest_common.sh@955 -- # kill 1585203 00:18:39.602 Received shutdown signal, test time was about 10.000000 seconds 00:18:39.602 00:18:39.602 Latency(us) 00:18:39.602 [2024-11-16T16:38:17.094Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.602 [2024-11-16T16:38:17.094Z] =================================================================================================================== 00:18:39.602 [2024-11-16T16:38:17.094Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:39.602 17:38:15 -- common/autotest_common.sh@960 -- # wait 1585203 00:18:39.602 17:38:15 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:39.602 17:38:15 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:39.602 17:38:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:39.602 17:38:15 -- nvmf/common.sh@116 -- # sync 00:18:39.602 17:38:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:39.602 17:38:15 -- nvmf/common.sh@119 -- # set +e 00:18:39.602 17:38:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:39.602 17:38:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:39.602 rmmod nvme_tcp 00:18:39.602 rmmod nvme_fabrics 00:18:39.602 rmmod nvme_keyring 00:18:39.602 17:38:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:39.602 17:38:15 -- nvmf/common.sh@123 -- # set -e 00:18:39.602 17:38:15 -- nvmf/common.sh@124 -- # return 0 00:18:39.602 17:38:15 -- nvmf/common.sh@477 -- # '[' -n 1585046 ']' 00:18:39.602 17:38:15 -- nvmf/common.sh@478 -- # killprocess 1585046 00:18:39.602 17:38:15 -- common/autotest_common.sh@936 -- # '[' -z 1585046 ']' 00:18:39.602 17:38:15 -- common/autotest_common.sh@940 -- # kill -0 1585046 00:18:39.602 17:38:15 -- common/autotest_common.sh@941 -- # uname 00:18:39.602 17:38:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:39.602 17:38:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1585046 00:18:39.602 17:38:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:39.602 17:38:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:39.602 17:38:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1585046' 00:18:39.602 killing process with pid 1585046 00:18:39.602 17:38:15 -- common/autotest_common.sh@955 -- # kill 1585046 00:18:39.602 17:38:15 -- common/autotest_common.sh@960 -- # wait 1585046 00:18:39.602 17:38:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:39.602 17:38:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:39.602 17:38:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:39.602 17:38:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:39.602 17:38:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:39.602 17:38:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:39.602 17:38:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:39.602 17:38:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.537 17:38:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:40.537 00:18:40.537 real 0m17.714s 00:18:40.537 user 0m23.995s 00:18:40.537 sys 0m3.835s 00:18:40.537 17:38:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:40.538 17:38:17 -- common/autotest_common.sh@10 -- # set +x 00:18:40.538 ************************************ 00:18:40.538 END TEST nvmf_queue_depth 00:18:40.538 ************************************ 00:18:40.538 17:38:17 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:40.538 17:38:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:40.538 17:38:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:40.538 17:38:17 -- common/autotest_common.sh@10 -- # set +x 00:18:40.538 ************************************ 00:18:40.538 START TEST nvmf_multipath 00:18:40.538 ************************************ 00:18:40.538 17:38:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:40.538 * Looking for test storage... 00:18:40.538 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:40.538 17:38:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:40.538 17:38:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:40.538 17:38:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:40.538 17:38:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:40.538 17:38:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:40.538 17:38:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:40.538 17:38:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:40.538 17:38:17 -- scripts/common.sh@335 -- # IFS=.-: 00:18:40.538 17:38:17 -- scripts/common.sh@335 -- # read -ra ver1 00:18:40.538 17:38:17 -- scripts/common.sh@336 -- # IFS=.-: 00:18:40.538 17:38:17 -- scripts/common.sh@336 -- # read -ra ver2 00:18:40.538 17:38:17 -- scripts/common.sh@337 -- # local 'op=<' 00:18:40.538 17:38:17 -- scripts/common.sh@339 -- # ver1_l=2 00:18:40.538 17:38:17 -- scripts/common.sh@340 -- # ver2_l=1 00:18:40.538 17:38:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:40.538 17:38:17 -- scripts/common.sh@343 -- # case "$op" in 00:18:40.538 17:38:17 -- scripts/common.sh@344 -- # : 1 00:18:40.538 17:38:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:40.538 17:38:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:40.538 17:38:17 -- scripts/common.sh@364 -- # decimal 1 00:18:40.538 17:38:17 -- scripts/common.sh@352 -- # local d=1 00:18:40.538 17:38:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:40.538 17:38:17 -- scripts/common.sh@354 -- # echo 1 00:18:40.538 17:38:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:40.538 17:38:17 -- scripts/common.sh@365 -- # decimal 2 00:18:40.538 17:38:17 -- scripts/common.sh@352 -- # local d=2 00:18:40.538 17:38:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:40.538 17:38:17 -- scripts/common.sh@354 -- # echo 2 00:18:40.538 17:38:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:40.538 17:38:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:40.538 17:38:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:40.538 17:38:17 -- scripts/common.sh@367 -- # return 0 00:18:40.538 17:38:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:40.538 17:38:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:40.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.538 --rc genhtml_branch_coverage=1 00:18:40.538 --rc genhtml_function_coverage=1 00:18:40.538 --rc genhtml_legend=1 00:18:40.538 --rc geninfo_all_blocks=1 00:18:40.538 --rc geninfo_unexecuted_blocks=1 00:18:40.538 00:18:40.538 ' 00:18:40.538 17:38:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:40.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.538 --rc genhtml_branch_coverage=1 00:18:40.538 --rc genhtml_function_coverage=1 00:18:40.538 --rc genhtml_legend=1 00:18:40.538 --rc geninfo_all_blocks=1 00:18:40.538 --rc geninfo_unexecuted_blocks=1 00:18:40.538 00:18:40.538 ' 00:18:40.538 17:38:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:40.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.538 --rc genhtml_branch_coverage=1 00:18:40.538 --rc genhtml_function_coverage=1 00:18:40.538 --rc genhtml_legend=1 00:18:40.538 --rc geninfo_all_blocks=1 00:18:40.538 --rc geninfo_unexecuted_blocks=1 00:18:40.538 00:18:40.538 ' 00:18:40.538 17:38:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:40.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:40.538 --rc genhtml_branch_coverage=1 00:18:40.538 --rc genhtml_function_coverage=1 00:18:40.538 --rc genhtml_legend=1 00:18:40.538 --rc geninfo_all_blocks=1 00:18:40.538 --rc geninfo_unexecuted_blocks=1 00:18:40.538 00:18:40.538 ' 00:18:40.538 17:38:17 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:40.538 17:38:17 -- nvmf/common.sh@7 -- # uname -s 00:18:40.538 17:38:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:40.538 17:38:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:40.538 17:38:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:40.538 17:38:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:40.538 17:38:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:40.538 17:38:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:40.538 17:38:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:40.538 17:38:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:40.538 17:38:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:40.538 17:38:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:40.538 17:38:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.538 17:38:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:40.538 17:38:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:40.538 17:38:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:40.538 17:38:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:40.538 17:38:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:40.538 17:38:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:40.538 17:38:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:40.538 17:38:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:40.538 17:38:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.538 17:38:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.538 17:38:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.538 17:38:17 -- paths/export.sh@5 -- # export PATH 00:18:40.538 17:38:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:40.538 17:38:17 -- nvmf/common.sh@46 -- # : 0 00:18:40.538 17:38:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:40.538 17:38:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:40.538 17:38:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:40.538 17:38:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:40.538 17:38:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:40.538 17:38:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:40.538 17:38:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:40.538 17:38:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:40.538 17:38:17 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:40.538 17:38:17 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:40.538 17:38:17 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:40.538 17:38:17 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:40.538 17:38:17 -- target/multipath.sh@43 -- # nvmftestinit 00:18:40.538 17:38:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:40.538 17:38:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:40.538 17:38:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:40.538 17:38:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:40.538 17:38:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:40.538 17:38:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.538 17:38:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.538 17:38:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:40.538 17:38:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:40.538 17:38:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:40.538 17:38:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:40.538 17:38:17 -- common/autotest_common.sh@10 -- # set +x 00:18:43.071 17:38:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:43.071 17:38:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:43.071 17:38:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:43.071 17:38:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:43.071 17:38:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:43.071 17:38:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:43.072 17:38:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:43.072 17:38:19 -- nvmf/common.sh@294 -- # net_devs=() 00:18:43.072 17:38:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:43.072 17:38:19 -- nvmf/common.sh@295 -- # e810=() 00:18:43.072 17:38:19 -- nvmf/common.sh@295 -- # local -ga e810 00:18:43.072 17:38:19 -- nvmf/common.sh@296 -- # x722=() 00:18:43.072 17:38:19 -- nvmf/common.sh@296 -- # local -ga x722 00:18:43.072 17:38:19 -- nvmf/common.sh@297 -- # mlx=() 00:18:43.072 17:38:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:43.072 17:38:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:43.072 17:38:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:43.072 17:38:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:43.072 17:38:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:43.072 17:38:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.072 17:38:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:43.072 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:43.072 17:38:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:43.072 17:38:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:43.072 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:43.072 17:38:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:43.072 17:38:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.072 17:38:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.072 17:38:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.072 17:38:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.072 17:38:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:43.072 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:43.072 17:38:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.072 17:38:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:43.072 17:38:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:43.072 17:38:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:43.072 17:38:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:43.072 17:38:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:43.072 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:43.072 17:38:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:43.072 17:38:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:43.072 17:38:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:43.072 17:38:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:43.072 17:38:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:43.072 17:38:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:43.072 17:38:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:43.072 17:38:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:43.072 17:38:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:43.072 17:38:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:43.072 17:38:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:43.072 17:38:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:43.072 17:38:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:43.072 17:38:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:43.072 17:38:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:43.072 17:38:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:43.072 17:38:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:43.072 17:38:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:43.072 17:38:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:43.072 17:38:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:43.072 17:38:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:43.072 17:38:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:43.072 17:38:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:43.072 17:38:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:43.072 17:38:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:43.072 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:43.072 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:18:43.072 00:18:43.072 --- 10.0.0.2 ping statistics --- 00:18:43.072 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.072 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:18:43.072 17:38:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:43.072 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:43.072 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:18:43.072 00:18:43.072 --- 10.0.0.1 ping statistics --- 00:18:43.072 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:43.072 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:18:43.072 17:38:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:43.072 17:38:20 -- nvmf/common.sh@410 -- # return 0 00:18:43.072 17:38:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:43.072 17:38:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:43.072 17:38:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:43.072 17:38:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:43.072 17:38:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:43.072 17:38:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:43.072 17:38:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:43.072 17:38:20 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:43.072 17:38:20 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:43.072 only one NIC for nvmf test 00:18:43.072 17:38:20 -- target/multipath.sh@47 -- # nvmftestfini 00:18:43.072 17:38:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:43.072 17:38:20 -- nvmf/common.sh@116 -- # sync 00:18:43.072 17:38:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:43.072 17:38:20 -- nvmf/common.sh@119 -- # set +e 00:18:43.072 17:38:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:43.072 17:38:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:43.072 rmmod nvme_tcp 00:18:43.072 rmmod nvme_fabrics 00:18:43.072 rmmod nvme_keyring 00:18:43.072 17:38:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:43.072 17:38:20 -- nvmf/common.sh@123 -- # set -e 00:18:43.072 17:38:20 -- nvmf/common.sh@124 -- # return 0 00:18:43.072 17:38:20 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:43.072 17:38:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:43.072 17:38:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:43.072 17:38:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:43.072 17:38:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:43.072 17:38:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:43.072 17:38:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:43.072 17:38:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:43.072 17:38:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:44.975 17:38:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:44.975 17:38:22 -- target/multipath.sh@48 -- # exit 0 00:18:44.975 17:38:22 -- target/multipath.sh@1 -- # nvmftestfini 00:18:44.975 17:38:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:44.975 17:38:22 -- nvmf/common.sh@116 -- # sync 00:18:44.975 17:38:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:44.975 17:38:22 -- nvmf/common.sh@119 -- # set +e 00:18:44.975 17:38:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:44.975 17:38:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:44.975 17:38:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:44.975 17:38:22 -- nvmf/common.sh@123 -- # set -e 00:18:44.975 17:38:22 -- nvmf/common.sh@124 -- # return 0 00:18:44.975 17:38:22 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:44.975 17:38:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:44.975 17:38:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:44.975 17:38:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:44.975 17:38:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:44.975 17:38:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:44.975 17:38:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:44.975 17:38:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:44.975 17:38:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:44.975 17:38:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:44.975 00:18:44.975 real 0m4.513s 00:18:44.975 user 0m0.931s 00:18:44.975 sys 0m1.578s 00:18:44.975 17:38:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:44.975 17:38:22 -- common/autotest_common.sh@10 -- # set +x 00:18:44.975 ************************************ 00:18:44.975 END TEST nvmf_multipath 00:18:44.975 ************************************ 00:18:44.975 17:38:22 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:44.975 17:38:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:44.975 17:38:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:44.975 17:38:22 -- common/autotest_common.sh@10 -- # set +x 00:18:44.975 ************************************ 00:18:44.975 START TEST nvmf_zcopy 00:18:44.975 ************************************ 00:18:44.975 17:38:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:44.975 * Looking for test storage... 00:18:44.975 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:44.975 17:38:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:44.975 17:38:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:44.975 17:38:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:44.975 17:38:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:44.975 17:38:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:44.975 17:38:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:44.975 17:38:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:44.975 17:38:22 -- scripts/common.sh@335 -- # IFS=.-: 00:18:44.975 17:38:22 -- scripts/common.sh@335 -- # read -ra ver1 00:18:44.975 17:38:22 -- scripts/common.sh@336 -- # IFS=.-: 00:18:44.975 17:38:22 -- scripts/common.sh@336 -- # read -ra ver2 00:18:44.975 17:38:22 -- scripts/common.sh@337 -- # local 'op=<' 00:18:44.975 17:38:22 -- scripts/common.sh@339 -- # ver1_l=2 00:18:44.975 17:38:22 -- scripts/common.sh@340 -- # ver2_l=1 00:18:44.975 17:38:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:44.975 17:38:22 -- scripts/common.sh@343 -- # case "$op" in 00:18:44.975 17:38:22 -- scripts/common.sh@344 -- # : 1 00:18:44.975 17:38:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:44.975 17:38:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:44.975 17:38:22 -- scripts/common.sh@364 -- # decimal 1 00:18:44.975 17:38:22 -- scripts/common.sh@352 -- # local d=1 00:18:44.975 17:38:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:44.975 17:38:22 -- scripts/common.sh@354 -- # echo 1 00:18:44.975 17:38:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:44.975 17:38:22 -- scripts/common.sh@365 -- # decimal 2 00:18:44.975 17:38:22 -- scripts/common.sh@352 -- # local d=2 00:18:44.975 17:38:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:44.975 17:38:22 -- scripts/common.sh@354 -- # echo 2 00:18:44.975 17:38:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:44.975 17:38:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:44.975 17:38:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:44.975 17:38:22 -- scripts/common.sh@367 -- # return 0 00:18:44.975 17:38:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:44.975 17:38:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:44.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:44.976 --rc genhtml_branch_coverage=1 00:18:44.976 --rc genhtml_function_coverage=1 00:18:44.976 --rc genhtml_legend=1 00:18:44.976 --rc geninfo_all_blocks=1 00:18:44.976 --rc geninfo_unexecuted_blocks=1 00:18:44.976 00:18:44.976 ' 00:18:44.976 17:38:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:44.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:44.976 --rc genhtml_branch_coverage=1 00:18:44.976 --rc genhtml_function_coverage=1 00:18:44.976 --rc genhtml_legend=1 00:18:44.976 --rc geninfo_all_blocks=1 00:18:44.976 --rc geninfo_unexecuted_blocks=1 00:18:44.976 00:18:44.976 ' 00:18:44.976 17:38:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:44.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:44.976 --rc genhtml_branch_coverage=1 00:18:44.976 --rc genhtml_function_coverage=1 00:18:44.976 --rc genhtml_legend=1 00:18:44.976 --rc geninfo_all_blocks=1 00:18:44.976 --rc geninfo_unexecuted_blocks=1 00:18:44.976 00:18:44.976 ' 00:18:44.976 17:38:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:44.976 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:44.976 --rc genhtml_branch_coverage=1 00:18:44.976 --rc genhtml_function_coverage=1 00:18:44.976 --rc genhtml_legend=1 00:18:44.976 --rc geninfo_all_blocks=1 00:18:44.976 --rc geninfo_unexecuted_blocks=1 00:18:44.976 00:18:44.976 ' 00:18:44.976 17:38:22 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:44.976 17:38:22 -- nvmf/common.sh@7 -- # uname -s 00:18:44.976 17:38:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:44.976 17:38:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:44.976 17:38:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:44.976 17:38:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:44.976 17:38:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:44.976 17:38:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:44.976 17:38:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:44.976 17:38:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:44.976 17:38:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:44.976 17:38:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:44.976 17:38:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:44.976 17:38:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:44.976 17:38:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:44.976 17:38:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:44.976 17:38:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:44.976 17:38:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:44.976 17:38:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:44.976 17:38:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:44.976 17:38:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:44.976 17:38:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:44.976 17:38:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:44.976 17:38:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:44.976 17:38:22 -- paths/export.sh@5 -- # export PATH 00:18:44.976 17:38:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:44.976 17:38:22 -- nvmf/common.sh@46 -- # : 0 00:18:44.976 17:38:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:44.976 17:38:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:44.976 17:38:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:44.976 17:38:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:44.976 17:38:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:44.976 17:38:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:44.976 17:38:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:44.976 17:38:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:44.976 17:38:22 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:44.976 17:38:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:44.976 17:38:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:44.976 17:38:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:44.976 17:38:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:44.976 17:38:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:44.976 17:38:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:44.976 17:38:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:44.976 17:38:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:44.976 17:38:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:44.976 17:38:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:44.976 17:38:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:44.976 17:38:22 -- common/autotest_common.sh@10 -- # set +x 00:18:47.511 17:38:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:47.511 17:38:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:47.511 17:38:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:47.511 17:38:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:47.511 17:38:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:47.511 17:38:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:47.511 17:38:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:47.511 17:38:24 -- nvmf/common.sh@294 -- # net_devs=() 00:18:47.511 17:38:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:47.511 17:38:24 -- nvmf/common.sh@295 -- # e810=() 00:18:47.511 17:38:24 -- nvmf/common.sh@295 -- # local -ga e810 00:18:47.511 17:38:24 -- nvmf/common.sh@296 -- # x722=() 00:18:47.511 17:38:24 -- nvmf/common.sh@296 -- # local -ga x722 00:18:47.511 17:38:24 -- nvmf/common.sh@297 -- # mlx=() 00:18:47.511 17:38:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:47.511 17:38:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:47.511 17:38:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:47.511 17:38:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:47.511 17:38:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:47.511 17:38:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:47.511 17:38:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:47.511 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:47.511 17:38:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:47.511 17:38:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:47.511 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:47.511 17:38:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:47.511 17:38:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:47.511 17:38:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:47.511 17:38:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:47.511 17:38:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:47.511 17:38:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:47.511 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:47.511 17:38:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:47.511 17:38:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:47.511 17:38:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:47.511 17:38:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:47.511 17:38:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:47.511 17:38:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:47.511 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:47.511 17:38:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:47.511 17:38:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:47.511 17:38:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:47.511 17:38:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:47.511 17:38:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:47.511 17:38:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:47.511 17:38:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:47.511 17:38:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:47.511 17:38:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:47.511 17:38:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:47.511 17:38:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:47.511 17:38:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:47.511 17:38:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:47.511 17:38:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:47.511 17:38:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:47.511 17:38:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:47.511 17:38:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:47.511 17:38:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:47.511 17:38:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:47.511 17:38:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:47.511 17:38:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:47.511 17:38:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:47.511 17:38:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:47.512 17:38:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:47.512 17:38:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:47.512 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:47.512 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:18:47.512 00:18:47.512 --- 10.0.0.2 ping statistics --- 00:18:47.512 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:47.512 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:18:47.512 17:38:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:47.512 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:47.512 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:18:47.512 00:18:47.512 --- 10.0.0.1 ping statistics --- 00:18:47.512 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:47.512 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:18:47.512 17:38:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:47.512 17:38:24 -- nvmf/common.sh@410 -- # return 0 00:18:47.512 17:38:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:47.512 17:38:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:47.512 17:38:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:47.512 17:38:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:47.512 17:38:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:47.512 17:38:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:47.512 17:38:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:47.512 17:38:24 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:47.512 17:38:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:47.512 17:38:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:47.512 17:38:24 -- common/autotest_common.sh@10 -- # set +x 00:18:47.512 17:38:24 -- nvmf/common.sh@469 -- # nvmfpid=1590464 00:18:47.512 17:38:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:47.512 17:38:24 -- nvmf/common.sh@470 -- # waitforlisten 1590464 00:18:47.512 17:38:24 -- common/autotest_common.sh@829 -- # '[' -z 1590464 ']' 00:18:47.512 17:38:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:47.512 17:38:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:47.512 17:38:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:47.512 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:47.512 17:38:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:47.512 17:38:24 -- common/autotest_common.sh@10 -- # set +x 00:18:47.512 [2024-11-16 17:38:24.669058] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:47.512 [2024-11-16 17:38:24.669162] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:47.512 EAL: No free 2048 kB hugepages reported on node 1 00:18:47.512 [2024-11-16 17:38:24.734488] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:47.512 [2024-11-16 17:38:24.822366] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:47.512 [2024-11-16 17:38:24.822524] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:47.512 [2024-11-16 17:38:24.822540] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:47.512 [2024-11-16 17:38:24.822553] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:47.512 [2024-11-16 17:38:24.822586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:48.447 17:38:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:48.447 17:38:25 -- common/autotest_common.sh@862 -- # return 0 00:18:48.447 17:38:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:48.447 17:38:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:48.447 17:38:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.447 17:38:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:48.447 17:38:25 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:48.447 17:38:25 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:48.447 17:38:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.447 17:38:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.447 [2024-11-16 17:38:25.661633] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:48.447 17:38:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.447 17:38:25 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:48.447 17:38:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.447 17:38:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.447 17:38:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.447 17:38:25 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:48.447 17:38:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.447 17:38:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.447 [2024-11-16 17:38:25.677812] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:48.447 17:38:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.447 17:38:25 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:48.447 17:38:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.447 17:38:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.447 17:38:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.447 17:38:25 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:48.447 17:38:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.447 17:38:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.447 malloc0 00:18:48.447 17:38:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.447 17:38:25 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:48.447 17:38:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:48.447 17:38:25 -- common/autotest_common.sh@10 -- # set +x 00:18:48.447 17:38:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:48.447 17:38:25 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:48.447 17:38:25 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:48.447 17:38:25 -- nvmf/common.sh@520 -- # config=() 00:18:48.447 17:38:25 -- nvmf/common.sh@520 -- # local subsystem config 00:18:48.447 17:38:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:48.447 17:38:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:48.447 { 00:18:48.447 "params": { 00:18:48.447 "name": "Nvme$subsystem", 00:18:48.447 "trtype": "$TEST_TRANSPORT", 00:18:48.447 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:48.447 "adrfam": "ipv4", 00:18:48.447 "trsvcid": "$NVMF_PORT", 00:18:48.447 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:48.447 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:48.447 "hdgst": ${hdgst:-false}, 00:18:48.447 "ddgst": ${ddgst:-false} 00:18:48.447 }, 00:18:48.447 "method": "bdev_nvme_attach_controller" 00:18:48.447 } 00:18:48.447 EOF 00:18:48.447 )") 00:18:48.447 17:38:25 -- nvmf/common.sh@542 -- # cat 00:18:48.447 17:38:25 -- nvmf/common.sh@544 -- # jq . 00:18:48.447 17:38:25 -- nvmf/common.sh@545 -- # IFS=, 00:18:48.447 17:38:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:48.447 "params": { 00:18:48.447 "name": "Nvme1", 00:18:48.447 "trtype": "tcp", 00:18:48.447 "traddr": "10.0.0.2", 00:18:48.447 "adrfam": "ipv4", 00:18:48.447 "trsvcid": "4420", 00:18:48.447 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:48.447 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:48.447 "hdgst": false, 00:18:48.447 "ddgst": false 00:18:48.447 }, 00:18:48.447 "method": "bdev_nvme_attach_controller" 00:18:48.447 }' 00:18:48.447 [2024-11-16 17:38:25.750540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:48.447 [2024-11-16 17:38:25.750633] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1590621 ] 00:18:48.447 EAL: No free 2048 kB hugepages reported on node 1 00:18:48.447 [2024-11-16 17:38:25.814754] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:48.447 [2024-11-16 17:38:25.907028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:48.705 Running I/O for 10 seconds... 00:18:58.751 00:18:58.751 Latency(us) 00:18:58.751 [2024-11-16T16:38:36.243Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:58.751 [2024-11-16T16:38:36.243Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:58.751 Verification LBA range: start 0x0 length 0x1000 00:18:58.751 Nvme1n1 : 10.01 8631.94 67.44 0.00 0.00 14792.63 1438.15 22719.15 00:18:58.751 [2024-11-16T16:38:36.243Z] =================================================================================================================== 00:18:58.751 [2024-11-16T16:38:36.243Z] Total : 8631.94 67.44 0.00 0.00 14792.63 1438.15 22719.15 00:18:59.009 17:38:36 -- target/zcopy.sh@39 -- # perfpid=1591966 00:18:59.009 17:38:36 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:59.009 17:38:36 -- common/autotest_common.sh@10 -- # set +x 00:18:59.009 17:38:36 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:59.009 17:38:36 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:59.009 17:38:36 -- nvmf/common.sh@520 -- # config=() 00:18:59.009 17:38:36 -- nvmf/common.sh@520 -- # local subsystem config 00:18:59.009 17:38:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:59.009 17:38:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:59.009 { 00:18:59.009 "params": { 00:18:59.009 "name": "Nvme$subsystem", 00:18:59.009 "trtype": "$TEST_TRANSPORT", 00:18:59.009 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:59.009 "adrfam": "ipv4", 00:18:59.009 "trsvcid": "$NVMF_PORT", 00:18:59.009 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:59.009 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:59.009 "hdgst": ${hdgst:-false}, 00:18:59.009 "ddgst": ${ddgst:-false} 00:18:59.009 }, 00:18:59.009 "method": "bdev_nvme_attach_controller" 00:18:59.009 } 00:18:59.009 EOF 00:18:59.009 )") 00:18:59.009 17:38:36 -- nvmf/common.sh@542 -- # cat 00:18:59.009 [2024-11-16 17:38:36.403867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.009 [2024-11-16 17:38:36.403915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.009 17:38:36 -- nvmf/common.sh@544 -- # jq . 00:18:59.009 17:38:36 -- nvmf/common.sh@545 -- # IFS=, 00:18:59.010 17:38:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:59.010 "params": { 00:18:59.010 "name": "Nvme1", 00:18:59.010 "trtype": "tcp", 00:18:59.010 "traddr": "10.0.0.2", 00:18:59.010 "adrfam": "ipv4", 00:18:59.010 "trsvcid": "4420", 00:18:59.010 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:59.010 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:59.010 "hdgst": false, 00:18:59.010 "ddgst": false 00:18:59.010 }, 00:18:59.010 "method": "bdev_nvme_attach_controller" 00:18:59.010 }' 00:18:59.010 [2024-11-16 17:38:36.411828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.411855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.419846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.419871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.427868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.427893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.435889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.435914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.441961] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:59.010 [2024-11-16 17:38:36.442028] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1591966 ] 00:18:59.010 [2024-11-16 17:38:36.443912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.443936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.451935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.451959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.459956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.459981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.467977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.468001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.476000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.476023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 EAL: No free 2048 kB hugepages reported on node 1 00:18:59.010 [2024-11-16 17:38:36.484025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.484048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.492053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.492086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.010 [2024-11-16 17:38:36.500070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.010 [2024-11-16 17:38:36.500094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.268 [2024-11-16 17:38:36.508094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.268 [2024-11-16 17:38:36.508118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.268 [2024-11-16 17:38:36.510813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:59.268 [2024-11-16 17:38:36.516133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.268 [2024-11-16 17:38:36.516163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.268 [2024-11-16 17:38:36.524170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.268 [2024-11-16 17:38:36.524213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.268 [2024-11-16 17:38:36.532165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.532189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.540187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.540212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.548208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.548232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.556230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.556254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.564264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.564297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.572305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.572345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.580298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.580321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.588323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.588348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.596344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.596370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.604363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.604388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.606062] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:59.269 [2024-11-16 17:38:36.612386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.612410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.620415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.620441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.628458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.628497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.636480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.636528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.644507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.644547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.652535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.652572] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.660555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.660594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.668569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.668609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.676558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.676582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.684611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.684660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.692645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.692687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.700633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.700657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.708651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.708675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.716697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.716726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.724706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.724733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.732726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.732752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.740746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.740774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.748769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.748796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.269 [2024-11-16 17:38:36.756794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.269 [2024-11-16 17:38:36.756821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.527 [2024-11-16 17:38:36.764814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.527 [2024-11-16 17:38:36.764841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.527 [2024-11-16 17:38:36.772835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.527 [2024-11-16 17:38:36.772860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.527 [2024-11-16 17:38:36.780864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.527 [2024-11-16 17:38:36.780893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.527 Running I/O for 5 seconds... 00:18:59.527 [2024-11-16 17:38:36.788881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.527 [2024-11-16 17:38:36.788915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.803797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.803830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.814320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.814350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.825420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.825450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.836825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.836856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.848162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.848192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.859531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.859562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.870806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.870836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.884103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.884133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.894926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.894956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.905921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.905950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.916975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.917005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.928326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.928356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.941160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.941190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.951478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.951508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.962431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.962461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.973824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.973854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.984386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.984416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:36.996761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:36.996791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:37.005993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:37.006031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.528 [2024-11-16 17:38:37.019259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.528 [2024-11-16 17:38:37.019289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.029634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.029664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.040730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.040760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.053470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.053500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.063660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.063689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.075346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.075376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.086499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.086529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.097318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.097348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.108263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.108293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.121013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.121043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.131604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.131644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.142456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.142485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.155428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.155458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.165635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.165664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.175925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.175955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.186739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.186768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.199374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.199404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.209171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.209202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.220119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.220149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.233175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.233205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.243392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.243421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.254198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.254227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.265387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.265417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.786 [2024-11-16 17:38:37.276565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.786 [2024-11-16 17:38:37.276595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.287356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.287387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.298160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.298190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.311019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.311050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.321408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.321449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.332674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.332705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.343888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.343919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.354415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.354457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.365482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.365511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.376238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.376269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.387128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.387158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.400335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.400365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.410998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.411028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.421945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.421975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.432938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.432969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.443434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.443463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.454382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.454412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.465681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.465711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.479102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.479132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.489742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.489772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.500918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.500948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.513685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.513715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.524454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.524483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.045 [2024-11-16 17:38:37.535407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.045 [2024-11-16 17:38:37.535438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.546291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.546320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.557077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.557108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.569959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.569989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.580523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.580553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.591752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.591782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.604517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.604546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.615099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.615129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.625884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.625914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.636820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.636849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.647931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.647961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.659002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.659033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.669979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.670010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.682588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.682627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.692789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.692819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.703672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.703702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.716374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.716404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.726652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.726682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.737863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.737893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.749096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.749126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.759975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.760005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.772865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.772895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.783290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.783320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.304 [2024-11-16 17:38:37.794448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.304 [2024-11-16 17:38:37.794478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.807551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.807581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.817895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.817926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.828823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.828853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.842129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.842159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.852708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.852748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.863713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.863744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.874796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.874826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.886248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.886277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.899194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.899224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.909689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.909719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.920667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.920696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.933691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.933735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.943664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.943694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.954432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.954462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.966977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.967007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.976561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.976592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:37.988358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:37.988388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:38.001112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:38.001142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:38.011007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:38.011037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:38.021828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:38.021858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:38.033000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:38.033030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.563 [2024-11-16 17:38:38.044400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.563 [2024-11-16 17:38:38.044430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.057526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.057556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.068090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.068130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.078902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.078932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.090380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.090410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.101862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.101892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.113142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.113172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.124048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.124078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.135280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.135311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.148252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.148282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.158486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.158516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.169863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.169894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.180788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.180818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.191994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.192024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.203224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.203254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.214401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.214432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.822 [2024-11-16 17:38:38.227061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.822 [2024-11-16 17:38:38.227091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.823 [2024-11-16 17:38:38.237164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.823 [2024-11-16 17:38:38.237206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.823 [2024-11-16 17:38:38.248610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.823 [2024-11-16 17:38:38.248649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.823 [2024-11-16 17:38:38.260163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.823 [2024-11-16 17:38:38.260193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.823 [2024-11-16 17:38:38.271338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.823 [2024-11-16 17:38:38.271368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.823 [2024-11-16 17:38:38.282492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.823 [2024-11-16 17:38:38.282530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.823 [2024-11-16 17:38:38.295211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.823 [2024-11-16 17:38:38.295241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.823 [2024-11-16 17:38:38.306190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.823 [2024-11-16 17:38:38.306220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.317236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.317266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.329855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.329885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.340491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.340521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.351528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.351559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.364336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.364366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.374662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.374692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.385055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.385085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.396267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.396298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.409452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.409482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.419942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.081 [2024-11-16 17:38:38.419972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.081 [2024-11-16 17:38:38.430949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.430979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.442121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.442157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.452814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.452844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.465402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.465432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.475220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.475250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.487097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.487128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.499858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.499897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.510888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.510930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.521626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.521655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.532547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.532578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.543732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.543763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.556514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.556544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.082 [2024-11-16 17:38:38.567486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.082 [2024-11-16 17:38:38.567515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.578597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.578642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.591354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.591384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.601254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.601284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.612713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.612743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.625866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.625896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.636418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.636447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.646862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.646891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.657678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.657708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.670645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.670675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.680132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.680162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.691964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.691994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.702834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.702864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.714050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.714093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.725146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.725175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.735797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.735827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.747741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.747771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.757347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.757376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.769250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.769280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.780009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.780040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.790550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.790580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.801387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.801417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.812268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.812298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.341 [2024-11-16 17:38:38.825450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.341 [2024-11-16 17:38:38.825479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.835571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.835601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.846506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.846536] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.859097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.859128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.869002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.869032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.880195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.880225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.893021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.893059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.903144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.903174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.914124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.914155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.924912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.924942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.935892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.935922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.947180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.947210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.958116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.958145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.970967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.970996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.981360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.981390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:38.992237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:38.992266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:39.004985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:39.005015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:39.014237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:39.014267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:39.026364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:39.026393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:39.037153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:39.037183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:39.047877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:39.047907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:39.060404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:39.060433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:39.069851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:39.069881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.600 [2024-11-16 17:38:39.081160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.600 [2024-11-16 17:38:39.081190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.093998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.094028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.104330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.104359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.115278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.115307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.128176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.128206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.138264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.138294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.149442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.149472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.161234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.161265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.172606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.172644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.183533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.183562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.196591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.196630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.206729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.206758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.218552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.218581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.229414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.229444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.239991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.240021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.251174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.251203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.264006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.264035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.274475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.274504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.285262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.285292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.297932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.297962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.308287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.308318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.319329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.319359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.331653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.331682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.859 [2024-11-16 17:38:39.341573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.859 [2024-11-16 17:38:39.341603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.352035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.352065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.363068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.363097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.373969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.373999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.384723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.384753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.395363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.395392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.406232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.406261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.417148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.417178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.428344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.428374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.439182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.439212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.452132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.452161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.462061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.462091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.472866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.472896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.483839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.483869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.494601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.494640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.505395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.505425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.516126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.516156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.527000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.527030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.538106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.538136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.550735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.550774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.560785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.560816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.571431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.571461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.584450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.584480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.594244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.594275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.118 [2024-11-16 17:38:39.605842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.118 [2024-11-16 17:38:39.605873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.617005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.617035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.628000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.628030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.638844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.638883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.651961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.651992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.661919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.661949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.672599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.672637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.686719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.686750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.697572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.697603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.708579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.708609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.719642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.719672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.730784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.730814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.741821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.741851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.752775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.752804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.765325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.765366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.776076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.776107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.787035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.787065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.799969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.799998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.810107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.810137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.821259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.821289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.834035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.834064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.843909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.843938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.854961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.854991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.377 [2024-11-16 17:38:39.867950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.377 [2024-11-16 17:38:39.867979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.636 [2024-11-16 17:38:39.878344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.636 [2024-11-16 17:38:39.878373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.636 [2024-11-16 17:38:39.889236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.636 [2024-11-16 17:38:39.889266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.636 [2024-11-16 17:38:39.900485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.636 [2024-11-16 17:38:39.900515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.636 [2024-11-16 17:38:39.911674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.636 [2024-11-16 17:38:39.911704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.636 [2024-11-16 17:38:39.924508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:39.924537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:39.934478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:39.934508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:39.945285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:39.945315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:39.958095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:39.958125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:39.968322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:39.968352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:39.979117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:39.979158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:39.992447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:39.992477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.002774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.002805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.013722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.013753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.025042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.025080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.036069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.036103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.047286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.047318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.058313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.058343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.071986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.072017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.082676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.082706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.094111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.094141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.107039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.107070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.116517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.116548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.637 [2024-11-16 17:38:40.128144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.637 [2024-11-16 17:38:40.128174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.141389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.141419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.151134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.151163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.162194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.162223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.174814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.174844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.184459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.184489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.195594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.195643] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.208519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.208548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.218718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.218748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.229308] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.229339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.239744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.239774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.250867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.250896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.261683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.261713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.272929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.272959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.285741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.285772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.296043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.296073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.306560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.306590] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.317259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.317289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.328011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.328042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.338789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.338819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.349652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.349682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.362396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.362427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.895 [2024-11-16 17:38:40.372532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.895 [2024-11-16 17:38:40.372563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.896 [2024-11-16 17:38:40.384106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.896 [2024-11-16 17:38:40.384137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.395206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.395236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.405744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.405784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.416974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.417003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.427788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.427818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.439063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.439093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.450006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.450036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.463036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.463066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.473474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.473504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.484180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.484210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.497395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.497425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.509134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.509164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.517969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.517999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.529963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.529994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.540980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.541010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.552148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.552178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.563472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.563501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.574395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.574424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.585334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.585363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.596155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.154 [2024-11-16 17:38:40.596185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.154 [2024-11-16 17:38:40.606746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.155 [2024-11-16 17:38:40.606775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.155 [2024-11-16 17:38:40.619785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.155 [2024-11-16 17:38:40.619814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.155 [2024-11-16 17:38:40.630162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.155 [2024-11-16 17:38:40.630192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.155 [2024-11-16 17:38:40.641340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.155 [2024-11-16 17:38:40.641370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.652176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.652207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.663095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.663125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.676213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.676243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.686698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.686727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.697369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.697400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.707980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.708010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.718470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.718500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.729313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.729343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.740680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.740711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.752075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.752107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.762886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.762916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.773900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.773929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.785241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.785271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.796584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.796626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.807831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.807860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.820941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.820972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.831267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.831296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.842138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.842169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.852567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.413 [2024-11-16 17:38:40.852598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.413 [2024-11-16 17:38:40.863742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.414 [2024-11-16 17:38:40.863772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.414 [2024-11-16 17:38:40.876431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.414 [2024-11-16 17:38:40.876461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.414 [2024-11-16 17:38:40.886065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.414 [2024-11-16 17:38:40.886095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.414 [2024-11-16 17:38:40.897742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.414 [2024-11-16 17:38:40.897772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.908991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.909021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.920284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.920314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.931242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.931271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.943630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.943660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.953327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.953357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.964562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.964592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.975488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.975518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.986052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.986081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:40.996905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:40.996935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.007458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.007488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.018192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.018221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.028668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.028699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.039519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.039548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.050489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.050519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.063265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.063294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.073529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.073559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.084287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.084316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.095311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.095340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.106311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.106341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.119147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.119177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.129004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.129035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.139991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.140020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.151112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.151142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.673 [2024-11-16 17:38:41.161950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.673 [2024-11-16 17:38:41.161979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.174793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.174823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.185286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.185316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.196608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.196646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.209155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.209186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.218415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.218445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.230215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.230244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.242712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.242753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.252971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.253001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.264092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.264121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.277061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.277091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.287125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.287155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.298451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.298481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.311411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.311441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.321822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.321852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.332341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.332372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.343029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.343058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.353878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.353907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.364662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.364691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.375522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.375551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.386757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.386791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.398171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.398202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.409278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.409308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.932 [2024-11-16 17:38:41.422211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.932 [2024-11-16 17:38:41.422240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.431844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.431874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.442929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.442958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.453881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.453924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.464778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.464808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.477303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.477332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.487318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.487348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.498738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.498768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.511221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.511250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.521917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.521946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.532805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.532835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.546019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.546049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.555914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.555944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.566825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.566854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.580054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.580084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.590574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.590604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.601348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.601377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.612362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.612392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.623599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.623638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.636643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.636673] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.646482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.646512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.657603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.657642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.670781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.670817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.191 [2024-11-16 17:38:41.680379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.191 [2024-11-16 17:38:41.680410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.691041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.691071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.703576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.703607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.713767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.713798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.725727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.725766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.736754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.736784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.748095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.748125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.761398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.761427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.771686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.771715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.782828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.782858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.794099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.794129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.804980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.805010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 00:19:04.450 Latency(us) 00:19:04.450 [2024-11-16T16:38:41.942Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:04.450 [2024-11-16T16:38:41.942Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:04.450 Nvme1n1 : 5.01 11599.41 90.62 0.00 0.00 11020.59 4587.52 23010.42 00:19:04.450 [2024-11-16T16:38:41.942Z] =================================================================================================================== 00:19:04.450 [2024-11-16T16:38:41.942Z] Total : 11599.41 90.62 0.00 0.00 11020.59 4587.52 23010.42 00:19:04.450 [2024-11-16 17:38:41.812425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.812455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.820445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.820473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.828484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.828520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.836551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.836640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.848594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.848675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.856591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.856644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.864606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.864664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.872649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.872696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.880664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.880712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.888702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.888748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.896728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.896774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.904740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.904788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.912766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.912811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.920785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.920833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.928797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.928841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.450 [2024-11-16 17:38:41.936816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.450 [2024-11-16 17:38:41.936864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:41.944824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:41.944874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:41.952815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:41.952842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:41.960862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:41.960913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:41.968910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:41.968957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:41.976943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:41.976993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:41.984908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:41.984938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:41.992930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:41.992960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:42.000998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:42.001054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:42.009018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:42.009067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:42.017009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:42.017045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:42.025007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:42.025031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 [2024-11-16 17:38:42.033029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.709 [2024-11-16 17:38:42.033053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.709 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1591966) - No such process 00:19:04.709 17:38:42 -- target/zcopy.sh@49 -- # wait 1591966 00:19:04.709 17:38:42 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:04.709 17:38:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.709 17:38:42 -- common/autotest_common.sh@10 -- # set +x 00:19:04.709 17:38:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.709 17:38:42 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:04.709 17:38:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.709 17:38:42 -- common/autotest_common.sh@10 -- # set +x 00:19:04.709 delay0 00:19:04.710 17:38:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.710 17:38:42 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:04.710 17:38:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.710 17:38:42 -- common/autotest_common.sh@10 -- # set +x 00:19:04.710 17:38:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.710 17:38:42 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:04.710 EAL: No free 2048 kB hugepages reported on node 1 00:19:04.710 [2024-11-16 17:38:42.154446] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:12.819 Initializing NVMe Controllers 00:19:12.819 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:12.819 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:12.819 Initialization complete. Launching workers. 00:19:12.819 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 250, failed: 21523 00:19:12.819 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 21647, failed to submit 126 00:19:12.819 success 21557, unsuccess 90, failed 0 00:19:12.819 17:38:49 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:12.819 17:38:49 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:12.819 17:38:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:12.819 17:38:49 -- nvmf/common.sh@116 -- # sync 00:19:12.819 17:38:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:12.819 17:38:49 -- nvmf/common.sh@119 -- # set +e 00:19:12.819 17:38:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:12.819 17:38:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:12.819 rmmod nvme_tcp 00:19:12.819 rmmod nvme_fabrics 00:19:12.819 rmmod nvme_keyring 00:19:12.819 17:38:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:12.819 17:38:49 -- nvmf/common.sh@123 -- # set -e 00:19:12.819 17:38:49 -- nvmf/common.sh@124 -- # return 0 00:19:12.819 17:38:49 -- nvmf/common.sh@477 -- # '[' -n 1590464 ']' 00:19:12.819 17:38:49 -- nvmf/common.sh@478 -- # killprocess 1590464 00:19:12.819 17:38:49 -- common/autotest_common.sh@936 -- # '[' -z 1590464 ']' 00:19:12.819 17:38:49 -- common/autotest_common.sh@940 -- # kill -0 1590464 00:19:12.819 17:38:49 -- common/autotest_common.sh@941 -- # uname 00:19:12.819 17:38:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:12.819 17:38:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1590464 00:19:12.819 17:38:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:12.819 17:38:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:12.820 17:38:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1590464' 00:19:12.820 killing process with pid 1590464 00:19:12.820 17:38:49 -- common/autotest_common.sh@955 -- # kill 1590464 00:19:12.820 17:38:49 -- common/autotest_common.sh@960 -- # wait 1590464 00:19:12.820 17:38:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:12.820 17:38:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:12.820 17:38:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:12.820 17:38:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:12.820 17:38:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:12.820 17:38:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:12.820 17:38:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:12.820 17:38:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:14.199 17:38:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:14.199 00:19:14.199 real 0m29.390s 00:19:14.199 user 0m42.756s 00:19:14.199 sys 0m9.071s 00:19:14.199 17:38:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:14.199 17:38:51 -- common/autotest_common.sh@10 -- # set +x 00:19:14.199 ************************************ 00:19:14.199 END TEST nvmf_zcopy 00:19:14.199 ************************************ 00:19:14.199 17:38:51 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:14.199 17:38:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:14.199 17:38:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:14.199 17:38:51 -- common/autotest_common.sh@10 -- # set +x 00:19:14.199 ************************************ 00:19:14.199 START TEST nvmf_nmic 00:19:14.199 ************************************ 00:19:14.199 17:38:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:14.458 * Looking for test storage... 00:19:14.458 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:14.458 17:38:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:14.458 17:38:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:14.458 17:38:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:14.458 17:38:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:14.458 17:38:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:14.458 17:38:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:14.458 17:38:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:14.458 17:38:51 -- scripts/common.sh@335 -- # IFS=.-: 00:19:14.458 17:38:51 -- scripts/common.sh@335 -- # read -ra ver1 00:19:14.458 17:38:51 -- scripts/common.sh@336 -- # IFS=.-: 00:19:14.458 17:38:51 -- scripts/common.sh@336 -- # read -ra ver2 00:19:14.458 17:38:51 -- scripts/common.sh@337 -- # local 'op=<' 00:19:14.458 17:38:51 -- scripts/common.sh@339 -- # ver1_l=2 00:19:14.458 17:38:51 -- scripts/common.sh@340 -- # ver2_l=1 00:19:14.458 17:38:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:14.458 17:38:51 -- scripts/common.sh@343 -- # case "$op" in 00:19:14.458 17:38:51 -- scripts/common.sh@344 -- # : 1 00:19:14.458 17:38:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:14.458 17:38:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:14.458 17:38:51 -- scripts/common.sh@364 -- # decimal 1 00:19:14.458 17:38:51 -- scripts/common.sh@352 -- # local d=1 00:19:14.458 17:38:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:14.458 17:38:51 -- scripts/common.sh@354 -- # echo 1 00:19:14.458 17:38:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:14.458 17:38:51 -- scripts/common.sh@365 -- # decimal 2 00:19:14.458 17:38:51 -- scripts/common.sh@352 -- # local d=2 00:19:14.458 17:38:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:14.458 17:38:51 -- scripts/common.sh@354 -- # echo 2 00:19:14.458 17:38:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:14.458 17:38:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:14.458 17:38:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:14.458 17:38:51 -- scripts/common.sh@367 -- # return 0 00:19:14.458 17:38:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:14.458 17:38:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:14.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:14.458 --rc genhtml_branch_coverage=1 00:19:14.458 --rc genhtml_function_coverage=1 00:19:14.458 --rc genhtml_legend=1 00:19:14.458 --rc geninfo_all_blocks=1 00:19:14.458 --rc geninfo_unexecuted_blocks=1 00:19:14.458 00:19:14.458 ' 00:19:14.458 17:38:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:14.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:14.458 --rc genhtml_branch_coverage=1 00:19:14.458 --rc genhtml_function_coverage=1 00:19:14.458 --rc genhtml_legend=1 00:19:14.458 --rc geninfo_all_blocks=1 00:19:14.458 --rc geninfo_unexecuted_blocks=1 00:19:14.458 00:19:14.458 ' 00:19:14.458 17:38:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:14.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:14.458 --rc genhtml_branch_coverage=1 00:19:14.458 --rc genhtml_function_coverage=1 00:19:14.458 --rc genhtml_legend=1 00:19:14.458 --rc geninfo_all_blocks=1 00:19:14.458 --rc geninfo_unexecuted_blocks=1 00:19:14.458 00:19:14.458 ' 00:19:14.458 17:38:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:14.458 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:14.458 --rc genhtml_branch_coverage=1 00:19:14.458 --rc genhtml_function_coverage=1 00:19:14.458 --rc genhtml_legend=1 00:19:14.459 --rc geninfo_all_blocks=1 00:19:14.459 --rc geninfo_unexecuted_blocks=1 00:19:14.459 00:19:14.459 ' 00:19:14.459 17:38:51 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:14.459 17:38:51 -- nvmf/common.sh@7 -- # uname -s 00:19:14.459 17:38:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:14.459 17:38:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:14.459 17:38:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:14.459 17:38:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:14.459 17:38:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:14.459 17:38:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:14.459 17:38:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:14.459 17:38:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:14.459 17:38:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:14.459 17:38:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:14.459 17:38:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:14.459 17:38:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:14.459 17:38:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:14.459 17:38:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:14.459 17:38:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:14.459 17:38:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:14.459 17:38:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:14.459 17:38:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:14.459 17:38:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:14.459 17:38:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.459 17:38:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.459 17:38:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.459 17:38:51 -- paths/export.sh@5 -- # export PATH 00:19:14.459 17:38:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:14.459 17:38:51 -- nvmf/common.sh@46 -- # : 0 00:19:14.459 17:38:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:14.459 17:38:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:14.459 17:38:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:14.459 17:38:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:14.459 17:38:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:14.459 17:38:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:14.459 17:38:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:14.459 17:38:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:14.459 17:38:51 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:14.459 17:38:51 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:14.459 17:38:51 -- target/nmic.sh@14 -- # nvmftestinit 00:19:14.459 17:38:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:14.459 17:38:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:14.459 17:38:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:14.459 17:38:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:14.459 17:38:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:14.459 17:38:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:14.459 17:38:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:14.459 17:38:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:14.459 17:38:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:14.459 17:38:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:14.459 17:38:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:14.459 17:38:51 -- common/autotest_common.sh@10 -- # set +x 00:19:16.993 17:38:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:16.993 17:38:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:16.993 17:38:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:16.993 17:38:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:16.993 17:38:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:16.993 17:38:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:16.993 17:38:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:16.993 17:38:53 -- nvmf/common.sh@294 -- # net_devs=() 00:19:16.993 17:38:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:16.993 17:38:53 -- nvmf/common.sh@295 -- # e810=() 00:19:16.993 17:38:53 -- nvmf/common.sh@295 -- # local -ga e810 00:19:16.993 17:38:53 -- nvmf/common.sh@296 -- # x722=() 00:19:16.993 17:38:53 -- nvmf/common.sh@296 -- # local -ga x722 00:19:16.993 17:38:53 -- nvmf/common.sh@297 -- # mlx=() 00:19:16.993 17:38:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:16.993 17:38:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:16.993 17:38:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:16.993 17:38:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:16.993 17:38:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:16.993 17:38:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:16.993 17:38:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:16.993 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:16.993 17:38:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:16.993 17:38:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:16.993 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:16.993 17:38:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:16.993 17:38:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:16.993 17:38:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:16.993 17:38:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:16.993 17:38:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:16.993 17:38:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:16.993 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:16.993 17:38:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:16.993 17:38:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:16.993 17:38:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:16.993 17:38:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:16.993 17:38:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:16.993 17:38:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:16.993 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:16.993 17:38:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:16.993 17:38:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:16.993 17:38:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:16.993 17:38:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:16.993 17:38:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:16.993 17:38:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:16.993 17:38:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:16.993 17:38:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:16.993 17:38:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:16.993 17:38:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:16.993 17:38:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:16.993 17:38:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:16.993 17:38:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:16.993 17:38:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:16.993 17:38:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:16.993 17:38:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:16.993 17:38:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:16.993 17:38:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:16.993 17:38:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:16.993 17:38:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:16.993 17:38:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:16.993 17:38:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:16.993 17:38:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:16.993 17:38:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:16.993 17:38:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:16.993 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:16.993 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.181 ms 00:19:16.993 00:19:16.993 --- 10.0.0.2 ping statistics --- 00:19:16.993 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:16.993 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:19:16.993 17:38:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:16.993 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:16.993 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:19:16.993 00:19:16.993 --- 10.0.0.1 ping statistics --- 00:19:16.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:16.994 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:19:16.994 17:38:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:16.994 17:38:54 -- nvmf/common.sh@410 -- # return 0 00:19:16.994 17:38:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:16.994 17:38:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:16.994 17:38:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:16.994 17:38:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:16.994 17:38:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:16.994 17:38:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:16.994 17:38:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:16.994 17:38:54 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:16.994 17:38:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:16.994 17:38:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:16.994 17:38:54 -- common/autotest_common.sh@10 -- # set +x 00:19:16.994 17:38:54 -- nvmf/common.sh@469 -- # nvmfpid=1595419 00:19:16.994 17:38:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:16.994 17:38:54 -- nvmf/common.sh@470 -- # waitforlisten 1595419 00:19:16.994 17:38:54 -- common/autotest_common.sh@829 -- # '[' -z 1595419 ']' 00:19:16.994 17:38:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:16.994 17:38:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:16.994 17:38:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:16.994 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:16.994 17:38:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:16.994 17:38:54 -- common/autotest_common.sh@10 -- # set +x 00:19:16.994 [2024-11-16 17:38:54.089641] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:16.994 [2024-11-16 17:38:54.089722] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:16.994 EAL: No free 2048 kB hugepages reported on node 1 00:19:16.994 [2024-11-16 17:38:54.162611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:16.994 [2024-11-16 17:38:54.257757] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:16.994 [2024-11-16 17:38:54.257916] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:16.994 [2024-11-16 17:38:54.257935] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:16.994 [2024-11-16 17:38:54.257948] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:16.994 [2024-11-16 17:38:54.258004] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:16.994 [2024-11-16 17:38:54.258034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:16.994 [2024-11-16 17:38:54.258281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:16.994 [2024-11-16 17:38:54.258286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:17.928 17:38:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:17.928 17:38:55 -- common/autotest_common.sh@862 -- # return 0 00:19:17.928 17:38:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:17.928 17:38:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 17:38:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:17.928 17:38:55 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:17.928 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 [2024-11-16 17:38:55.085256] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:17.928 17:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.928 17:38:55 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:17.928 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 Malloc0 00:19:17.928 17:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.928 17:38:55 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:17.928 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 17:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.928 17:38:55 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:17.928 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 17:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.928 17:38:55 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:17.928 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 [2024-11-16 17:38:55.138772] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:17.928 17:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.928 17:38:55 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:17.928 test case1: single bdev can't be used in multiple subsystems 00:19:17.928 17:38:55 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:17.928 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 17:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.928 17:38:55 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:17.928 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 17:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.928 17:38:55 -- target/nmic.sh@28 -- # nmic_status=0 00:19:17.928 17:38:55 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:17.928 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.928 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.928 [2024-11-16 17:38:55.162573] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:17.928 [2024-11-16 17:38:55.162625] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:17.928 [2024-11-16 17:38:55.162642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:17.928 request: 00:19:17.928 { 00:19:17.928 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:17.928 "namespace": { 00:19:17.928 "bdev_name": "Malloc0" 00:19:17.928 }, 00:19:17.928 "method": "nvmf_subsystem_add_ns", 00:19:17.928 "req_id": 1 00:19:17.928 } 00:19:17.928 Got JSON-RPC error response 00:19:17.928 response: 00:19:17.928 { 00:19:17.928 "code": -32602, 00:19:17.928 "message": "Invalid parameters" 00:19:17.928 } 00:19:17.928 17:38:55 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:17.928 17:38:55 -- target/nmic.sh@29 -- # nmic_status=1 00:19:17.928 17:38:55 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:17.928 17:38:55 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:17.928 Adding namespace failed - expected result. 00:19:17.928 17:38:55 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:17.928 test case2: host connect to nvmf target in multiple paths 00:19:17.929 17:38:55 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:17.929 17:38:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:17.929 17:38:55 -- common/autotest_common.sh@10 -- # set +x 00:19:17.929 [2024-11-16 17:38:55.170735] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:17.929 17:38:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:17.929 17:38:55 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:18.494 17:38:55 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:19.060 17:38:56 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:19.060 17:38:56 -- common/autotest_common.sh@1187 -- # local i=0 00:19:19.060 17:38:56 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:19.060 17:38:56 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:19.060 17:38:56 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:20.957 17:38:58 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:20.957 17:38:58 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:20.957 17:38:58 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:20.957 17:38:58 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:20.957 17:38:58 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:20.957 17:38:58 -- common/autotest_common.sh@1197 -- # return 0 00:19:20.957 17:38:58 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:20.957 [global] 00:19:20.957 thread=1 00:19:20.957 invalidate=1 00:19:20.957 rw=write 00:19:20.957 time_based=1 00:19:20.957 runtime=1 00:19:20.957 ioengine=libaio 00:19:20.957 direct=1 00:19:20.957 bs=4096 00:19:20.957 iodepth=1 00:19:20.957 norandommap=0 00:19:20.958 numjobs=1 00:19:20.958 00:19:20.958 verify_dump=1 00:19:20.958 verify_backlog=512 00:19:20.958 verify_state_save=0 00:19:20.958 do_verify=1 00:19:20.958 verify=crc32c-intel 00:19:20.958 [job0] 00:19:20.958 filename=/dev/nvme0n1 00:19:20.958 Could not set queue depth (nvme0n1) 00:19:21.215 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:21.215 fio-3.35 00:19:21.215 Starting 1 thread 00:19:22.588 00:19:22.588 job0: (groupid=0, jobs=1): err= 0: pid=1596075: Sat Nov 16 17:38:59 2024 00:19:22.588 read: IOPS=21, BW=86.7KiB/s (88.8kB/s)(88.0KiB/1015msec) 00:19:22.588 slat (nsec): min=8116, max=33659, avg=21756.95, stdev=9501.65 00:19:22.588 clat (usec): min=40930, max=41147, avg=40979.49, stdev=46.68 00:19:22.588 lat (usec): min=40955, max=41155, avg=41001.25, stdev=42.38 00:19:22.588 clat percentiles (usec): 00:19:22.588 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:22.588 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:22.588 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:22.588 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:22.588 | 99.99th=[41157] 00:19:22.588 write: IOPS=504, BW=2018KiB/s (2066kB/s)(2048KiB/1015msec); 0 zone resets 00:19:22.588 slat (usec): min=7, max=29459, avg=73.36, stdev=1301.24 00:19:22.588 clat (usec): min=121, max=282, avg=143.91, stdev=14.68 00:19:22.588 lat (usec): min=129, max=29741, avg=217.28, stdev=1307.44 00:19:22.588 clat percentiles (usec): 00:19:22.588 | 1.00th=[ 124], 5.00th=[ 128], 10.00th=[ 131], 20.00th=[ 135], 00:19:22.588 | 30.00th=[ 139], 40.00th=[ 141], 50.00th=[ 143], 60.00th=[ 145], 00:19:22.588 | 70.00th=[ 149], 80.00th=[ 151], 90.00th=[ 155], 95.00th=[ 159], 00:19:22.588 | 99.00th=[ 212], 99.50th=[ 243], 99.90th=[ 281], 99.95th=[ 281], 00:19:22.588 | 99.99th=[ 281] 00:19:22.588 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:22.588 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:22.588 lat (usec) : 250=95.51%, 500=0.37% 00:19:22.588 lat (msec) : 50=4.12% 00:19:22.588 cpu : usr=0.30%, sys=0.79%, ctx=537, majf=0, minf=1 00:19:22.588 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:22.588 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.588 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:22.588 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:22.588 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:22.588 00:19:22.588 Run status group 0 (all jobs): 00:19:22.588 READ: bw=86.7KiB/s (88.8kB/s), 86.7KiB/s-86.7KiB/s (88.8kB/s-88.8kB/s), io=88.0KiB (90.1kB), run=1015-1015msec 00:19:22.588 WRITE: bw=2018KiB/s (2066kB/s), 2018KiB/s-2018KiB/s (2066kB/s-2066kB/s), io=2048KiB (2097kB), run=1015-1015msec 00:19:22.588 00:19:22.588 Disk stats (read/write): 00:19:22.588 nvme0n1: ios=71/512, merge=0/0, ticks=1218/66, in_queue=1284, util=98.50% 00:19:22.588 17:38:59 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:22.588 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:22.588 17:38:59 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:22.588 17:38:59 -- common/autotest_common.sh@1208 -- # local i=0 00:19:22.588 17:38:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:22.588 17:38:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:22.588 17:38:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:22.588 17:38:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:22.588 17:38:59 -- common/autotest_common.sh@1220 -- # return 0 00:19:22.588 17:38:59 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:22.588 17:38:59 -- target/nmic.sh@53 -- # nvmftestfini 00:19:22.588 17:38:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:22.588 17:38:59 -- nvmf/common.sh@116 -- # sync 00:19:22.588 17:38:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:22.588 17:38:59 -- nvmf/common.sh@119 -- # set +e 00:19:22.588 17:38:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:22.588 17:38:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:22.588 rmmod nvme_tcp 00:19:22.588 rmmod nvme_fabrics 00:19:22.588 rmmod nvme_keyring 00:19:22.588 17:38:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:22.588 17:39:00 -- nvmf/common.sh@123 -- # set -e 00:19:22.588 17:39:00 -- nvmf/common.sh@124 -- # return 0 00:19:22.588 17:39:00 -- nvmf/common.sh@477 -- # '[' -n 1595419 ']' 00:19:22.588 17:39:00 -- nvmf/common.sh@478 -- # killprocess 1595419 00:19:22.588 17:39:00 -- common/autotest_common.sh@936 -- # '[' -z 1595419 ']' 00:19:22.588 17:39:00 -- common/autotest_common.sh@940 -- # kill -0 1595419 00:19:22.588 17:39:00 -- common/autotest_common.sh@941 -- # uname 00:19:22.588 17:39:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:22.588 17:39:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1595419 00:19:22.588 17:39:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:22.588 17:39:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:22.588 17:39:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1595419' 00:19:22.588 killing process with pid 1595419 00:19:22.588 17:39:00 -- common/autotest_common.sh@955 -- # kill 1595419 00:19:22.588 17:39:00 -- common/autotest_common.sh@960 -- # wait 1595419 00:19:22.847 17:39:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:22.847 17:39:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:22.847 17:39:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:22.847 17:39:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:22.847 17:39:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:22.847 17:39:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:22.847 17:39:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:22.847 17:39:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.384 17:39:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:25.384 00:19:25.384 real 0m10.675s 00:19:25.384 user 0m25.224s 00:19:25.384 sys 0m2.424s 00:19:25.384 17:39:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:25.384 17:39:02 -- common/autotest_common.sh@10 -- # set +x 00:19:25.384 ************************************ 00:19:25.384 END TEST nvmf_nmic 00:19:25.384 ************************************ 00:19:25.384 17:39:02 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:25.384 17:39:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:25.384 17:39:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:25.384 17:39:02 -- common/autotest_common.sh@10 -- # set +x 00:19:25.384 ************************************ 00:19:25.384 START TEST nvmf_fio_target 00:19:25.384 ************************************ 00:19:25.384 17:39:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:25.384 * Looking for test storage... 00:19:25.384 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:25.384 17:39:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:25.384 17:39:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:25.384 17:39:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:25.384 17:39:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:25.384 17:39:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:25.384 17:39:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:25.384 17:39:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:25.384 17:39:02 -- scripts/common.sh@335 -- # IFS=.-: 00:19:25.384 17:39:02 -- scripts/common.sh@335 -- # read -ra ver1 00:19:25.384 17:39:02 -- scripts/common.sh@336 -- # IFS=.-: 00:19:25.384 17:39:02 -- scripts/common.sh@336 -- # read -ra ver2 00:19:25.384 17:39:02 -- scripts/common.sh@337 -- # local 'op=<' 00:19:25.384 17:39:02 -- scripts/common.sh@339 -- # ver1_l=2 00:19:25.384 17:39:02 -- scripts/common.sh@340 -- # ver2_l=1 00:19:25.384 17:39:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:25.384 17:39:02 -- scripts/common.sh@343 -- # case "$op" in 00:19:25.384 17:39:02 -- scripts/common.sh@344 -- # : 1 00:19:25.384 17:39:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:25.384 17:39:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:25.384 17:39:02 -- scripts/common.sh@364 -- # decimal 1 00:19:25.384 17:39:02 -- scripts/common.sh@352 -- # local d=1 00:19:25.384 17:39:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:25.384 17:39:02 -- scripts/common.sh@354 -- # echo 1 00:19:25.384 17:39:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:25.384 17:39:02 -- scripts/common.sh@365 -- # decimal 2 00:19:25.384 17:39:02 -- scripts/common.sh@352 -- # local d=2 00:19:25.384 17:39:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:25.384 17:39:02 -- scripts/common.sh@354 -- # echo 2 00:19:25.385 17:39:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:25.385 17:39:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:25.385 17:39:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:25.385 17:39:02 -- scripts/common.sh@367 -- # return 0 00:19:25.385 17:39:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:25.385 17:39:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:25.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.385 --rc genhtml_branch_coverage=1 00:19:25.385 --rc genhtml_function_coverage=1 00:19:25.385 --rc genhtml_legend=1 00:19:25.385 --rc geninfo_all_blocks=1 00:19:25.385 --rc geninfo_unexecuted_blocks=1 00:19:25.385 00:19:25.385 ' 00:19:25.385 17:39:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:25.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.385 --rc genhtml_branch_coverage=1 00:19:25.385 --rc genhtml_function_coverage=1 00:19:25.385 --rc genhtml_legend=1 00:19:25.385 --rc geninfo_all_blocks=1 00:19:25.385 --rc geninfo_unexecuted_blocks=1 00:19:25.385 00:19:25.385 ' 00:19:25.385 17:39:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:25.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.385 --rc genhtml_branch_coverage=1 00:19:25.385 --rc genhtml_function_coverage=1 00:19:25.385 --rc genhtml_legend=1 00:19:25.385 --rc geninfo_all_blocks=1 00:19:25.385 --rc geninfo_unexecuted_blocks=1 00:19:25.385 00:19:25.385 ' 00:19:25.385 17:39:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:25.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.385 --rc genhtml_branch_coverage=1 00:19:25.385 --rc genhtml_function_coverage=1 00:19:25.385 --rc genhtml_legend=1 00:19:25.385 --rc geninfo_all_blocks=1 00:19:25.385 --rc geninfo_unexecuted_blocks=1 00:19:25.385 00:19:25.385 ' 00:19:25.385 17:39:02 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:25.385 17:39:02 -- nvmf/common.sh@7 -- # uname -s 00:19:25.385 17:39:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:25.385 17:39:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:25.385 17:39:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:25.385 17:39:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:25.385 17:39:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:25.385 17:39:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:25.385 17:39:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:25.385 17:39:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:25.385 17:39:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:25.385 17:39:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:25.385 17:39:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.385 17:39:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.385 17:39:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:25.385 17:39:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:25.385 17:39:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:25.385 17:39:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:25.385 17:39:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:25.385 17:39:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:25.385 17:39:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:25.385 17:39:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.385 17:39:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.385 17:39:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.385 17:39:02 -- paths/export.sh@5 -- # export PATH 00:19:25.385 17:39:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.385 17:39:02 -- nvmf/common.sh@46 -- # : 0 00:19:25.385 17:39:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:25.385 17:39:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:25.385 17:39:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:25.385 17:39:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:25.385 17:39:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:25.385 17:39:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:25.385 17:39:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:25.385 17:39:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:25.385 17:39:02 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:25.385 17:39:02 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:25.385 17:39:02 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:25.385 17:39:02 -- target/fio.sh@16 -- # nvmftestinit 00:19:25.385 17:39:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:25.385 17:39:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:25.385 17:39:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:25.385 17:39:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:25.385 17:39:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:25.385 17:39:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:25.385 17:39:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:25.385 17:39:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.385 17:39:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:25.385 17:39:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:25.385 17:39:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:25.385 17:39:02 -- common/autotest_common.sh@10 -- # set +x 00:19:27.287 17:39:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:27.287 17:39:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:27.287 17:39:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:27.287 17:39:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:27.287 17:39:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:27.287 17:39:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:27.287 17:39:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:27.287 17:39:04 -- nvmf/common.sh@294 -- # net_devs=() 00:19:27.287 17:39:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:27.287 17:39:04 -- nvmf/common.sh@295 -- # e810=() 00:19:27.287 17:39:04 -- nvmf/common.sh@295 -- # local -ga e810 00:19:27.287 17:39:04 -- nvmf/common.sh@296 -- # x722=() 00:19:27.287 17:39:04 -- nvmf/common.sh@296 -- # local -ga x722 00:19:27.287 17:39:04 -- nvmf/common.sh@297 -- # mlx=() 00:19:27.287 17:39:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:27.287 17:39:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:27.287 17:39:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:27.287 17:39:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:27.287 17:39:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:27.287 17:39:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.287 17:39:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:27.287 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:27.287 17:39:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.287 17:39:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:27.287 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:27.287 17:39:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.287 17:39:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:27.288 17:39:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:27.288 17:39:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:27.288 17:39:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.288 17:39:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.288 17:39:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.288 17:39:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.288 17:39:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:27.288 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:27.288 17:39:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.288 17:39:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:27.288 17:39:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:27.288 17:39:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:27.288 17:39:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:27.288 17:39:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:27.288 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:27.288 17:39:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:27.288 17:39:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:27.288 17:39:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:27.288 17:39:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:27.288 17:39:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:27.288 17:39:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:27.288 17:39:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:27.288 17:39:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:27.288 17:39:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:27.288 17:39:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:27.288 17:39:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:27.288 17:39:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:27.288 17:39:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:27.288 17:39:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:27.288 17:39:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:27.288 17:39:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:27.288 17:39:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:27.288 17:39:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:27.288 17:39:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:27.288 17:39:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:27.288 17:39:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:27.288 17:39:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:27.288 17:39:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:27.288 17:39:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:27.288 17:39:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:27.288 17:39:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:27.288 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:27.288 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.196 ms 00:19:27.288 00:19:27.288 --- 10.0.0.2 ping statistics --- 00:19:27.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.288 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:19:27.288 17:39:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:27.288 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:27.288 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:19:27.288 00:19:27.288 --- 10.0.0.1 ping statistics --- 00:19:27.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:27.288 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:19:27.288 17:39:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:27.288 17:39:04 -- nvmf/common.sh@410 -- # return 0 00:19:27.288 17:39:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:27.288 17:39:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:27.288 17:39:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:27.288 17:39:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:27.288 17:39:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:27.288 17:39:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:27.288 17:39:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:27.288 17:39:04 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:27.288 17:39:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:27.288 17:39:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:27.288 17:39:04 -- common/autotest_common.sh@10 -- # set +x 00:19:27.288 17:39:04 -- nvmf/common.sh@469 -- # nvmfpid=1598379 00:19:27.288 17:39:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:27.288 17:39:04 -- nvmf/common.sh@470 -- # waitforlisten 1598379 00:19:27.288 17:39:04 -- common/autotest_common.sh@829 -- # '[' -z 1598379 ']' 00:19:27.288 17:39:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:27.288 17:39:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:27.288 17:39:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:27.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:27.288 17:39:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:27.288 17:39:04 -- common/autotest_common.sh@10 -- # set +x 00:19:27.288 [2024-11-16 17:39:04.722557] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:27.288 [2024-11-16 17:39:04.722663] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:27.288 EAL: No free 2048 kB hugepages reported on node 1 00:19:27.546 [2024-11-16 17:39:04.797433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:27.546 [2024-11-16 17:39:04.890206] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:27.546 [2024-11-16 17:39:04.890369] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:27.546 [2024-11-16 17:39:04.890388] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:27.546 [2024-11-16 17:39:04.890402] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:27.546 [2024-11-16 17:39:04.890460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:27.546 [2024-11-16 17:39:04.890515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:27.546 [2024-11-16 17:39:04.890568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:27.546 [2024-11-16 17:39:04.890570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:28.478 17:39:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:28.478 17:39:05 -- common/autotest_common.sh@862 -- # return 0 00:19:28.478 17:39:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:28.478 17:39:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:28.478 17:39:05 -- common/autotest_common.sh@10 -- # set +x 00:19:28.478 17:39:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:28.478 17:39:05 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:28.735 [2024-11-16 17:39:05.987206] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:28.735 17:39:06 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:28.993 17:39:06 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:28.993 17:39:06 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.251 17:39:06 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:29.251 17:39:06 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.509 17:39:06 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:29.509 17:39:06 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.767 17:39:07 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:29.767 17:39:07 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:30.024 17:39:07 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:30.281 17:39:07 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:30.281 17:39:07 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:30.538 17:39:07 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:30.538 17:39:07 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:30.796 17:39:08 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:30.796 17:39:08 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:31.053 17:39:08 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:31.309 17:39:08 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:31.309 17:39:08 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:31.566 17:39:09 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:31.566 17:39:09 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:32.131 17:39:09 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:32.131 [2024-11-16 17:39:09.537921] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:32.131 17:39:09 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:32.388 17:39:09 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:32.646 17:39:10 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:33.210 17:39:10 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:33.210 17:39:10 -- common/autotest_common.sh@1187 -- # local i=0 00:19:33.210 17:39:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:33.210 17:39:10 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:33.210 17:39:10 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:33.210 17:39:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:35.736 17:39:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:35.736 17:39:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:35.736 17:39:12 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:35.736 17:39:12 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:35.736 17:39:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:35.736 17:39:12 -- common/autotest_common.sh@1197 -- # return 0 00:19:35.736 17:39:12 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:35.736 [global] 00:19:35.736 thread=1 00:19:35.736 invalidate=1 00:19:35.736 rw=write 00:19:35.736 time_based=1 00:19:35.736 runtime=1 00:19:35.736 ioengine=libaio 00:19:35.736 direct=1 00:19:35.736 bs=4096 00:19:35.736 iodepth=1 00:19:35.736 norandommap=0 00:19:35.736 numjobs=1 00:19:35.736 00:19:35.736 verify_dump=1 00:19:35.736 verify_backlog=512 00:19:35.736 verify_state_save=0 00:19:35.736 do_verify=1 00:19:35.736 verify=crc32c-intel 00:19:35.736 [job0] 00:19:35.736 filename=/dev/nvme0n1 00:19:35.736 [job1] 00:19:35.736 filename=/dev/nvme0n2 00:19:35.736 [job2] 00:19:35.736 filename=/dev/nvme0n3 00:19:35.736 [job3] 00:19:35.736 filename=/dev/nvme0n4 00:19:35.736 Could not set queue depth (nvme0n1) 00:19:35.736 Could not set queue depth (nvme0n2) 00:19:35.736 Could not set queue depth (nvme0n3) 00:19:35.736 Could not set queue depth (nvme0n4) 00:19:35.736 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.736 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.736 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.736 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.736 fio-3.35 00:19:35.736 Starting 4 threads 00:19:36.734 00:19:36.734 job0: (groupid=0, jobs=1): err= 0: pid=1600024: Sat Nov 16 17:39:14 2024 00:19:36.734 read: IOPS=21, BW=85.8KiB/s (87.8kB/s)(88.0KiB/1026msec) 00:19:36.734 slat (nsec): min=8402, max=35764, avg=23461.77, stdev=9194.52 00:19:36.734 clat (usec): min=40851, max=42048, avg=41598.10, stdev=508.45 00:19:36.734 lat (usec): min=40870, max=42066, avg=41621.56, stdev=505.13 00:19:36.734 clat percentiles (usec): 00:19:36.734 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:36.734 | 30.00th=[41157], 40.00th=[41681], 50.00th=[41681], 60.00th=[42206], 00:19:36.734 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:36.734 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:36.734 | 99.99th=[42206] 00:19:36.734 write: IOPS=499, BW=1996KiB/s (2044kB/s)(2048KiB/1026msec); 0 zone resets 00:19:36.734 slat (nsec): min=8267, max=33281, avg=9660.72, stdev=1667.69 00:19:36.734 clat (usec): min=147, max=399, avg=201.80, stdev=32.42 00:19:36.734 lat (usec): min=157, max=408, avg=211.46, stdev=32.36 00:19:36.734 clat percentiles (usec): 00:19:36.734 | 1.00th=[ 153], 5.00th=[ 161], 10.00th=[ 165], 20.00th=[ 178], 00:19:36.734 | 30.00th=[ 190], 40.00th=[ 194], 50.00th=[ 198], 60.00th=[ 202], 00:19:36.734 | 70.00th=[ 206], 80.00th=[ 217], 90.00th=[ 245], 95.00th=[ 262], 00:19:36.734 | 99.00th=[ 310], 99.50th=[ 367], 99.90th=[ 400], 99.95th=[ 400], 00:19:36.734 | 99.99th=[ 400] 00:19:36.734 bw ( KiB/s): min= 4096, max= 4096, per=24.16%, avg=4096.00, stdev= 0.00, samples=1 00:19:36.734 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:36.734 lat (usec) : 250=87.64%, 500=8.24% 00:19:36.734 lat (msec) : 50=4.12% 00:19:36.734 cpu : usr=0.20%, sys=0.78%, ctx=535, majf=0, minf=1 00:19:36.734 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.734 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.734 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.734 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.734 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.734 job1: (groupid=0, jobs=1): err= 0: pid=1600025: Sat Nov 16 17:39:14 2024 00:19:36.734 read: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec) 00:19:36.734 slat (nsec): min=4359, max=48155, avg=9800.94, stdev=4064.70 00:19:36.734 clat (usec): min=163, max=593, avg=198.71, stdev=34.02 00:19:36.734 lat (usec): min=169, max=612, avg=208.51, stdev=35.44 00:19:36.734 clat percentiles (usec): 00:19:36.734 | 1.00th=[ 169], 5.00th=[ 176], 10.00th=[ 180], 20.00th=[ 184], 00:19:36.734 | 30.00th=[ 188], 40.00th=[ 190], 50.00th=[ 194], 60.00th=[ 196], 00:19:36.734 | 70.00th=[ 200], 80.00th=[ 204], 90.00th=[ 212], 95.00th=[ 243], 00:19:36.734 | 99.00th=[ 355], 99.50th=[ 474], 99.90th=[ 553], 99.95th=[ 586], 00:19:36.734 | 99.99th=[ 594] 00:19:36.734 write: IOPS=2843, BW=11.1MiB/s (11.6MB/s)(11.1MiB/1001msec); 0 zone resets 00:19:36.734 slat (nsec): min=6251, max=45935, avg=12944.79, stdev=4761.94 00:19:36.734 clat (usec): min=118, max=832, avg=144.64, stdev=29.34 00:19:36.734 lat (usec): min=126, max=838, avg=157.59, stdev=28.91 00:19:36.734 clat percentiles (usec): 00:19:36.734 | 1.00th=[ 122], 5.00th=[ 126], 10.00th=[ 129], 20.00th=[ 133], 00:19:36.734 | 30.00th=[ 135], 40.00th=[ 137], 50.00th=[ 139], 60.00th=[ 143], 00:19:36.734 | 70.00th=[ 147], 80.00th=[ 153], 90.00th=[ 167], 95.00th=[ 182], 00:19:36.734 | 99.00th=[ 221], 99.50th=[ 231], 99.90th=[ 570], 99.95th=[ 611], 00:19:36.734 | 99.99th=[ 832] 00:19:36.734 bw ( KiB/s): min=12288, max=12288, per=72.49%, avg=12288.00, stdev= 0.00, samples=1 00:19:36.734 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:19:36.734 lat (usec) : 250=97.78%, 500=2.00%, 750=0.20%, 1000=0.02% 00:19:36.734 cpu : usr=4.70%, sys=5.10%, ctx=5407, majf=0, minf=1 00:19:36.734 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.734 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.734 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.734 issued rwts: total=2560,2846,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.734 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.734 job2: (groupid=0, jobs=1): err= 0: pid=1600026: Sat Nov 16 17:39:14 2024 00:19:36.734 read: IOPS=22, BW=89.0KiB/s (91.1kB/s)(92.0KiB/1034msec) 00:19:36.734 slat (nsec): min=6975, max=38211, avg=21498.96, stdev=8637.33 00:19:36.734 clat (usec): min=40781, max=41024, avg=40962.84, stdev=53.95 00:19:36.734 lat (usec): min=40788, max=41057, avg=40984.34, stdev=54.55 00:19:36.734 clat percentiles (usec): 00:19:36.734 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:36.734 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:36.734 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:36.734 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:36.734 | 99.99th=[41157] 00:19:36.734 write: IOPS=495, BW=1981KiB/s (2028kB/s)(2048KiB/1034msec); 0 zone resets 00:19:36.734 slat (nsec): min=6119, max=28094, avg=7212.60, stdev=1714.07 00:19:36.734 clat (usec): min=138, max=300, avg=168.44, stdev=16.66 00:19:36.734 lat (usec): min=145, max=328, avg=175.65, stdev=17.01 00:19:36.734 clat percentiles (usec): 00:19:36.734 | 1.00th=[ 143], 5.00th=[ 147], 10.00th=[ 151], 20.00th=[ 155], 00:19:36.734 | 30.00th=[ 159], 40.00th=[ 161], 50.00th=[ 165], 60.00th=[ 172], 00:19:36.734 | 70.00th=[ 176], 80.00th=[ 182], 90.00th=[ 190], 95.00th=[ 200], 00:19:36.734 | 99.00th=[ 215], 99.50th=[ 219], 99.90th=[ 302], 99.95th=[ 302], 00:19:36.734 | 99.99th=[ 302] 00:19:36.734 bw ( KiB/s): min= 4096, max= 4096, per=24.16%, avg=4096.00, stdev= 0.00, samples=1 00:19:36.734 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:36.734 lat (usec) : 250=95.51%, 500=0.19% 00:19:36.734 lat (msec) : 50=4.30% 00:19:36.734 cpu : usr=0.29%, sys=0.19%, ctx=535, majf=0, minf=1 00:19:36.734 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.734 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.734 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.734 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.734 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.734 job3: (groupid=0, jobs=1): err= 0: pid=1600027: Sat Nov 16 17:39:14 2024 00:19:36.734 read: IOPS=21, BW=85.9KiB/s (87.9kB/s)(88.0KiB/1025msec) 00:19:36.734 slat (nsec): min=8049, max=37141, avg=24157.27, stdev=9675.43 00:19:36.734 clat (usec): min=40878, max=41078, avg=40972.37, stdev=45.81 00:19:36.734 lat (usec): min=40915, max=41086, avg=40996.53, stdev=39.38 00:19:36.734 clat percentiles (usec): 00:19:36.734 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:36.734 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:36.734 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:36.734 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:36.734 | 99.99th=[41157] 00:19:36.734 write: IOPS=499, BW=1998KiB/s (2046kB/s)(2048KiB/1025msec); 0 zone resets 00:19:36.734 slat (nsec): min=8516, max=32182, avg=10554.19, stdev=3513.42 00:19:36.734 clat (usec): min=145, max=418, avg=225.76, stdev=31.18 00:19:36.734 lat (usec): min=154, max=427, avg=236.32, stdev=30.44 00:19:36.734 clat percentiles (usec): 00:19:36.734 | 1.00th=[ 155], 5.00th=[ 165], 10.00th=[ 178], 20.00th=[ 192], 00:19:36.734 | 30.00th=[ 227], 40.00th=[ 239], 50.00th=[ 241], 60.00th=[ 243], 00:19:36.734 | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 245], 95.00th=[ 247], 00:19:36.734 | 99.00th=[ 273], 99.50th=[ 326], 99.90th=[ 420], 99.95th=[ 420], 00:19:36.734 | 99.99th=[ 420] 00:19:36.734 bw ( KiB/s): min= 4096, max= 4096, per=24.16%, avg=4096.00, stdev= 0.00, samples=1 00:19:36.734 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:36.734 lat (usec) : 250=93.63%, 500=2.25% 00:19:36.734 lat (msec) : 50=4.12% 00:19:36.734 cpu : usr=0.49%, sys=0.59%, ctx=537, majf=0, minf=1 00:19:36.734 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.734 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.734 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.734 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.734 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.734 00:19:36.734 Run status group 0 (all jobs): 00:19:36.734 READ: bw=9.92MiB/s (10.4MB/s), 85.8KiB/s-9.99MiB/s (87.8kB/s-10.5MB/s), io=10.3MiB (10.8MB), run=1001-1034msec 00:19:36.734 WRITE: bw=16.6MiB/s (17.4MB/s), 1981KiB/s-11.1MiB/s (2028kB/s-11.6MB/s), io=17.1MiB (17.9MB), run=1001-1034msec 00:19:36.734 00:19:36.734 Disk stats (read/write): 00:19:36.734 nvme0n1: ios=66/512, merge=0/0, ticks=777/104, in_queue=881, util=85.87% 00:19:36.734 nvme0n2: ios=2093/2560, merge=0/0, ticks=504/346, in_queue=850, util=90.55% 00:19:36.734 nvme0n3: ios=75/512, merge=0/0, ticks=813/84, in_queue=897, util=94.89% 00:19:36.734 nvme0n4: ios=41/512, merge=0/0, ticks=1609/113, in_queue=1722, util=94.33% 00:19:36.734 17:39:14 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:36.734 [global] 00:19:36.734 thread=1 00:19:36.734 invalidate=1 00:19:36.734 rw=randwrite 00:19:36.734 time_based=1 00:19:36.734 runtime=1 00:19:36.734 ioengine=libaio 00:19:36.734 direct=1 00:19:36.734 bs=4096 00:19:36.734 iodepth=1 00:19:36.734 norandommap=0 00:19:36.734 numjobs=1 00:19:36.734 00:19:36.734 verify_dump=1 00:19:36.735 verify_backlog=512 00:19:36.735 verify_state_save=0 00:19:36.735 do_verify=1 00:19:36.735 verify=crc32c-intel 00:19:36.735 [job0] 00:19:36.735 filename=/dev/nvme0n1 00:19:36.735 [job1] 00:19:36.735 filename=/dev/nvme0n2 00:19:36.735 [job2] 00:19:36.735 filename=/dev/nvme0n3 00:19:36.735 [job3] 00:19:36.735 filename=/dev/nvme0n4 00:19:36.994 Could not set queue depth (nvme0n1) 00:19:36.994 Could not set queue depth (nvme0n2) 00:19:36.994 Could not set queue depth (nvme0n3) 00:19:36.994 Could not set queue depth (nvme0n4) 00:19:36.994 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.994 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.994 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.994 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:36.994 fio-3.35 00:19:36.994 Starting 4 threads 00:19:38.369 00:19:38.369 job0: (groupid=0, jobs=1): err= 0: pid=1600269: Sat Nov 16 17:39:15 2024 00:19:38.369 read: IOPS=22, BW=88.9KiB/s (91.0kB/s)(92.0KiB/1035msec) 00:19:38.369 slat (nsec): min=6957, max=46206, avg=23337.74, stdev=10676.63 00:19:38.369 clat (usec): min=40878, max=41032, avg=40964.25, stdev=35.42 00:19:38.369 lat (usec): min=40885, max=41050, avg=40987.59, stdev=33.22 00:19:38.369 clat percentiles (usec): 00:19:38.369 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:38.369 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:38.369 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:38.369 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:38.369 | 99.99th=[41157] 00:19:38.369 write: IOPS=494, BW=1979KiB/s (2026kB/s)(2048KiB/1035msec); 0 zone resets 00:19:38.369 slat (nsec): min=6847, max=34935, avg=10210.05, stdev=5231.07 00:19:38.369 clat (usec): min=136, max=238, avg=165.18, stdev=16.40 00:19:38.369 lat (usec): min=145, max=272, avg=175.39, stdev=19.46 00:19:38.369 clat percentiles (usec): 00:19:38.369 | 1.00th=[ 139], 5.00th=[ 145], 10.00th=[ 147], 20.00th=[ 151], 00:19:38.369 | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 161], 60.00th=[ 167], 00:19:38.369 | 70.00th=[ 172], 80.00th=[ 180], 90.00th=[ 190], 95.00th=[ 198], 00:19:38.369 | 99.00th=[ 212], 99.50th=[ 215], 99.90th=[ 239], 99.95th=[ 239], 00:19:38.369 | 99.99th=[ 239] 00:19:38.369 bw ( KiB/s): min= 4096, max= 4096, per=29.71%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.369 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.369 lat (usec) : 250=95.70% 00:19:38.369 lat (msec) : 50=4.30% 00:19:38.369 cpu : usr=0.39%, sys=0.77%, ctx=535, majf=0, minf=1 00:19:38.369 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.369 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.369 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.369 issued rwts: total=23,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.369 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.369 job1: (groupid=0, jobs=1): err= 0: pid=1600270: Sat Nov 16 17:39:15 2024 00:19:38.369 read: IOPS=23, BW=92.3KiB/s (94.5kB/s)(96.0KiB/1040msec) 00:19:38.369 slat (nsec): min=6750, max=35366, avg=22720.13, stdev=9746.29 00:19:38.369 clat (usec): min=271, max=41165, avg=39271.13, stdev=8307.35 00:19:38.369 lat (usec): min=289, max=41171, avg=39293.85, stdev=8308.29 00:19:38.369 clat percentiles (usec): 00:19:38.369 | 1.00th=[ 273], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:38.369 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:38.369 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:38.369 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:38.369 | 99.99th=[41157] 00:19:38.369 write: IOPS=492, BW=1969KiB/s (2016kB/s)(2048KiB/1040msec); 0 zone resets 00:19:38.369 slat (nsec): min=6998, max=38999, avg=10236.93, stdev=5251.51 00:19:38.369 clat (usec): min=136, max=360, avg=174.16, stdev=33.90 00:19:38.369 lat (usec): min=144, max=388, avg=184.40, stdev=37.33 00:19:38.369 clat percentiles (usec): 00:19:38.369 | 1.00th=[ 141], 5.00th=[ 145], 10.00th=[ 147], 20.00th=[ 149], 00:19:38.369 | 30.00th=[ 153], 40.00th=[ 157], 50.00th=[ 161], 60.00th=[ 167], 00:19:38.369 | 70.00th=[ 176], 80.00th=[ 204], 90.00th=[ 225], 95.00th=[ 249], 00:19:38.369 | 99.00th=[ 277], 99.50th=[ 285], 99.90th=[ 359], 99.95th=[ 359], 00:19:38.369 | 99.99th=[ 359] 00:19:38.369 bw ( KiB/s): min= 4096, max= 4096, per=29.71%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.369 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.369 lat (usec) : 250=90.86%, 500=4.85% 00:19:38.369 lat (msec) : 50=4.29% 00:19:38.369 cpu : usr=0.19%, sys=0.87%, ctx=536, majf=0, minf=1 00:19:38.369 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.369 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.369 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.369 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.369 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.369 job2: (groupid=0, jobs=1): err= 0: pid=1600271: Sat Nov 16 17:39:15 2024 00:19:38.369 read: IOPS=26, BW=105KiB/s (107kB/s)(108KiB/1029msec) 00:19:38.369 slat (nsec): min=6112, max=33879, avg=22860.30, stdev=10116.71 00:19:38.369 clat (usec): min=199, max=41027, avg=33363.29, stdev=16095.37 00:19:38.369 lat (usec): min=215, max=41047, avg=33386.15, stdev=16095.06 00:19:38.369 clat percentiles (usec): 00:19:38.369 | 1.00th=[ 200], 5.00th=[ 217], 10.00th=[ 227], 20.00th=[40633], 00:19:38.369 | 30.00th=[40633], 40.00th=[40633], 50.00th=[41157], 60.00th=[41157], 00:19:38.369 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:38.369 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:38.369 | 99.99th=[41157] 00:19:38.369 write: IOPS=497, BW=1990KiB/s (2038kB/s)(2048KiB/1029msec); 0 zone resets 00:19:38.369 slat (nsec): min=5545, max=39946, avg=10332.45, stdev=6279.32 00:19:38.369 clat (usec): min=155, max=430, avg=234.53, stdev=40.63 00:19:38.369 lat (usec): min=165, max=470, avg=244.86, stdev=40.88 00:19:38.369 clat percentiles (usec): 00:19:38.369 | 1.00th=[ 163], 5.00th=[ 178], 10.00th=[ 188], 20.00th=[ 208], 00:19:38.369 | 30.00th=[ 217], 40.00th=[ 223], 50.00th=[ 233], 60.00th=[ 241], 00:19:38.369 | 70.00th=[ 247], 80.00th=[ 255], 90.00th=[ 269], 95.00th=[ 306], 00:19:38.369 | 99.00th=[ 379], 99.50th=[ 383], 99.90th=[ 433], 99.95th=[ 433], 00:19:38.369 | 99.99th=[ 433] 00:19:38.369 bw ( KiB/s): min= 4096, max= 4096, per=29.71%, avg=4096.00, stdev= 0.00, samples=1 00:19:38.369 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:38.369 lat (usec) : 250=74.03%, 500=21.89% 00:19:38.369 lat (msec) : 50=4.08% 00:19:38.369 cpu : usr=0.10%, sys=0.68%, ctx=539, majf=0, minf=1 00:19:38.369 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.369 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.369 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.369 issued rwts: total=27,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.369 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.369 job3: (groupid=0, jobs=1): err= 0: pid=1600273: Sat Nov 16 17:39:15 2024 00:19:38.369 read: IOPS=1984, BW=7936KiB/s (8127kB/s)(7944KiB/1001msec) 00:19:38.369 slat (nsec): min=5805, max=72935, avg=13512.00, stdev=7819.92 00:19:38.369 clat (usec): min=190, max=1960, avg=257.33, stdev=69.62 00:19:38.369 lat (usec): min=197, max=1975, avg=270.85, stdev=73.25 00:19:38.369 clat percentiles (usec): 00:19:38.369 | 1.00th=[ 200], 5.00th=[ 206], 10.00th=[ 212], 20.00th=[ 219], 00:19:38.369 | 30.00th=[ 227], 40.00th=[ 237], 50.00th=[ 245], 60.00th=[ 251], 00:19:38.369 | 70.00th=[ 260], 80.00th=[ 273], 90.00th=[ 302], 95.00th=[ 404], 00:19:38.369 | 99.00th=[ 523], 99.50th=[ 545], 99.90th=[ 578], 99.95th=[ 1958], 00:19:38.369 | 99.99th=[ 1958] 00:19:38.369 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:38.369 slat (nsec): min=7314, max=73810, avg=16821.08, stdev=7098.31 00:19:38.369 clat (usec): min=140, max=533, avg=200.54, stdev=61.27 00:19:38.369 lat (usec): min=148, max=546, avg=217.36, stdev=61.68 00:19:38.369 clat percentiles (usec): 00:19:38.369 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 159], 20.00th=[ 163], 00:19:38.369 | 30.00th=[ 167], 40.00th=[ 174], 50.00th=[ 182], 60.00th=[ 188], 00:19:38.369 | 70.00th=[ 202], 80.00th=[ 215], 90.00th=[ 260], 95.00th=[ 379], 00:19:38.369 | 99.00th=[ 445], 99.50th=[ 461], 99.90th=[ 510], 99.95th=[ 510], 00:19:38.369 | 99.99th=[ 537] 00:19:38.369 bw ( KiB/s): min= 8192, max= 8192, per=59.43%, avg=8192.00, stdev= 0.00, samples=1 00:19:38.369 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:38.369 lat (usec) : 250=73.55%, 500=25.76%, 750=0.67% 00:19:38.369 lat (msec) : 2=0.02% 00:19:38.369 cpu : usr=4.40%, sys=6.80%, ctx=4035, majf=0, minf=1 00:19:38.369 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:38.369 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.369 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.369 issued rwts: total=1986,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.369 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:38.369 00:19:38.369 Run status group 0 (all jobs): 00:19:38.370 READ: bw=7923KiB/s (8113kB/s), 88.9KiB/s-7936KiB/s (91.0kB/s-8127kB/s), io=8240KiB (8438kB), run=1001-1040msec 00:19:38.370 WRITE: bw=13.5MiB/s (14.1MB/s), 1969KiB/s-8184KiB/s (2016kB/s-8380kB/s), io=14.0MiB (14.7MB), run=1001-1040msec 00:19:38.370 00:19:38.370 Disk stats (read/write): 00:19:38.370 nvme0n1: ios=68/512, merge=0/0, ticks=770/80, in_queue=850, util=86.67% 00:19:38.370 nvme0n2: ios=32/512, merge=0/0, ticks=747/91, in_queue=838, util=86.34% 00:19:38.370 nvme0n3: ios=18/512, merge=0/0, ticks=697/120, in_queue=817, util=88.77% 00:19:38.370 nvme0n4: ios=1593/1791, merge=0/0, ticks=549/362, in_queue=911, util=97.67% 00:19:38.370 17:39:15 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:38.370 [global] 00:19:38.370 thread=1 00:19:38.370 invalidate=1 00:19:38.370 rw=write 00:19:38.370 time_based=1 00:19:38.370 runtime=1 00:19:38.370 ioengine=libaio 00:19:38.370 direct=1 00:19:38.370 bs=4096 00:19:38.370 iodepth=128 00:19:38.370 norandommap=0 00:19:38.370 numjobs=1 00:19:38.370 00:19:38.370 verify_dump=1 00:19:38.370 verify_backlog=512 00:19:38.370 verify_state_save=0 00:19:38.370 do_verify=1 00:19:38.370 verify=crc32c-intel 00:19:38.370 [job0] 00:19:38.370 filename=/dev/nvme0n1 00:19:38.370 [job1] 00:19:38.370 filename=/dev/nvme0n2 00:19:38.370 [job2] 00:19:38.370 filename=/dev/nvme0n3 00:19:38.370 [job3] 00:19:38.370 filename=/dev/nvme0n4 00:19:38.370 Could not set queue depth (nvme0n1) 00:19:38.370 Could not set queue depth (nvme0n2) 00:19:38.370 Could not set queue depth (nvme0n3) 00:19:38.370 Could not set queue depth (nvme0n4) 00:19:38.628 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.628 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.628 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.628 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.628 fio-3.35 00:19:38.628 Starting 4 threads 00:19:40.002 00:19:40.002 job0: (groupid=0, jobs=1): err= 0: pid=1600522: Sat Nov 16 17:39:17 2024 00:19:40.002 read: IOPS=4063, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1008msec) 00:19:40.002 slat (usec): min=2, max=14250, avg=93.33, stdev=704.27 00:19:40.002 clat (usec): min=873, max=45138, avg=12663.88, stdev=6991.46 00:19:40.002 lat (usec): min=887, max=47353, avg=12757.21, stdev=7056.22 00:19:40.002 clat percentiles (usec): 00:19:40.002 | 1.00th=[ 1467], 5.00th=[ 5276], 10.00th=[ 7439], 20.00th=[ 9110], 00:19:40.002 | 30.00th=[ 9503], 40.00th=[ 9765], 50.00th=[10028], 60.00th=[11863], 00:19:40.002 | 70.00th=[13435], 80.00th=[15664], 90.00th=[19530], 95.00th=[29754], 00:19:40.002 | 99.00th=[39060], 99.50th=[44303], 99.90th=[45351], 99.95th=[45351], 00:19:40.002 | 99.99th=[45351] 00:19:40.002 write: IOPS=4969, BW=19.4MiB/s (20.4MB/s)(19.6MiB/1008msec); 0 zone resets 00:19:40.002 slat (usec): min=3, max=14995, avg=97.82, stdev=779.91 00:19:40.002 clat (usec): min=254, max=101468, avg=15161.20, stdev=16417.38 00:19:40.002 lat (usec): min=341, max=101482, avg=15259.01, stdev=16494.55 00:19:40.002 clat percentiles (usec): 00:19:40.002 | 1.00th=[ 840], 5.00th=[ 2180], 10.00th=[ 3359], 20.00th=[ 5800], 00:19:40.002 | 30.00th=[ 8586], 40.00th=[ 9896], 50.00th=[ 10290], 60.00th=[ 10683], 00:19:40.002 | 70.00th=[ 14353], 80.00th=[ 17433], 90.00th=[ 28181], 95.00th=[ 56361], 00:19:40.002 | 99.00th=[ 89654], 99.50th=[ 95945], 99.90th=[101188], 99.95th=[101188], 00:19:40.002 | 99.99th=[101188] 00:19:40.002 bw ( KiB/s): min=14072, max=24976, per=33.23%, avg=19524.00, stdev=7710.29, samples=2 00:19:40.002 iops : min= 3518, max= 6244, avg=4881.00, stdev=1927.57, samples=2 00:19:40.002 lat (usec) : 500=0.20%, 750=0.22%, 1000=0.67% 00:19:40.002 lat (msec) : 2=2.09%, 4=6.19%, 10=36.74%, 20=40.48%, 50=10.25% 00:19:40.002 lat (msec) : 100=3.01%, 250=0.15% 00:19:40.002 cpu : usr=4.27%, sys=6.26%, ctx=333, majf=0, minf=2 00:19:40.002 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:40.002 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.002 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.002 issued rwts: total=4096,5009,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.002 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.002 job1: (groupid=0, jobs=1): err= 0: pid=1600534: Sat Nov 16 17:39:17 2024 00:19:40.002 read: IOPS=1616, BW=6467KiB/s (6622kB/s)(6784KiB/1049msec) 00:19:40.002 slat (usec): min=3, max=12605, avg=256.22, stdev=1326.51 00:19:40.002 clat (usec): min=14514, max=83745, avg=32739.41, stdev=12769.66 00:19:40.002 lat (usec): min=14535, max=86116, avg=32995.63, stdev=12840.04 00:19:40.002 clat percentiles (usec): 00:19:40.002 | 1.00th=[15401], 5.00th=[17433], 10.00th=[18482], 20.00th=[22938], 00:19:40.002 | 30.00th=[26084], 40.00th=[27919], 50.00th=[31065], 60.00th=[33817], 00:19:40.002 | 70.00th=[36439], 80.00th=[39060], 90.00th=[46400], 95.00th=[63177], 00:19:40.002 | 99.00th=[74974], 99.50th=[74974], 99.90th=[83362], 99.95th=[83362], 00:19:40.002 | 99.99th=[83362] 00:19:40.002 write: IOPS=1952, BW=7809KiB/s (7997kB/s)(8192KiB/1049msec); 0 zone resets 00:19:40.002 slat (usec): min=4, max=25561, avg=264.05, stdev=1543.56 00:19:40.002 clat (usec): min=8617, max=87515, avg=37229.21, stdev=18326.35 00:19:40.002 lat (usec): min=8657, max=87524, avg=37493.27, stdev=18470.06 00:19:40.002 clat percentiles (usec): 00:19:40.002 | 1.00th=[ 9896], 5.00th=[12911], 10.00th=[17433], 20.00th=[21365], 00:19:40.002 | 30.00th=[21890], 40.00th=[25822], 50.00th=[37487], 60.00th=[40109], 00:19:40.002 | 70.00th=[44303], 80.00th=[52691], 90.00th=[64226], 95.00th=[70779], 00:19:40.002 | 99.00th=[81265], 99.50th=[86508], 99.90th=[87557], 99.95th=[87557], 00:19:40.002 | 99.99th=[87557] 00:19:40.002 bw ( KiB/s): min= 8192, max= 8192, per=13.94%, avg=8192.00, stdev= 0.00, samples=2 00:19:40.002 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=2 00:19:40.002 lat (msec) : 10=0.59%, 20=15.25%, 50=67.39%, 100=16.77% 00:19:40.002 cpu : usr=2.77%, sys=5.06%, ctx=221, majf=0, minf=1 00:19:40.002 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:19:40.002 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.002 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.002 issued rwts: total=1696,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.002 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.003 job2: (groupid=0, jobs=1): err= 0: pid=1600571: Sat Nov 16 17:39:17 2024 00:19:40.003 read: IOPS=3545, BW=13.8MiB/s (14.5MB/s)(14.0MiB/1011msec) 00:19:40.003 slat (usec): min=2, max=13088, avg=128.89, stdev=854.62 00:19:40.003 clat (usec): min=6434, max=40669, avg=16477.87, stdev=4690.63 00:19:40.003 lat (usec): min=6446, max=40674, avg=16606.76, stdev=4765.75 00:19:40.003 clat percentiles (usec): 00:19:40.003 | 1.00th=[ 9634], 5.00th=[10290], 10.00th=[10683], 20.00th=[11731], 00:19:40.003 | 30.00th=[13566], 40.00th=[14746], 50.00th=[15664], 60.00th=[17433], 00:19:40.003 | 70.00th=[18482], 80.00th=[20317], 90.00th=[23200], 95.00th=[25035], 00:19:40.003 | 99.00th=[28443], 99.50th=[28705], 99.90th=[32113], 99.95th=[39060], 00:19:40.003 | 99.99th=[40633] 00:19:40.003 write: IOPS=3702, BW=14.5MiB/s (15.2MB/s)(14.6MiB/1011msec); 0 zone resets 00:19:40.003 slat (usec): min=3, max=24243, avg=122.60, stdev=931.27 00:19:40.003 clat (usec): min=3720, max=68373, avg=18286.07, stdev=10052.70 00:19:40.003 lat (usec): min=3736, max=68384, avg=18408.67, stdev=10114.72 00:19:40.003 clat percentiles (usec): 00:19:40.003 | 1.00th=[ 4621], 5.00th=[ 6652], 10.00th=[ 8225], 20.00th=[11863], 00:19:40.003 | 30.00th=[12518], 40.00th=[13173], 50.00th=[14746], 60.00th=[17171], 00:19:40.003 | 70.00th=[21365], 80.00th=[25822], 90.00th=[32637], 95.00th=[38536], 00:19:40.003 | 99.00th=[52167], 99.50th=[56886], 99.90th=[62653], 99.95th=[62653], 00:19:40.003 | 99.99th=[68682] 00:19:40.003 bw ( KiB/s): min=10456, max=18472, per=24.62%, avg=14464.00, stdev=5668.17, samples=2 00:19:40.003 iops : min= 2614, max= 4618, avg=3616.00, stdev=1417.04, samples=2 00:19:40.003 lat (msec) : 4=0.11%, 10=10.21%, 20=61.68%, 50=27.30%, 100=0.71% 00:19:40.003 cpu : usr=4.36%, sys=8.71%, ctx=233, majf=0, minf=1 00:19:40.003 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:19:40.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.003 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.003 issued rwts: total=3584,3743,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.003 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.003 job3: (groupid=0, jobs=1): err= 0: pid=1600578: Sat Nov 16 17:39:17 2024 00:19:40.003 read: IOPS=4430, BW=17.3MiB/s (18.1MB/s)(17.5MiB/1009msec) 00:19:40.003 slat (usec): min=2, max=11121, avg=97.12, stdev=629.12 00:19:40.003 clat (usec): min=1318, max=43670, avg=12934.43, stdev=4745.81 00:19:40.003 lat (usec): min=1328, max=43689, avg=13031.55, stdev=4776.02 00:19:40.003 clat percentiles (usec): 00:19:40.003 | 1.00th=[ 1844], 5.00th=[ 6652], 10.00th=[ 8848], 20.00th=[10552], 00:19:40.003 | 30.00th=[11076], 40.00th=[11469], 50.00th=[12387], 60.00th=[13566], 00:19:40.003 | 70.00th=[14353], 80.00th=[15008], 90.00th=[16188], 95.00th=[21627], 00:19:40.003 | 99.00th=[33817], 99.50th=[39060], 99.90th=[40109], 99.95th=[40109], 00:19:40.003 | 99.99th=[43779] 00:19:40.003 write: IOPS=4566, BW=17.8MiB/s (18.7MB/s)(18.0MiB/1009msec); 0 zone resets 00:19:40.003 slat (usec): min=3, max=40077, avg=108.27, stdev=1048.20 00:19:40.003 clat (usec): min=224, max=101683, avg=13092.95, stdev=8147.71 00:19:40.003 lat (usec): min=240, max=101698, avg=13201.22, stdev=8271.41 00:19:40.003 clat percentiles (usec): 00:19:40.003 | 1.00th=[ 1156], 5.00th=[ 3490], 10.00th=[ 6325], 20.00th=[ 9503], 00:19:40.003 | 30.00th=[ 10421], 40.00th=[ 10814], 50.00th=[ 11207], 60.00th=[ 12518], 00:19:40.003 | 70.00th=[ 13435], 80.00th=[ 14877], 90.00th=[ 18220], 95.00th=[ 30540], 00:19:40.003 | 99.00th=[ 41157], 99.50th=[ 41681], 99.90th=[ 86508], 99.95th=[101188], 00:19:40.003 | 99.99th=[101188] 00:19:40.003 bw ( KiB/s): min=16384, max=20480, per=31.37%, avg=18432.00, stdev=2896.31, samples=2 00:19:40.003 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:19:40.003 lat (usec) : 250=0.01%, 500=0.04%, 750=0.04%, 1000=0.22% 00:19:40.003 lat (msec) : 2=1.61%, 4=3.04%, 10=13.96%, 20=73.69%, 50=7.19% 00:19:40.003 lat (msec) : 100=0.14%, 250=0.04% 00:19:40.003 cpu : usr=2.88%, sys=7.74%, ctx=398, majf=0, minf=1 00:19:40.003 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:40.003 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:40.003 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:40.003 issued rwts: total=4470,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:40.003 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:40.003 00:19:40.003 Run status group 0 (all jobs): 00:19:40.003 READ: bw=51.6MiB/s (54.1MB/s), 6467KiB/s-17.3MiB/s (6622kB/s-18.1MB/s), io=54.1MiB (56.7MB), run=1008-1049msec 00:19:40.003 WRITE: bw=57.4MiB/s (60.2MB/s), 7809KiB/s-19.4MiB/s (7997kB/s-20.4MB/s), io=60.2MiB (63.1MB), run=1008-1049msec 00:19:40.003 00:19:40.003 Disk stats (read/write): 00:19:40.003 nvme0n1: ios=3127/4096, merge=0/0, ticks=28455/45441, in_queue=73896, util=99.50% 00:19:40.003 nvme0n2: ios=1557/1536, merge=0/0, ticks=17237/18730, in_queue=35967, util=98.98% 00:19:40.003 nvme0n3: ios=3130/3263, merge=0/0, ticks=30637/35577, in_queue=66214, util=97.60% 00:19:40.003 nvme0n4: ios=3658/4096, merge=0/0, ticks=29370/27254, in_queue=56624, util=96.42% 00:19:40.003 17:39:17 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:40.003 [global] 00:19:40.003 thread=1 00:19:40.003 invalidate=1 00:19:40.003 rw=randwrite 00:19:40.003 time_based=1 00:19:40.003 runtime=1 00:19:40.003 ioengine=libaio 00:19:40.003 direct=1 00:19:40.003 bs=4096 00:19:40.003 iodepth=128 00:19:40.003 norandommap=0 00:19:40.003 numjobs=1 00:19:40.003 00:19:40.003 verify_dump=1 00:19:40.003 verify_backlog=512 00:19:40.003 verify_state_save=0 00:19:40.003 do_verify=1 00:19:40.003 verify=crc32c-intel 00:19:40.003 [job0] 00:19:40.003 filename=/dev/nvme0n1 00:19:40.003 [job1] 00:19:40.003 filename=/dev/nvme0n2 00:19:40.003 [job2] 00:19:40.003 filename=/dev/nvme0n3 00:19:40.003 [job3] 00:19:40.003 filename=/dev/nvme0n4 00:19:40.003 Could not set queue depth (nvme0n1) 00:19:40.003 Could not set queue depth (nvme0n2) 00:19:40.003 Could not set queue depth (nvme0n3) 00:19:40.003 Could not set queue depth (nvme0n4) 00:19:40.003 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.003 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.003 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.003 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:40.003 fio-3.35 00:19:40.003 Starting 4 threads 00:19:41.377 00:19:41.377 job0: (groupid=0, jobs=1): err= 0: pid=1600858: Sat Nov 16 17:39:18 2024 00:19:41.377 read: IOPS=3982, BW=15.6MiB/s (16.3MB/s)(15.6MiB/1005msec) 00:19:41.377 slat (usec): min=2, max=10579, avg=128.17, stdev=758.27 00:19:41.377 clat (usec): min=4573, max=38015, avg=16839.03, stdev=7789.94 00:19:41.377 lat (usec): min=4579, max=38036, avg=16967.20, stdev=7836.93 00:19:41.377 clat percentiles (usec): 00:19:41.377 | 1.00th=[ 4817], 5.00th=[ 9241], 10.00th=[10028], 20.00th=[11076], 00:19:41.377 | 30.00th=[11600], 40.00th=[12256], 50.00th=[14615], 60.00th=[15139], 00:19:41.377 | 70.00th=[19006], 80.00th=[22676], 90.00th=[30278], 95.00th=[34341], 00:19:41.377 | 99.00th=[36963], 99.50th=[38011], 99.90th=[38011], 99.95th=[38011], 00:19:41.377 | 99.99th=[38011] 00:19:41.377 write: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec); 0 zone resets 00:19:41.377 slat (usec): min=4, max=13616, avg=110.66, stdev=711.04 00:19:41.377 clat (usec): min=1826, max=33156, avg=14675.94, stdev=5135.47 00:19:41.377 lat (usec): min=1832, max=33163, avg=14786.61, stdev=5164.91 00:19:41.377 clat percentiles (usec): 00:19:41.377 | 1.00th=[ 5211], 5.00th=[ 9372], 10.00th=[ 9765], 20.00th=[10683], 00:19:41.377 | 30.00th=[11338], 40.00th=[11994], 50.00th=[13173], 60.00th=[15008], 00:19:41.377 | 70.00th=[16319], 80.00th=[18220], 90.00th=[21627], 95.00th=[24249], 00:19:41.377 | 99.00th=[31851], 99.50th=[32375], 99.90th=[33162], 99.95th=[33162], 00:19:41.377 | 99.99th=[33162] 00:19:41.377 bw ( KiB/s): min=16384, max=16416, per=25.95%, avg=16400.00, stdev=22.63, samples=2 00:19:41.377 iops : min= 4096, max= 4104, avg=4100.00, stdev= 5.66, samples=2 00:19:41.377 lat (msec) : 2=0.06%, 4=0.25%, 10=10.89%, 20=67.50%, 50=21.30% 00:19:41.377 cpu : usr=4.08%, sys=5.18%, ctx=352, majf=0, minf=1 00:19:41.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:41.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.377 issued rwts: total=4002,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.377 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.377 job1: (groupid=0, jobs=1): err= 0: pid=1600859: Sat Nov 16 17:39:18 2024 00:19:41.377 read: IOPS=5099, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1004msec) 00:19:41.377 slat (usec): min=2, max=21210, avg=92.84, stdev=546.00 00:19:41.377 clat (usec): min=6811, max=32167, avg=12281.08, stdev=4531.94 00:19:41.377 lat (usec): min=6816, max=36562, avg=12373.92, stdev=4570.56 00:19:41.377 clat percentiles (usec): 00:19:41.377 | 1.00th=[ 7439], 5.00th=[ 8586], 10.00th=[ 9765], 20.00th=[10028], 00:19:41.377 | 30.00th=[10159], 40.00th=[10290], 50.00th=[10421], 60.00th=[10683], 00:19:41.377 | 70.00th=[11076], 80.00th=[15270], 90.00th=[16909], 95.00th=[25035], 00:19:41.377 | 99.00th=[31065], 99.50th=[32113], 99.90th=[32113], 99.95th=[32113], 00:19:41.377 | 99.99th=[32113] 00:19:41.377 write: IOPS=5260, BW=20.5MiB/s (21.5MB/s)(20.6MiB/1004msec); 0 zone resets 00:19:41.377 slat (usec): min=2, max=12742, avg=90.76, stdev=522.87 00:19:41.377 clat (usec): min=2950, max=31035, avg=11975.58, stdev=3818.24 00:19:41.377 lat (usec): min=3492, max=31041, avg=12066.34, stdev=3848.87 00:19:41.377 clat percentiles (usec): 00:19:41.377 | 1.00th=[ 7111], 5.00th=[ 8160], 10.00th=[ 9110], 20.00th=[10159], 00:19:41.377 | 30.00th=[10421], 40.00th=[10552], 50.00th=[10814], 60.00th=[11076], 00:19:41.377 | 70.00th=[11863], 80.00th=[12911], 90.00th=[16712], 95.00th=[20841], 00:19:41.377 | 99.00th=[27919], 99.50th=[28705], 99.90th=[30278], 99.95th=[30278], 00:19:41.377 | 99.99th=[31065] 00:19:41.377 bw ( KiB/s): min=20072, max=21168, per=32.63%, avg=20620.00, stdev=774.99, samples=2 00:19:41.377 iops : min= 5018, max= 5292, avg=5155.00, stdev=193.75, samples=2 00:19:41.377 lat (msec) : 4=0.10%, 10=15.91%, 20=78.04%, 50=5.95% 00:19:41.377 cpu : usr=6.18%, sys=7.78%, ctx=473, majf=0, minf=2 00:19:41.377 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:41.377 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.377 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.377 issued rwts: total=5120,5282,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.377 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.377 job2: (groupid=0, jobs=1): err= 0: pid=1600860: Sat Nov 16 17:39:18 2024 00:19:41.377 read: IOPS=3569, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1004msec) 00:19:41.377 slat (usec): min=2, max=11001, avg=141.69, stdev=753.77 00:19:41.377 clat (usec): min=9400, max=35481, avg=18188.81, stdev=5602.97 00:19:41.377 lat (usec): min=9588, max=35503, avg=18330.50, stdev=5659.03 00:19:41.378 clat percentiles (usec): 00:19:41.378 | 1.00th=[10290], 5.00th=[11863], 10.00th=[12780], 20.00th=[13304], 00:19:41.378 | 30.00th=[13566], 40.00th=[15008], 50.00th=[16712], 60.00th=[17957], 00:19:41.378 | 70.00th=[21103], 80.00th=[24249], 90.00th=[26346], 95.00th=[28967], 00:19:41.378 | 99.00th=[32900], 99.50th=[33162], 99.90th=[35390], 99.95th=[35390], 00:19:41.378 | 99.99th=[35390] 00:19:41.378 write: IOPS=3938, BW=15.4MiB/s (16.1MB/s)(15.4MiB/1004msec); 0 zone resets 00:19:41.378 slat (usec): min=4, max=12433, avg=114.86, stdev=684.25 00:19:41.378 clat (usec): min=3431, max=36222, avg=15605.89, stdev=4096.31 00:19:41.378 lat (usec): min=4239, max=36254, avg=15720.75, stdev=4151.37 00:19:41.378 clat percentiles (usec): 00:19:41.378 | 1.00th=[ 7898], 5.00th=[10683], 10.00th=[12387], 20.00th=[13042], 00:19:41.378 | 30.00th=[13304], 40.00th=[13829], 50.00th=[14091], 60.00th=[14746], 00:19:41.378 | 70.00th=[16712], 80.00th=[17957], 90.00th=[22152], 95.00th=[24249], 00:19:41.378 | 99.00th=[29230], 99.50th=[29230], 99.90th=[32113], 99.95th=[34341], 00:19:41.378 | 99.99th=[36439] 00:19:41.378 bw ( KiB/s): min=13496, max=17120, per=24.23%, avg=15308.00, stdev=2562.55, samples=2 00:19:41.378 iops : min= 3374, max= 4280, avg=3827.00, stdev=640.64, samples=2 00:19:41.378 lat (msec) : 4=0.01%, 10=2.24%, 20=74.36%, 50=23.39% 00:19:41.378 cpu : usr=4.09%, sys=8.28%, ctx=341, majf=0, minf=1 00:19:41.378 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:41.378 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.378 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.378 issued rwts: total=3584,3954,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.378 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.378 job3: (groupid=0, jobs=1): err= 0: pid=1600861: Sat Nov 16 17:39:18 2024 00:19:41.378 read: IOPS=2289, BW=9157KiB/s (9377kB/s)(9212KiB/1006msec) 00:19:41.378 slat (usec): min=2, max=55013, avg=212.57, stdev=2079.47 00:19:41.378 clat (msec): min=3, max=117, avg=25.08, stdev=20.89 00:19:41.378 lat (msec): min=7, max=117, avg=25.29, stdev=20.99 00:19:41.378 clat percentiles (msec): 00:19:41.378 | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 14], 00:19:41.378 | 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 20], 00:19:41.378 | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 40], 95.00th=[ 74], 00:19:41.378 | 99.00th=[ 118], 99.50th=[ 118], 99.90th=[ 118], 99.95th=[ 118], 00:19:41.378 | 99.99th=[ 118] 00:19:41.378 write: IOPS=2544, BW=9.94MiB/s (10.4MB/s)(10.0MiB/1006msec); 0 zone resets 00:19:41.378 slat (usec): min=3, max=24638, avg=193.15, stdev=1215.89 00:19:41.378 clat (msec): min=10, max=117, avg=26.91, stdev=16.18 00:19:41.378 lat (msec): min=10, max=117, avg=27.10, stdev=16.23 00:19:41.378 clat percentiles (msec): 00:19:41.378 | 1.00th=[ 12], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], 00:19:41.378 | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 23], 60.00th=[ 23], 00:19:41.378 | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 47], 95.00th=[ 60], 00:19:41.378 | 99.00th=[ 115], 99.50th=[ 116], 99.90th=[ 116], 99.95th=[ 116], 00:19:41.378 | 99.99th=[ 117] 00:19:41.378 bw ( KiB/s): min= 7880, max=12600, per=16.21%, avg=10240.00, stdev=3337.54, samples=2 00:19:41.378 iops : min= 1970, max= 3150, avg=2560.00, stdev=834.39, samples=2 00:19:41.378 lat (msec) : 4=0.02%, 10=0.76%, 20=46.54%, 50=43.12%, 100=7.61% 00:19:41.378 lat (msec) : 250=1.95% 00:19:41.378 cpu : usr=1.89%, sys=3.48%, ctx=296, majf=0, minf=1 00:19:41.378 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:41.378 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.378 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:41.378 issued rwts: total=2303,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.378 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:41.378 00:19:41.378 Run status group 0 (all jobs): 00:19:41.378 READ: bw=58.3MiB/s (61.1MB/s), 9157KiB/s-19.9MiB/s (9377kB/s-20.9MB/s), io=58.6MiB (61.5MB), run=1004-1006msec 00:19:41.378 WRITE: bw=61.7MiB/s (64.7MB/s), 9.94MiB/s-20.5MiB/s (10.4MB/s-21.5MB/s), io=62.1MiB (65.1MB), run=1004-1006msec 00:19:41.378 00:19:41.378 Disk stats (read/write): 00:19:41.378 nvme0n1: ios=3111/3543, merge=0/0, ticks=24021/30459, in_queue=54480, util=97.29% 00:19:41.378 nvme0n2: ios=4096/4440, merge=0/0, ticks=16726/17354, in_queue=34080, util=85.87% 00:19:41.378 nvme0n3: ios=3061/3072, merge=0/0, ticks=21096/16209, in_queue=37305, util=92.81% 00:19:41.378 nvme0n4: ios=2122/2560, merge=0/0, ticks=18328/26987, in_queue=45315, util=98.22% 00:19:41.378 17:39:18 -- target/fio.sh@55 -- # sync 00:19:41.378 17:39:18 -- target/fio.sh@59 -- # fio_pid=1601003 00:19:41.378 17:39:18 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:41.378 17:39:18 -- target/fio.sh@61 -- # sleep 3 00:19:41.378 [global] 00:19:41.378 thread=1 00:19:41.378 invalidate=1 00:19:41.378 rw=read 00:19:41.378 time_based=1 00:19:41.378 runtime=10 00:19:41.378 ioengine=libaio 00:19:41.378 direct=1 00:19:41.378 bs=4096 00:19:41.378 iodepth=1 00:19:41.378 norandommap=1 00:19:41.378 numjobs=1 00:19:41.378 00:19:41.378 [job0] 00:19:41.378 filename=/dev/nvme0n1 00:19:41.378 [job1] 00:19:41.378 filename=/dev/nvme0n2 00:19:41.378 [job2] 00:19:41.378 filename=/dev/nvme0n3 00:19:41.378 [job3] 00:19:41.378 filename=/dev/nvme0n4 00:19:41.378 Could not set queue depth (nvme0n1) 00:19:41.378 Could not set queue depth (nvme0n2) 00:19:41.378 Could not set queue depth (nvme0n3) 00:19:41.378 Could not set queue depth (nvme0n4) 00:19:41.636 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:41.636 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:41.636 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:41.636 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:41.636 fio-3.35 00:19:41.636 Starting 4 threads 00:19:44.177 17:39:21 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:44.742 17:39:21 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:44.742 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=360448, buflen=4096 00:19:44.742 fio: pid=1601096, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:44.742 17:39:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:44.742 17:39:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:45.000 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=2146304, buflen=4096 00:19:45.000 fio: pid=1601095, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.258 17:39:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.258 17:39:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:45.258 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=364544, buflen=4096 00:19:45.258 fio: pid=1601091, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:45.516 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=479232, buflen=4096 00:19:45.516 fio: pid=1601092, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:19:45.516 17:39:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.516 17:39:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:45.516 00:19:45.516 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1601091: Sat Nov 16 17:39:22 2024 00:19:45.516 read: IOPS=25, BW=101KiB/s (104kB/s)(356KiB/3514msec) 00:19:45.516 slat (usec): min=8, max=26858, avg=504.80, stdev=3312.44 00:19:45.516 clat (usec): min=328, max=41936, avg=38710.80, stdev=9375.55 00:19:45.516 lat (usec): min=401, max=57807, avg=39221.10, stdev=8744.41 00:19:45.516 clat percentiles (usec): 00:19:45.516 | 1.00th=[ 330], 5.00th=[ 857], 10.00th=[41157], 20.00th=[41157], 00:19:45.516 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:45.516 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:45.516 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:19:45.516 | 99.99th=[41681] 00:19:45.516 bw ( KiB/s): min= 96, max= 112, per=11.75%, avg=102.67, stdev= 7.87, samples=6 00:19:45.516 iops : min= 24, max= 28, avg=25.67, stdev= 1.97, samples=6 00:19:45.516 lat (usec) : 500=4.44%, 1000=1.11% 00:19:45.516 lat (msec) : 50=93.33% 00:19:45.516 cpu : usr=0.00%, sys=0.11%, ctx=94, majf=0, minf=1 00:19:45.516 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.516 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.516 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.516 issued rwts: total=90,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.516 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.516 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=1601092: Sat Nov 16 17:39:22 2024 00:19:45.516 read: IOPS=31, BW=124KiB/s (127kB/s)(468KiB/3768msec) 00:19:45.516 slat (usec): min=6, max=11911, avg=247.40, stdev=1443.55 00:19:45.516 clat (usec): min=241, max=41530, avg=31941.96, stdev=16949.28 00:19:45.516 lat (usec): min=277, max=52951, avg=32133.43, stdev=17086.10 00:19:45.516 clat percentiles (usec): 00:19:45.516 | 1.00th=[ 247], 5.00th=[ 343], 10.00th=[ 351], 20.00th=[ 437], 00:19:45.516 | 30.00th=[40633], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:45.516 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:45.516 | 99.00th=[41681], 99.50th=[41681], 99.90th=[41681], 99.95th=[41681], 00:19:45.516 | 99.99th=[41681] 00:19:45.516 bw ( KiB/s): min= 96, max= 168, per=14.51%, avg=126.14, stdev=30.07, samples=7 00:19:45.516 iops : min= 24, max= 42, avg=31.43, stdev= 7.63, samples=7 00:19:45.516 lat (usec) : 250=1.69%, 500=19.49%, 750=0.85% 00:19:45.516 lat (msec) : 50=77.12% 00:19:45.516 cpu : usr=0.05%, sys=0.27%, ctx=119, majf=0, minf=1 00:19:45.516 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.516 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.516 complete : 0=0.8%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.516 issued rwts: total=118,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.516 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.516 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1601095: Sat Nov 16 17:39:22 2024 00:19:45.516 read: IOPS=161, BW=645KiB/s (661kB/s)(2096KiB/3249msec) 00:19:45.516 slat (usec): min=6, max=7682, avg=39.61, stdev=453.91 00:19:45.516 clat (usec): min=214, max=43959, avg=6114.02, stdev=14283.97 00:19:45.516 lat (usec): min=222, max=44001, avg=6153.68, stdev=14283.42 00:19:45.516 clat percentiles (usec): 00:19:45.516 | 1.00th=[ 229], 5.00th=[ 239], 10.00th=[ 245], 20.00th=[ 255], 00:19:45.516 | 30.00th=[ 285], 40.00th=[ 400], 50.00th=[ 404], 60.00th=[ 412], 00:19:45.517 | 70.00th=[ 441], 80.00th=[ 474], 90.00th=[41157], 95.00th=[42206], 00:19:45.517 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:19:45.517 | 99.99th=[43779] 00:19:45.517 bw ( KiB/s): min= 96, max= 2920, per=71.63%, avg=622.67, stdev=1128.37, samples=6 00:19:45.517 iops : min= 24, max= 730, avg=155.67, stdev=282.09, samples=6 00:19:45.517 lat (usec) : 250=13.71%, 500=70.67%, 750=1.14% 00:19:45.517 lat (msec) : 2=0.19%, 10=0.19%, 50=13.90% 00:19:45.517 cpu : usr=0.12%, sys=0.28%, ctx=527, majf=0, minf=2 00:19:45.517 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.517 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.517 complete : 0=0.2%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.517 issued rwts: total=525,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.517 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.517 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1601096: Sat Nov 16 17:39:22 2024 00:19:45.517 read: IOPS=30, BW=120KiB/s (123kB/s)(352KiB/2941msec) 00:19:45.517 slat (nsec): min=8697, max=52302, avg=22286.56, stdev=9623.34 00:19:45.517 clat (usec): min=255, max=41164, avg=33120.80, stdev=16102.05 00:19:45.517 lat (usec): min=270, max=41177, avg=33143.15, stdev=16099.17 00:19:45.517 clat percentiles (usec): 00:19:45.517 | 1.00th=[ 255], 5.00th=[ 334], 10.00th=[ 355], 20.00th=[40633], 00:19:45.517 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:45.517 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:45.517 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:45.517 | 99.99th=[41157] 00:19:45.517 bw ( KiB/s): min= 96, max= 160, per=13.36%, avg=116.80, stdev=27.48, samples=5 00:19:45.517 iops : min= 24, max= 40, avg=29.20, stdev= 6.87, samples=5 00:19:45.517 lat (usec) : 500=16.85%, 750=1.12% 00:19:45.517 lat (msec) : 2=1.12%, 50=79.78% 00:19:45.517 cpu : usr=0.00%, sys=0.14%, ctx=90, majf=0, minf=2 00:19:45.517 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:45.517 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.517 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:45.517 issued rwts: total=89,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:45.517 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:45.517 00:19:45.517 Run status group 0 (all jobs): 00:19:45.517 READ: bw=868KiB/s (889kB/s), 101KiB/s-645KiB/s (104kB/s-661kB/s), io=3272KiB (3351kB), run=2941-3768msec 00:19:45.517 00:19:45.517 Disk stats (read/write): 00:19:45.517 nvme0n1: ios=128/0, merge=0/0, ticks=4370/0, in_queue=4370, util=98.43% 00:19:45.517 nvme0n2: ios=113/0, merge=0/0, ticks=3575/0, in_queue=3575, util=96.12% 00:19:45.517 nvme0n3: ios=521/0, merge=0/0, ticks=3081/0, in_queue=3081, util=96.35% 00:19:45.517 nvme0n4: ios=135/0, merge=0/0, ticks=3729/0, in_queue=3729, util=99.53% 00:19:45.775 17:39:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:45.775 17:39:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:46.033 17:39:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.033 17:39:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:46.291 17:39:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.291 17:39:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:46.549 17:39:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:46.549 17:39:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:46.807 17:39:24 -- target/fio.sh@69 -- # fio_status=0 00:19:46.807 17:39:24 -- target/fio.sh@70 -- # wait 1601003 00:19:46.807 17:39:24 -- target/fio.sh@70 -- # fio_status=4 00:19:46.807 17:39:24 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:46.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:46.807 17:39:24 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:46.807 17:39:24 -- common/autotest_common.sh@1208 -- # local i=0 00:19:46.807 17:39:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:46.807 17:39:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:46.807 17:39:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:46.807 17:39:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:46.807 17:39:24 -- common/autotest_common.sh@1220 -- # return 0 00:19:46.807 17:39:24 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:46.807 17:39:24 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:46.807 nvmf hotplug test: fio failed as expected 00:19:46.807 17:39:24 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:47.066 17:39:24 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:47.066 17:39:24 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:47.066 17:39:24 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:47.066 17:39:24 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:47.066 17:39:24 -- target/fio.sh@91 -- # nvmftestfini 00:19:47.066 17:39:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:47.066 17:39:24 -- nvmf/common.sh@116 -- # sync 00:19:47.066 17:39:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:47.066 17:39:24 -- nvmf/common.sh@119 -- # set +e 00:19:47.066 17:39:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:47.066 17:39:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:47.066 rmmod nvme_tcp 00:19:47.066 rmmod nvme_fabrics 00:19:47.066 rmmod nvme_keyring 00:19:47.324 17:39:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:47.324 17:39:24 -- nvmf/common.sh@123 -- # set -e 00:19:47.324 17:39:24 -- nvmf/common.sh@124 -- # return 0 00:19:47.324 17:39:24 -- nvmf/common.sh@477 -- # '[' -n 1598379 ']' 00:19:47.324 17:39:24 -- nvmf/common.sh@478 -- # killprocess 1598379 00:19:47.324 17:39:24 -- common/autotest_common.sh@936 -- # '[' -z 1598379 ']' 00:19:47.324 17:39:24 -- common/autotest_common.sh@940 -- # kill -0 1598379 00:19:47.324 17:39:24 -- common/autotest_common.sh@941 -- # uname 00:19:47.324 17:39:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:47.325 17:39:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1598379 00:19:47.325 17:39:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:47.325 17:39:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:47.325 17:39:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1598379' 00:19:47.325 killing process with pid 1598379 00:19:47.325 17:39:24 -- common/autotest_common.sh@955 -- # kill 1598379 00:19:47.325 17:39:24 -- common/autotest_common.sh@960 -- # wait 1598379 00:19:47.584 17:39:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:47.584 17:39:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:47.584 17:39:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:47.584 17:39:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:47.584 17:39:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:47.584 17:39:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:47.584 17:39:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:47.584 17:39:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:49.492 17:39:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:49.492 00:19:49.492 real 0m24.512s 00:19:49.492 user 1m26.800s 00:19:49.492 sys 0m6.140s 00:19:49.492 17:39:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:49.492 17:39:26 -- common/autotest_common.sh@10 -- # set +x 00:19:49.492 ************************************ 00:19:49.492 END TEST nvmf_fio_target 00:19:49.492 ************************************ 00:19:49.492 17:39:26 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:49.493 17:39:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:49.493 17:39:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:49.493 17:39:26 -- common/autotest_common.sh@10 -- # set +x 00:19:49.493 ************************************ 00:19:49.493 START TEST nvmf_bdevio 00:19:49.493 ************************************ 00:19:49.493 17:39:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:49.493 * Looking for test storage... 00:19:49.493 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:49.493 17:39:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:49.493 17:39:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:49.493 17:39:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:49.751 17:39:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:49.751 17:39:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:49.751 17:39:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:49.751 17:39:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:49.751 17:39:27 -- scripts/common.sh@335 -- # IFS=.-: 00:19:49.751 17:39:27 -- scripts/common.sh@335 -- # read -ra ver1 00:19:49.751 17:39:27 -- scripts/common.sh@336 -- # IFS=.-: 00:19:49.751 17:39:27 -- scripts/common.sh@336 -- # read -ra ver2 00:19:49.751 17:39:27 -- scripts/common.sh@337 -- # local 'op=<' 00:19:49.751 17:39:27 -- scripts/common.sh@339 -- # ver1_l=2 00:19:49.751 17:39:27 -- scripts/common.sh@340 -- # ver2_l=1 00:19:49.751 17:39:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:49.751 17:39:27 -- scripts/common.sh@343 -- # case "$op" in 00:19:49.751 17:39:27 -- scripts/common.sh@344 -- # : 1 00:19:49.751 17:39:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:49.751 17:39:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:49.751 17:39:27 -- scripts/common.sh@364 -- # decimal 1 00:19:49.751 17:39:27 -- scripts/common.sh@352 -- # local d=1 00:19:49.751 17:39:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:49.751 17:39:27 -- scripts/common.sh@354 -- # echo 1 00:19:49.751 17:39:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:49.751 17:39:27 -- scripts/common.sh@365 -- # decimal 2 00:19:49.751 17:39:27 -- scripts/common.sh@352 -- # local d=2 00:19:49.751 17:39:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:49.751 17:39:27 -- scripts/common.sh@354 -- # echo 2 00:19:49.751 17:39:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:49.751 17:39:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:49.751 17:39:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:49.751 17:39:27 -- scripts/common.sh@367 -- # return 0 00:19:49.751 17:39:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:49.751 17:39:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:49.751 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:49.751 --rc genhtml_branch_coverage=1 00:19:49.751 --rc genhtml_function_coverage=1 00:19:49.751 --rc genhtml_legend=1 00:19:49.751 --rc geninfo_all_blocks=1 00:19:49.751 --rc geninfo_unexecuted_blocks=1 00:19:49.751 00:19:49.751 ' 00:19:49.751 17:39:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:49.751 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:49.751 --rc genhtml_branch_coverage=1 00:19:49.751 --rc genhtml_function_coverage=1 00:19:49.751 --rc genhtml_legend=1 00:19:49.751 --rc geninfo_all_blocks=1 00:19:49.751 --rc geninfo_unexecuted_blocks=1 00:19:49.751 00:19:49.751 ' 00:19:49.751 17:39:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:49.751 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:49.751 --rc genhtml_branch_coverage=1 00:19:49.751 --rc genhtml_function_coverage=1 00:19:49.751 --rc genhtml_legend=1 00:19:49.751 --rc geninfo_all_blocks=1 00:19:49.751 --rc geninfo_unexecuted_blocks=1 00:19:49.751 00:19:49.751 ' 00:19:49.751 17:39:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:49.751 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:49.751 --rc genhtml_branch_coverage=1 00:19:49.751 --rc genhtml_function_coverage=1 00:19:49.751 --rc genhtml_legend=1 00:19:49.751 --rc geninfo_all_blocks=1 00:19:49.751 --rc geninfo_unexecuted_blocks=1 00:19:49.751 00:19:49.751 ' 00:19:49.751 17:39:27 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:49.751 17:39:27 -- nvmf/common.sh@7 -- # uname -s 00:19:49.751 17:39:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:49.751 17:39:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:49.751 17:39:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:49.751 17:39:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:49.751 17:39:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:49.751 17:39:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:49.751 17:39:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:49.751 17:39:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:49.751 17:39:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:49.751 17:39:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:49.751 17:39:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:49.751 17:39:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:49.751 17:39:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:49.751 17:39:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:49.751 17:39:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:49.751 17:39:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:49.751 17:39:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:49.751 17:39:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:49.751 17:39:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:49.751 17:39:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:49.752 17:39:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:49.752 17:39:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:49.752 17:39:27 -- paths/export.sh@5 -- # export PATH 00:19:49.752 17:39:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:49.752 17:39:27 -- nvmf/common.sh@46 -- # : 0 00:19:49.752 17:39:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:49.752 17:39:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:49.752 17:39:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:49.752 17:39:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:49.752 17:39:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:49.752 17:39:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:49.752 17:39:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:49.752 17:39:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:49.752 17:39:27 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:49.752 17:39:27 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:49.752 17:39:27 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:49.752 17:39:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:49.752 17:39:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:49.752 17:39:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:49.752 17:39:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:49.752 17:39:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:49.752 17:39:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:49.752 17:39:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:49.752 17:39:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:49.752 17:39:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:49.752 17:39:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:49.752 17:39:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:49.752 17:39:27 -- common/autotest_common.sh@10 -- # set +x 00:19:51.656 17:39:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:51.656 17:39:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:51.656 17:39:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:51.656 17:39:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:51.656 17:39:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:51.656 17:39:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:51.656 17:39:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:51.656 17:39:29 -- nvmf/common.sh@294 -- # net_devs=() 00:19:51.656 17:39:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:51.656 17:39:29 -- nvmf/common.sh@295 -- # e810=() 00:19:51.656 17:39:29 -- nvmf/common.sh@295 -- # local -ga e810 00:19:51.656 17:39:29 -- nvmf/common.sh@296 -- # x722=() 00:19:51.656 17:39:29 -- nvmf/common.sh@296 -- # local -ga x722 00:19:51.656 17:39:29 -- nvmf/common.sh@297 -- # mlx=() 00:19:51.656 17:39:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:51.656 17:39:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:51.656 17:39:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:51.656 17:39:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:51.656 17:39:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:51.656 17:39:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:51.656 17:39:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:51.656 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:51.656 17:39:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:51.656 17:39:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:51.656 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:51.656 17:39:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:51.656 17:39:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:51.656 17:39:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:51.656 17:39:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:51.656 17:39:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:51.656 17:39:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:51.656 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:51.656 17:39:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:51.656 17:39:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:51.656 17:39:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:51.656 17:39:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:51.656 17:39:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:51.656 17:39:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:51.656 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:51.656 17:39:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:51.656 17:39:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:51.656 17:39:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:51.656 17:39:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:51.656 17:39:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:51.656 17:39:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:51.656 17:39:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:51.656 17:39:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:51.656 17:39:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:51.656 17:39:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:51.656 17:39:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:51.656 17:39:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:51.656 17:39:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:51.656 17:39:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:51.656 17:39:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:51.656 17:39:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:51.656 17:39:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:51.656 17:39:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:51.656 17:39:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:51.656 17:39:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:51.656 17:39:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:51.656 17:39:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:51.656 17:39:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:51.656 17:39:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:51.656 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:51.656 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:19:51.656 00:19:51.656 --- 10.0.0.2 ping statistics --- 00:19:51.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:51.656 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:19:51.656 17:39:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:51.656 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:51.656 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:19:51.656 00:19:51.656 --- 10.0.0.1 ping statistics --- 00:19:51.656 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:51.656 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:19:51.656 17:39:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:51.656 17:39:29 -- nvmf/common.sh@410 -- # return 0 00:19:51.656 17:39:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:51.656 17:39:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:51.656 17:39:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:51.656 17:39:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:51.656 17:39:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:51.656 17:39:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:51.914 17:39:29 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:51.914 17:39:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:51.914 17:39:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:51.914 17:39:29 -- common/autotest_common.sh@10 -- # set +x 00:19:51.914 17:39:29 -- nvmf/common.sh@469 -- # nvmfpid=1603752 00:19:51.914 17:39:29 -- nvmf/common.sh@470 -- # waitforlisten 1603752 00:19:51.914 17:39:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:51.914 17:39:29 -- common/autotest_common.sh@829 -- # '[' -z 1603752 ']' 00:19:51.914 17:39:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:51.914 17:39:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:51.914 17:39:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:51.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:51.914 17:39:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:51.914 17:39:29 -- common/autotest_common.sh@10 -- # set +x 00:19:51.914 [2024-11-16 17:39:29.205117] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:51.914 [2024-11-16 17:39:29.205190] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:51.914 EAL: No free 2048 kB hugepages reported on node 1 00:19:51.914 [2024-11-16 17:39:29.276124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:51.914 [2024-11-16 17:39:29.369726] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:51.914 [2024-11-16 17:39:29.369915] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:51.914 [2024-11-16 17:39:29.369935] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:51.914 [2024-11-16 17:39:29.369960] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:51.914 [2024-11-16 17:39:29.370060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:51.914 [2024-11-16 17:39:29.370120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:51.914 [2024-11-16 17:39:29.370193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:51.914 [2024-11-16 17:39:29.370196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:52.848 17:39:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:52.848 17:39:30 -- common/autotest_common.sh@862 -- # return 0 00:19:52.848 17:39:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:52.848 17:39:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:52.848 17:39:30 -- common/autotest_common.sh@10 -- # set +x 00:19:52.848 17:39:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:52.848 17:39:30 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:52.848 17:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.848 17:39:30 -- common/autotest_common.sh@10 -- # set +x 00:19:52.848 [2024-11-16 17:39:30.189269] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:52.848 17:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.848 17:39:30 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:52.848 17:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.848 17:39:30 -- common/autotest_common.sh@10 -- # set +x 00:19:52.848 Malloc0 00:19:52.848 17:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.848 17:39:30 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:52.848 17:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.848 17:39:30 -- common/autotest_common.sh@10 -- # set +x 00:19:52.848 17:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.848 17:39:30 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:52.848 17:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.848 17:39:30 -- common/autotest_common.sh@10 -- # set +x 00:19:52.848 17:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.848 17:39:30 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:52.848 17:39:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.848 17:39:30 -- common/autotest_common.sh@10 -- # set +x 00:19:52.848 [2024-11-16 17:39:30.241142] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:52.848 17:39:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.848 17:39:30 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:52.848 17:39:30 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:52.848 17:39:30 -- nvmf/common.sh@520 -- # config=() 00:19:52.848 17:39:30 -- nvmf/common.sh@520 -- # local subsystem config 00:19:52.848 17:39:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:52.848 17:39:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:52.848 { 00:19:52.848 "params": { 00:19:52.848 "name": "Nvme$subsystem", 00:19:52.848 "trtype": "$TEST_TRANSPORT", 00:19:52.848 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:52.848 "adrfam": "ipv4", 00:19:52.848 "trsvcid": "$NVMF_PORT", 00:19:52.848 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:52.848 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:52.848 "hdgst": ${hdgst:-false}, 00:19:52.848 "ddgst": ${ddgst:-false} 00:19:52.848 }, 00:19:52.848 "method": "bdev_nvme_attach_controller" 00:19:52.849 } 00:19:52.849 EOF 00:19:52.849 )") 00:19:52.849 17:39:30 -- nvmf/common.sh@542 -- # cat 00:19:52.849 17:39:30 -- nvmf/common.sh@544 -- # jq . 00:19:52.849 17:39:30 -- nvmf/common.sh@545 -- # IFS=, 00:19:52.849 17:39:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:52.849 "params": { 00:19:52.849 "name": "Nvme1", 00:19:52.849 "trtype": "tcp", 00:19:52.849 "traddr": "10.0.0.2", 00:19:52.849 "adrfam": "ipv4", 00:19:52.849 "trsvcid": "4420", 00:19:52.849 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:52.849 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:52.849 "hdgst": false, 00:19:52.849 "ddgst": false 00:19:52.849 }, 00:19:52.849 "method": "bdev_nvme_attach_controller" 00:19:52.849 }' 00:19:52.849 [2024-11-16 17:39:30.283052] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:52.849 [2024-11-16 17:39:30.283125] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1603913 ] 00:19:52.849 EAL: No free 2048 kB hugepages reported on node 1 00:19:53.108 [2024-11-16 17:39:30.344875] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:53.108 [2024-11-16 17:39:30.433299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:53.108 [2024-11-16 17:39:30.433352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:53.108 [2024-11-16 17:39:30.433354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:53.366 [2024-11-16 17:39:30.734498] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:53.366 [2024-11-16 17:39:30.734547] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:53.366 I/O targets: 00:19:53.366 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:53.366 00:19:53.366 00:19:53.366 CUnit - A unit testing framework for C - Version 2.1-3 00:19:53.366 http://cunit.sourceforge.net/ 00:19:53.366 00:19:53.366 00:19:53.366 Suite: bdevio tests on: Nvme1n1 00:19:53.366 Test: blockdev write read block ...passed 00:19:53.366 Test: blockdev write zeroes read block ...passed 00:19:53.366 Test: blockdev write zeroes read no split ...passed 00:19:53.366 Test: blockdev write zeroes read split ...passed 00:19:53.624 Test: blockdev write zeroes read split partial ...passed 00:19:53.624 Test: blockdev reset ...[2024-11-16 17:39:30.888311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:53.624 [2024-11-16 17:39:30.888445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22fe670 (9): Bad file descriptor 00:19:53.624 [2024-11-16 17:39:30.983330] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:53.624 passed 00:19:53.624 Test: blockdev write read 8 blocks ...passed 00:19:53.624 Test: blockdev write read size > 128k ...passed 00:19:53.624 Test: blockdev write read invalid size ...passed 00:19:53.624 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:53.624 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:53.624 Test: blockdev write read max offset ...passed 00:19:53.882 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:53.882 Test: blockdev writev readv 8 blocks ...passed 00:19:53.882 Test: blockdev writev readv 30 x 1block ...passed 00:19:53.882 Test: blockdev writev readv block ...passed 00:19:53.882 Test: blockdev writev readv size > 128k ...passed 00:19:53.882 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:53.882 Test: blockdev comparev and writev ...[2024-11-16 17:39:31.276628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:53.882 [2024-11-16 17:39:31.276673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.276699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:53.882 [2024-11-16 17:39:31.276716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.277033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:53.882 [2024-11-16 17:39:31.277057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.277078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:53.882 [2024-11-16 17:39:31.277094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.277393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:53.882 [2024-11-16 17:39:31.277416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.277436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:53.882 [2024-11-16 17:39:31.277452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.277773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:53.882 [2024-11-16 17:39:31.277797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.277818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:53.882 [2024-11-16 17:39:31.277833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:53.882 passed 00:19:53.882 Test: blockdev nvme passthru rw ...passed 00:19:53.882 Test: blockdev nvme passthru vendor specific ...[2024-11-16 17:39:31.359858] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:53.882 [2024-11-16 17:39:31.359886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.360024] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:53.882 [2024-11-16 17:39:31.360048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.360179] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:53.882 [2024-11-16 17:39:31.360203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:53.882 [2024-11-16 17:39:31.360347] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:53.882 [2024-11-16 17:39:31.360370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:53.882 passed 00:19:54.140 Test: blockdev nvme admin passthru ...passed 00:19:54.140 Test: blockdev copy ...passed 00:19:54.140 00:19:54.140 Run Summary: Type Total Ran Passed Failed Inactive 00:19:54.140 suites 1 1 n/a 0 0 00:19:54.140 tests 23 23 23 0 0 00:19:54.140 asserts 152 152 152 0 n/a 00:19:54.140 00:19:54.140 Elapsed time = 1.370 seconds 00:19:54.140 17:39:31 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:54.140 17:39:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:54.140 17:39:31 -- common/autotest_common.sh@10 -- # set +x 00:19:54.140 17:39:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:54.140 17:39:31 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:54.140 17:39:31 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:54.140 17:39:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:54.140 17:39:31 -- nvmf/common.sh@116 -- # sync 00:19:54.140 17:39:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:54.140 17:39:31 -- nvmf/common.sh@119 -- # set +e 00:19:54.140 17:39:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:54.140 17:39:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:54.140 rmmod nvme_tcp 00:19:54.399 rmmod nvme_fabrics 00:19:54.399 rmmod nvme_keyring 00:19:54.399 17:39:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:54.399 17:39:31 -- nvmf/common.sh@123 -- # set -e 00:19:54.399 17:39:31 -- nvmf/common.sh@124 -- # return 0 00:19:54.399 17:39:31 -- nvmf/common.sh@477 -- # '[' -n 1603752 ']' 00:19:54.399 17:39:31 -- nvmf/common.sh@478 -- # killprocess 1603752 00:19:54.399 17:39:31 -- common/autotest_common.sh@936 -- # '[' -z 1603752 ']' 00:19:54.399 17:39:31 -- common/autotest_common.sh@940 -- # kill -0 1603752 00:19:54.399 17:39:31 -- common/autotest_common.sh@941 -- # uname 00:19:54.399 17:39:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:54.399 17:39:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1603752 00:19:54.399 17:39:31 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:54.399 17:39:31 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:54.399 17:39:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1603752' 00:19:54.399 killing process with pid 1603752 00:19:54.399 17:39:31 -- common/autotest_common.sh@955 -- # kill 1603752 00:19:54.399 17:39:31 -- common/autotest_common.sh@960 -- # wait 1603752 00:19:54.658 17:39:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:54.658 17:39:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:54.658 17:39:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:54.658 17:39:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:54.658 17:39:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:54.658 17:39:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:54.658 17:39:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:54.658 17:39:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:56.561 17:39:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:56.561 00:19:56.561 real 0m7.078s 00:19:56.561 user 0m13.746s 00:19:56.561 sys 0m2.103s 00:19:56.561 17:39:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:56.561 17:39:33 -- common/autotest_common.sh@10 -- # set +x 00:19:56.561 ************************************ 00:19:56.561 END TEST nvmf_bdevio 00:19:56.561 ************************************ 00:19:56.561 17:39:34 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:56.561 17:39:34 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:56.561 17:39:34 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:56.561 17:39:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:56.561 17:39:34 -- common/autotest_common.sh@10 -- # set +x 00:19:56.561 ************************************ 00:19:56.561 START TEST nvmf_bdevio_no_huge 00:19:56.561 ************************************ 00:19:56.561 17:39:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:56.820 * Looking for test storage... 00:19:56.820 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:56.820 17:39:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:56.820 17:39:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:56.820 17:39:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:56.820 17:39:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:56.820 17:39:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:56.820 17:39:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:56.820 17:39:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:56.820 17:39:34 -- scripts/common.sh@335 -- # IFS=.-: 00:19:56.820 17:39:34 -- scripts/common.sh@335 -- # read -ra ver1 00:19:56.820 17:39:34 -- scripts/common.sh@336 -- # IFS=.-: 00:19:56.820 17:39:34 -- scripts/common.sh@336 -- # read -ra ver2 00:19:56.820 17:39:34 -- scripts/common.sh@337 -- # local 'op=<' 00:19:56.820 17:39:34 -- scripts/common.sh@339 -- # ver1_l=2 00:19:56.820 17:39:34 -- scripts/common.sh@340 -- # ver2_l=1 00:19:56.820 17:39:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:56.820 17:39:34 -- scripts/common.sh@343 -- # case "$op" in 00:19:56.820 17:39:34 -- scripts/common.sh@344 -- # : 1 00:19:56.820 17:39:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:56.820 17:39:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:56.820 17:39:34 -- scripts/common.sh@364 -- # decimal 1 00:19:56.820 17:39:34 -- scripts/common.sh@352 -- # local d=1 00:19:56.820 17:39:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:56.820 17:39:34 -- scripts/common.sh@354 -- # echo 1 00:19:56.820 17:39:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:56.820 17:39:34 -- scripts/common.sh@365 -- # decimal 2 00:19:56.820 17:39:34 -- scripts/common.sh@352 -- # local d=2 00:19:56.820 17:39:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:56.820 17:39:34 -- scripts/common.sh@354 -- # echo 2 00:19:56.820 17:39:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:56.820 17:39:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:56.820 17:39:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:56.820 17:39:34 -- scripts/common.sh@367 -- # return 0 00:19:56.820 17:39:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:56.820 17:39:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:56.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.820 --rc genhtml_branch_coverage=1 00:19:56.820 --rc genhtml_function_coverage=1 00:19:56.820 --rc genhtml_legend=1 00:19:56.820 --rc geninfo_all_blocks=1 00:19:56.820 --rc geninfo_unexecuted_blocks=1 00:19:56.820 00:19:56.820 ' 00:19:56.820 17:39:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:56.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.820 --rc genhtml_branch_coverage=1 00:19:56.820 --rc genhtml_function_coverage=1 00:19:56.820 --rc genhtml_legend=1 00:19:56.820 --rc geninfo_all_blocks=1 00:19:56.820 --rc geninfo_unexecuted_blocks=1 00:19:56.820 00:19:56.820 ' 00:19:56.820 17:39:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:56.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.820 --rc genhtml_branch_coverage=1 00:19:56.820 --rc genhtml_function_coverage=1 00:19:56.820 --rc genhtml_legend=1 00:19:56.820 --rc geninfo_all_blocks=1 00:19:56.820 --rc geninfo_unexecuted_blocks=1 00:19:56.820 00:19:56.820 ' 00:19:56.820 17:39:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:56.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:56.820 --rc genhtml_branch_coverage=1 00:19:56.820 --rc genhtml_function_coverage=1 00:19:56.820 --rc genhtml_legend=1 00:19:56.821 --rc geninfo_all_blocks=1 00:19:56.821 --rc geninfo_unexecuted_blocks=1 00:19:56.821 00:19:56.821 ' 00:19:56.821 17:39:34 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:56.821 17:39:34 -- nvmf/common.sh@7 -- # uname -s 00:19:56.821 17:39:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:56.821 17:39:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:56.821 17:39:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:56.821 17:39:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:56.821 17:39:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:56.821 17:39:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:56.821 17:39:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:56.821 17:39:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:56.821 17:39:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:56.821 17:39:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:56.821 17:39:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:56.821 17:39:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:56.821 17:39:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:56.821 17:39:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:56.821 17:39:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:56.821 17:39:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:56.821 17:39:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:56.821 17:39:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:56.821 17:39:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:56.821 17:39:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.821 17:39:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.821 17:39:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.821 17:39:34 -- paths/export.sh@5 -- # export PATH 00:19:56.821 17:39:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:56.821 17:39:34 -- nvmf/common.sh@46 -- # : 0 00:19:56.821 17:39:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:56.821 17:39:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:56.821 17:39:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:56.821 17:39:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:56.821 17:39:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:56.821 17:39:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:56.821 17:39:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:56.821 17:39:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:56.821 17:39:34 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:56.821 17:39:34 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:56.821 17:39:34 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:56.821 17:39:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:56.821 17:39:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:56.821 17:39:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:56.821 17:39:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:56.821 17:39:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:56.821 17:39:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:56.821 17:39:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:56.821 17:39:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:56.821 17:39:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:56.821 17:39:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:56.821 17:39:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:56.821 17:39:34 -- common/autotest_common.sh@10 -- # set +x 00:19:58.725 17:39:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:58.725 17:39:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:58.725 17:39:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:58.725 17:39:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:58.725 17:39:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:58.725 17:39:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:58.725 17:39:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:58.725 17:39:36 -- nvmf/common.sh@294 -- # net_devs=() 00:19:58.725 17:39:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:58.725 17:39:36 -- nvmf/common.sh@295 -- # e810=() 00:19:58.725 17:39:36 -- nvmf/common.sh@295 -- # local -ga e810 00:19:58.725 17:39:36 -- nvmf/common.sh@296 -- # x722=() 00:19:58.725 17:39:36 -- nvmf/common.sh@296 -- # local -ga x722 00:19:58.725 17:39:36 -- nvmf/common.sh@297 -- # mlx=() 00:19:58.725 17:39:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:58.725 17:39:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:58.725 17:39:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:58.725 17:39:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:58.725 17:39:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:58.725 17:39:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:58.725 17:39:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:58.725 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:58.725 17:39:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:58.725 17:39:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:58.725 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:58.725 17:39:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:58.725 17:39:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:58.725 17:39:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:58.725 17:39:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:58.725 17:39:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:58.725 17:39:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:58.725 17:39:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:58.725 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:58.725 17:39:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:58.725 17:39:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:58.725 17:39:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:58.725 17:39:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:58.725 17:39:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:58.726 17:39:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:58.726 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:58.726 17:39:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:58.726 17:39:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:58.726 17:39:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:58.726 17:39:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:58.726 17:39:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:58.726 17:39:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:58.726 17:39:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:58.726 17:39:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:58.726 17:39:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:58.726 17:39:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:58.726 17:39:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:58.726 17:39:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:58.726 17:39:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:58.726 17:39:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:58.726 17:39:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:58.726 17:39:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:58.726 17:39:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:58.726 17:39:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:58.726 17:39:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:58.726 17:39:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:58.726 17:39:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:58.726 17:39:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:58.726 17:39:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:58.726 17:39:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:58.726 17:39:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:58.726 17:39:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:58.726 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:58.726 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.276 ms 00:19:58.726 00:19:58.726 --- 10.0.0.2 ping statistics --- 00:19:58.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:58.726 rtt min/avg/max/mdev = 0.276/0.276/0.276/0.000 ms 00:19:58.726 17:39:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:58.726 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:58.726 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:19:58.726 00:19:58.726 --- 10.0.0.1 ping statistics --- 00:19:58.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:58.726 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:19:58.726 17:39:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:58.726 17:39:36 -- nvmf/common.sh@410 -- # return 0 00:19:58.726 17:39:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:58.726 17:39:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:58.726 17:39:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:58.726 17:39:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:58.726 17:39:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:58.726 17:39:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:58.726 17:39:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:58.984 17:39:36 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:58.984 17:39:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:58.984 17:39:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:58.984 17:39:36 -- common/autotest_common.sh@10 -- # set +x 00:19:58.984 17:39:36 -- nvmf/common.sh@469 -- # nvmfpid=1606003 00:19:58.985 17:39:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:58.985 17:39:36 -- nvmf/common.sh@470 -- # waitforlisten 1606003 00:19:58.985 17:39:36 -- common/autotest_common.sh@829 -- # '[' -z 1606003 ']' 00:19:58.985 17:39:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:58.985 17:39:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:58.985 17:39:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:58.985 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:58.985 17:39:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:58.985 17:39:36 -- common/autotest_common.sh@10 -- # set +x 00:19:58.985 [2024-11-16 17:39:36.272347] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:58.985 [2024-11-16 17:39:36.272429] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:58.985 [2024-11-16 17:39:36.347581] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:58.985 [2024-11-16 17:39:36.431286] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:58.985 [2024-11-16 17:39:36.431424] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:58.985 [2024-11-16 17:39:36.431441] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:58.985 [2024-11-16 17:39:36.431459] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:58.985 [2024-11-16 17:39:36.431542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:58.985 [2024-11-16 17:39:36.431607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:58.985 [2024-11-16 17:39:36.431668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:58.985 [2024-11-16 17:39:36.431671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:59.919 17:39:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:59.919 17:39:37 -- common/autotest_common.sh@862 -- # return 0 00:19:59.919 17:39:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:59.919 17:39:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:59.919 17:39:37 -- common/autotest_common.sh@10 -- # set +x 00:19:59.919 17:39:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:59.919 17:39:37 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:59.919 17:39:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.919 17:39:37 -- common/autotest_common.sh@10 -- # set +x 00:19:59.919 [2024-11-16 17:39:37.315805] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:59.919 17:39:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.919 17:39:37 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:59.919 17:39:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.919 17:39:37 -- common/autotest_common.sh@10 -- # set +x 00:19:59.919 Malloc0 00:19:59.919 17:39:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.919 17:39:37 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:59.919 17:39:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.919 17:39:37 -- common/autotest_common.sh@10 -- # set +x 00:19:59.919 17:39:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.919 17:39:37 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:59.919 17:39:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.919 17:39:37 -- common/autotest_common.sh@10 -- # set +x 00:19:59.919 17:39:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.919 17:39:37 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:59.919 17:39:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.919 17:39:37 -- common/autotest_common.sh@10 -- # set +x 00:19:59.919 [2024-11-16 17:39:37.353970] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:59.919 17:39:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.919 17:39:37 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:59.919 17:39:37 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:59.919 17:39:37 -- nvmf/common.sh@520 -- # config=() 00:19:59.919 17:39:37 -- nvmf/common.sh@520 -- # local subsystem config 00:19:59.919 17:39:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:59.919 17:39:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:59.919 { 00:19:59.919 "params": { 00:19:59.919 "name": "Nvme$subsystem", 00:19:59.919 "trtype": "$TEST_TRANSPORT", 00:19:59.919 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:59.919 "adrfam": "ipv4", 00:19:59.919 "trsvcid": "$NVMF_PORT", 00:19:59.919 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:59.919 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:59.919 "hdgst": ${hdgst:-false}, 00:19:59.919 "ddgst": ${ddgst:-false} 00:19:59.919 }, 00:19:59.919 "method": "bdev_nvme_attach_controller" 00:19:59.919 } 00:19:59.919 EOF 00:19:59.919 )") 00:19:59.919 17:39:37 -- nvmf/common.sh@542 -- # cat 00:19:59.919 17:39:37 -- nvmf/common.sh@544 -- # jq . 00:19:59.919 17:39:37 -- nvmf/common.sh@545 -- # IFS=, 00:19:59.919 17:39:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:59.919 "params": { 00:19:59.919 "name": "Nvme1", 00:19:59.919 "trtype": "tcp", 00:19:59.919 "traddr": "10.0.0.2", 00:19:59.919 "adrfam": "ipv4", 00:19:59.919 "trsvcid": "4420", 00:19:59.919 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:59.919 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:59.919 "hdgst": false, 00:19:59.919 "ddgst": false 00:19:59.919 }, 00:19:59.919 "method": "bdev_nvme_attach_controller" 00:19:59.919 }' 00:19:59.919 [2024-11-16 17:39:37.399464] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:59.919 [2024-11-16 17:39:37.399544] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1606166 ] 00:20:00.176 [2024-11-16 17:39:37.463098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:00.176 [2024-11-16 17:39:37.548097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:00.177 [2024-11-16 17:39:37.548147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:00.177 [2024-11-16 17:39:37.548151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:00.434 [2024-11-16 17:39:37.820520] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:20:00.435 [2024-11-16 17:39:37.820576] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:20:00.435 I/O targets: 00:20:00.435 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:20:00.435 00:20:00.435 00:20:00.435 CUnit - A unit testing framework for C - Version 2.1-3 00:20:00.435 http://cunit.sourceforge.net/ 00:20:00.435 00:20:00.435 00:20:00.435 Suite: bdevio tests on: Nvme1n1 00:20:00.435 Test: blockdev write read block ...passed 00:20:00.435 Test: blockdev write zeroes read block ...passed 00:20:00.435 Test: blockdev write zeroes read no split ...passed 00:20:00.693 Test: blockdev write zeroes read split ...passed 00:20:00.693 Test: blockdev write zeroes read split partial ...passed 00:20:00.693 Test: blockdev reset ...[2024-11-16 17:39:37.982006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:20:00.693 [2024-11-16 17:39:37.982129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x225f150 (9): Bad file descriptor 00:20:00.693 [2024-11-16 17:39:38.078441] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:20:00.693 passed 00:20:00.693 Test: blockdev write read 8 blocks ...passed 00:20:00.693 Test: blockdev write read size > 128k ...passed 00:20:00.693 Test: blockdev write read invalid size ...passed 00:20:00.693 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:20:00.693 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:20:00.693 Test: blockdev write read max offset ...passed 00:20:00.952 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:20:00.952 Test: blockdev writev readv 8 blocks ...passed 00:20:00.952 Test: blockdev writev readv 30 x 1block ...passed 00:20:00.952 Test: blockdev writev readv block ...passed 00:20:00.952 Test: blockdev writev readv size > 128k ...passed 00:20:00.952 Test: blockdev writev readv size > 128k in two iovs ...passed 00:20:00.952 Test: blockdev comparev and writev ...[2024-11-16 17:39:38.249714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.952 [2024-11-16 17:39:38.249750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:20:00.952 [2024-11-16 17:39:38.249781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.952 [2024-11-16 17:39:38.249798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:20:00.952 [2024-11-16 17:39:38.250167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.952 [2024-11-16 17:39:38.250192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:20:00.952 [2024-11-16 17:39:38.250214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.953 [2024-11-16 17:39:38.250229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:20:00.953 [2024-11-16 17:39:38.250574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.953 [2024-11-16 17:39:38.250606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:20:00.953 [2024-11-16 17:39:38.250636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.953 [2024-11-16 17:39:38.250668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:20:00.953 [2024-11-16 17:39:38.251037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.953 [2024-11-16 17:39:38.251061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:20:00.953 [2024-11-16 17:39:38.251082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:20:00.953 [2024-11-16 17:39:38.251098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:20:00.953 passed 00:20:00.953 Test: blockdev nvme passthru rw ...passed 00:20:00.953 Test: blockdev nvme passthru vendor specific ...[2024-11-16 17:39:38.332877] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:00.953 [2024-11-16 17:39:38.332914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:20:00.953 [2024-11-16 17:39:38.333067] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:00.953 [2024-11-16 17:39:38.333090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:20:00.953 [2024-11-16 17:39:38.333222] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:00.953 [2024-11-16 17:39:38.333245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:20:00.953 [2024-11-16 17:39:38.333380] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:20:00.953 [2024-11-16 17:39:38.333403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:20:00.953 passed 00:20:00.953 Test: blockdev nvme admin passthru ...passed 00:20:00.953 Test: blockdev copy ...passed 00:20:00.953 00:20:00.953 Run Summary: Type Total Ran Passed Failed Inactive 00:20:00.953 suites 1 1 n/a 0 0 00:20:00.953 tests 23 23 23 0 0 00:20:00.953 asserts 152 152 152 0 n/a 00:20:00.953 00:20:00.953 Elapsed time = 1.149 seconds 00:20:01.520 17:39:38 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:01.520 17:39:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:01.520 17:39:38 -- common/autotest_common.sh@10 -- # set +x 00:20:01.520 17:39:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:01.520 17:39:38 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:20:01.520 17:39:38 -- target/bdevio.sh@30 -- # nvmftestfini 00:20:01.520 17:39:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:01.520 17:39:38 -- nvmf/common.sh@116 -- # sync 00:20:01.520 17:39:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:01.520 17:39:38 -- nvmf/common.sh@119 -- # set +e 00:20:01.520 17:39:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:01.520 17:39:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:01.520 rmmod nvme_tcp 00:20:01.520 rmmod nvme_fabrics 00:20:01.520 rmmod nvme_keyring 00:20:01.520 17:39:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:01.520 17:39:38 -- nvmf/common.sh@123 -- # set -e 00:20:01.520 17:39:38 -- nvmf/common.sh@124 -- # return 0 00:20:01.520 17:39:38 -- nvmf/common.sh@477 -- # '[' -n 1606003 ']' 00:20:01.520 17:39:38 -- nvmf/common.sh@478 -- # killprocess 1606003 00:20:01.520 17:39:38 -- common/autotest_common.sh@936 -- # '[' -z 1606003 ']' 00:20:01.520 17:39:38 -- common/autotest_common.sh@940 -- # kill -0 1606003 00:20:01.520 17:39:38 -- common/autotest_common.sh@941 -- # uname 00:20:01.520 17:39:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:01.520 17:39:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1606003 00:20:01.520 17:39:38 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:20:01.520 17:39:38 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:20:01.520 17:39:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1606003' 00:20:01.520 killing process with pid 1606003 00:20:01.520 17:39:38 -- common/autotest_common.sh@955 -- # kill 1606003 00:20:01.520 17:39:38 -- common/autotest_common.sh@960 -- # wait 1606003 00:20:01.779 17:39:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:01.779 17:39:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:01.779 17:39:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:01.779 17:39:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:01.779 17:39:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:01.779 17:39:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:01.779 17:39:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:01.779 17:39:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:04.312 17:39:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:04.312 00:20:04.312 real 0m7.260s 00:20:04.312 user 0m14.090s 00:20:04.312 sys 0m2.562s 00:20:04.312 17:39:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:04.312 17:39:41 -- common/autotest_common.sh@10 -- # set +x 00:20:04.312 ************************************ 00:20:04.312 END TEST nvmf_bdevio_no_huge 00:20:04.312 ************************************ 00:20:04.312 17:39:41 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:04.312 17:39:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:04.313 17:39:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:04.313 17:39:41 -- common/autotest_common.sh@10 -- # set +x 00:20:04.313 ************************************ 00:20:04.313 START TEST nvmf_tls 00:20:04.313 ************************************ 00:20:04.313 17:39:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:04.313 * Looking for test storage... 00:20:04.313 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:04.313 17:39:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:04.313 17:39:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:04.313 17:39:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:04.313 17:39:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:04.313 17:39:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:04.313 17:39:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:04.313 17:39:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:04.313 17:39:41 -- scripts/common.sh@335 -- # IFS=.-: 00:20:04.313 17:39:41 -- scripts/common.sh@335 -- # read -ra ver1 00:20:04.313 17:39:41 -- scripts/common.sh@336 -- # IFS=.-: 00:20:04.313 17:39:41 -- scripts/common.sh@336 -- # read -ra ver2 00:20:04.313 17:39:41 -- scripts/common.sh@337 -- # local 'op=<' 00:20:04.313 17:39:41 -- scripts/common.sh@339 -- # ver1_l=2 00:20:04.313 17:39:41 -- scripts/common.sh@340 -- # ver2_l=1 00:20:04.313 17:39:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:04.313 17:39:41 -- scripts/common.sh@343 -- # case "$op" in 00:20:04.313 17:39:41 -- scripts/common.sh@344 -- # : 1 00:20:04.313 17:39:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:04.313 17:39:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:04.313 17:39:41 -- scripts/common.sh@364 -- # decimal 1 00:20:04.313 17:39:41 -- scripts/common.sh@352 -- # local d=1 00:20:04.313 17:39:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:04.313 17:39:41 -- scripts/common.sh@354 -- # echo 1 00:20:04.313 17:39:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:04.313 17:39:41 -- scripts/common.sh@365 -- # decimal 2 00:20:04.313 17:39:41 -- scripts/common.sh@352 -- # local d=2 00:20:04.313 17:39:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:04.313 17:39:41 -- scripts/common.sh@354 -- # echo 2 00:20:04.313 17:39:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:04.313 17:39:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:04.313 17:39:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:04.313 17:39:41 -- scripts/common.sh@367 -- # return 0 00:20:04.313 17:39:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:04.313 17:39:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:04.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.313 --rc genhtml_branch_coverage=1 00:20:04.313 --rc genhtml_function_coverage=1 00:20:04.313 --rc genhtml_legend=1 00:20:04.313 --rc geninfo_all_blocks=1 00:20:04.313 --rc geninfo_unexecuted_blocks=1 00:20:04.313 00:20:04.313 ' 00:20:04.313 17:39:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:04.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.313 --rc genhtml_branch_coverage=1 00:20:04.313 --rc genhtml_function_coverage=1 00:20:04.313 --rc genhtml_legend=1 00:20:04.313 --rc geninfo_all_blocks=1 00:20:04.313 --rc geninfo_unexecuted_blocks=1 00:20:04.313 00:20:04.313 ' 00:20:04.313 17:39:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:04.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.313 --rc genhtml_branch_coverage=1 00:20:04.313 --rc genhtml_function_coverage=1 00:20:04.313 --rc genhtml_legend=1 00:20:04.313 --rc geninfo_all_blocks=1 00:20:04.313 --rc geninfo_unexecuted_blocks=1 00:20:04.313 00:20:04.313 ' 00:20:04.313 17:39:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:04.313 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:04.313 --rc genhtml_branch_coverage=1 00:20:04.313 --rc genhtml_function_coverage=1 00:20:04.313 --rc genhtml_legend=1 00:20:04.313 --rc geninfo_all_blocks=1 00:20:04.313 --rc geninfo_unexecuted_blocks=1 00:20:04.313 00:20:04.313 ' 00:20:04.313 17:39:41 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:04.313 17:39:41 -- nvmf/common.sh@7 -- # uname -s 00:20:04.313 17:39:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:04.313 17:39:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:04.313 17:39:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:04.313 17:39:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:04.313 17:39:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:04.313 17:39:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:04.313 17:39:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:04.313 17:39:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:04.313 17:39:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:04.313 17:39:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:04.313 17:39:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:04.313 17:39:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:04.313 17:39:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:04.313 17:39:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:04.313 17:39:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:04.313 17:39:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:04.313 17:39:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:04.313 17:39:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:04.313 17:39:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:04.313 17:39:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.313 17:39:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.313 17:39:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.313 17:39:41 -- paths/export.sh@5 -- # export PATH 00:20:04.313 17:39:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:04.313 17:39:41 -- nvmf/common.sh@46 -- # : 0 00:20:04.313 17:39:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:04.313 17:39:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:04.313 17:39:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:04.313 17:39:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:04.313 17:39:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:04.313 17:39:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:04.313 17:39:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:04.313 17:39:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:04.313 17:39:41 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:04.313 17:39:41 -- target/tls.sh@71 -- # nvmftestinit 00:20:04.313 17:39:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:04.313 17:39:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:04.313 17:39:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:04.313 17:39:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:04.313 17:39:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:04.313 17:39:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:04.313 17:39:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:04.313 17:39:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:04.313 17:39:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:04.313 17:39:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:04.313 17:39:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:04.313 17:39:41 -- common/autotest_common.sh@10 -- # set +x 00:20:06.217 17:39:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:06.217 17:39:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:06.217 17:39:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:06.217 17:39:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:06.217 17:39:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:06.217 17:39:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:06.217 17:39:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:06.217 17:39:43 -- nvmf/common.sh@294 -- # net_devs=() 00:20:06.217 17:39:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:06.217 17:39:43 -- nvmf/common.sh@295 -- # e810=() 00:20:06.217 17:39:43 -- nvmf/common.sh@295 -- # local -ga e810 00:20:06.217 17:39:43 -- nvmf/common.sh@296 -- # x722=() 00:20:06.217 17:39:43 -- nvmf/common.sh@296 -- # local -ga x722 00:20:06.217 17:39:43 -- nvmf/common.sh@297 -- # mlx=() 00:20:06.217 17:39:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:06.217 17:39:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:06.217 17:39:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:06.217 17:39:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:06.217 17:39:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:06.217 17:39:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:06.217 17:39:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:06.217 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:06.217 17:39:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:06.217 17:39:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:06.217 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:06.217 17:39:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:06.217 17:39:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:06.217 17:39:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:06.217 17:39:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:06.217 17:39:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:06.217 17:39:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:06.217 17:39:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:06.217 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:06.217 17:39:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:06.217 17:39:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:06.217 17:39:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:06.217 17:39:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:06.218 17:39:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:06.218 17:39:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:06.218 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:06.218 17:39:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:06.218 17:39:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:06.218 17:39:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:06.218 17:39:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:06.218 17:39:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:06.218 17:39:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:06.218 17:39:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:06.218 17:39:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:06.218 17:39:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:06.218 17:39:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:06.218 17:39:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:06.218 17:39:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:06.218 17:39:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:06.218 17:39:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:06.218 17:39:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:06.218 17:39:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:06.218 17:39:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:06.218 17:39:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:06.218 17:39:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:06.218 17:39:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:06.218 17:39:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:06.218 17:39:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:06.218 17:39:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:06.218 17:39:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:06.218 17:39:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:06.218 17:39:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:06.218 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:06.218 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:20:06.218 00:20:06.218 --- 10.0.0.2 ping statistics --- 00:20:06.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:06.218 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:20:06.218 17:39:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:06.218 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:06.218 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.084 ms 00:20:06.218 00:20:06.218 --- 10.0.0.1 ping statistics --- 00:20:06.218 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:06.218 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:20:06.218 17:39:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:06.218 17:39:43 -- nvmf/common.sh@410 -- # return 0 00:20:06.218 17:39:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:06.218 17:39:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:06.218 17:39:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:06.218 17:39:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:06.218 17:39:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:06.218 17:39:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:06.218 17:39:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:06.218 17:39:43 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:06.218 17:39:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:06.218 17:39:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:06.218 17:39:43 -- common/autotest_common.sh@10 -- # set +x 00:20:06.218 17:39:43 -- nvmf/common.sh@469 -- # nvmfpid=1608381 00:20:06.218 17:39:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:06.218 17:39:43 -- nvmf/common.sh@470 -- # waitforlisten 1608381 00:20:06.218 17:39:43 -- common/autotest_common.sh@829 -- # '[' -z 1608381 ']' 00:20:06.218 17:39:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:06.218 17:39:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:06.218 17:39:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:06.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:06.218 17:39:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:06.218 17:39:43 -- common/autotest_common.sh@10 -- # set +x 00:20:06.218 [2024-11-16 17:39:43.608532] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:06.218 [2024-11-16 17:39:43.608638] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:06.218 EAL: No free 2048 kB hugepages reported on node 1 00:20:06.218 [2024-11-16 17:39:43.684260] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:06.476 [2024-11-16 17:39:43.772969] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:06.476 [2024-11-16 17:39:43.773125] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:06.476 [2024-11-16 17:39:43.773142] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:06.476 [2024-11-16 17:39:43.773155] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:06.476 [2024-11-16 17:39:43.773184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:06.476 17:39:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:06.476 17:39:43 -- common/autotest_common.sh@862 -- # return 0 00:20:06.476 17:39:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:06.476 17:39:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:06.476 17:39:43 -- common/autotest_common.sh@10 -- # set +x 00:20:06.476 17:39:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:06.476 17:39:43 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:06.476 17:39:43 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:06.734 true 00:20:06.734 17:39:44 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:06.734 17:39:44 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:06.992 17:39:44 -- target/tls.sh@82 -- # version=0 00:20:06.992 17:39:44 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:06.992 17:39:44 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:07.250 17:39:44 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.250 17:39:44 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:07.509 17:39:44 -- target/tls.sh@90 -- # version=13 00:20:07.509 17:39:44 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:07.509 17:39:44 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:07.768 17:39:45 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.768 17:39:45 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:08.027 17:39:45 -- target/tls.sh@98 -- # version=7 00:20:08.027 17:39:45 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:08.027 17:39:45 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:08.027 17:39:45 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:08.286 17:39:45 -- target/tls.sh@105 -- # ktls=false 00:20:08.286 17:39:45 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:08.286 17:39:45 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:08.544 17:39:45 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:08.544 17:39:45 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:08.803 17:39:46 -- target/tls.sh@113 -- # ktls=true 00:20:08.803 17:39:46 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:08.803 17:39:46 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:09.062 17:39:46 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:09.062 17:39:46 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:09.320 17:39:46 -- target/tls.sh@121 -- # ktls=false 00:20:09.320 17:39:46 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:09.320 17:39:46 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:09.320 17:39:46 -- target/tls.sh@49 -- # local key hash crc 00:20:09.320 17:39:46 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:09.320 17:39:46 -- target/tls.sh@51 -- # hash=01 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # tail -c8 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # gzip -1 -c 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # head -c 4 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # crc='p$H�' 00:20:09.320 17:39:46 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:09.320 17:39:46 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:09.320 17:39:46 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.320 17:39:46 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.320 17:39:46 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:09.320 17:39:46 -- target/tls.sh@49 -- # local key hash crc 00:20:09.320 17:39:46 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:09.320 17:39:46 -- target/tls.sh@51 -- # hash=01 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # gzip -1 -c 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # tail -c8 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # head -c 4 00:20:09.320 17:39:46 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:09.320 17:39:46 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:09.320 17:39:46 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:09.320 17:39:46 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.320 17:39:46 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.320 17:39:46 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.320 17:39:46 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:09.320 17:39:46 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:09.320 17:39:46 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:09.320 17:39:46 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:09.320 17:39:46 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:09.320 17:39:46 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:09.578 17:39:47 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:10.176 17:39:47 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.176 17:39:47 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.176 17:39:47 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:10.461 [2024-11-16 17:39:47.706201] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:10.461 17:39:47 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:10.719 17:39:47 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:10.977 [2024-11-16 17:39:48.263722] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:10.977 [2024-11-16 17:39:48.264001] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:10.977 17:39:48 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:11.236 malloc0 00:20:11.236 17:39:48 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:11.494 17:39:48 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:11.752 17:39:49 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:11.752 EAL: No free 2048 kB hugepages reported on node 1 00:20:23.948 Initializing NVMe Controllers 00:20:23.948 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:23.948 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:23.948 Initialization complete. Launching workers. 00:20:23.948 ======================================================== 00:20:23.948 Latency(us) 00:20:23.948 Device Information : IOPS MiB/s Average min max 00:20:23.948 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7638.45 29.84 8381.42 1149.36 9369.36 00:20:23.948 ======================================================== 00:20:23.948 Total : 7638.45 29.84 8381.42 1149.36 9369.36 00:20:23.948 00:20:23.948 17:39:59 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:23.948 17:39:59 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:23.948 17:39:59 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:23.948 17:39:59 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:23.948 17:39:59 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:23.948 17:39:59 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:23.948 17:39:59 -- target/tls.sh@28 -- # bdevperf_pid=1610343 00:20:23.948 17:39:59 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:23.948 17:39:59 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:23.948 17:39:59 -- target/tls.sh@31 -- # waitforlisten 1610343 /var/tmp/bdevperf.sock 00:20:23.948 17:39:59 -- common/autotest_common.sh@829 -- # '[' -z 1610343 ']' 00:20:23.948 17:39:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:23.948 17:39:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:23.948 17:39:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:23.948 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:23.948 17:39:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:23.948 17:39:59 -- common/autotest_common.sh@10 -- # set +x 00:20:23.948 [2024-11-16 17:39:59.296946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:23.948 [2024-11-16 17:39:59.297020] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1610343 ] 00:20:23.948 EAL: No free 2048 kB hugepages reported on node 1 00:20:23.948 [2024-11-16 17:39:59.355541] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:23.948 [2024-11-16 17:39:59.439344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:23.948 17:40:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:23.948 17:40:00 -- common/autotest_common.sh@862 -- # return 0 00:20:23.948 17:40:00 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:23.948 [2024-11-16 17:40:00.522044] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:23.948 TLSTESTn1 00:20:23.948 17:40:00 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:23.948 Running I/O for 10 seconds... 00:20:33.916 00:20:33.916 Latency(us) 00:20:33.916 [2024-11-16T16:40:11.408Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:33.916 [2024-11-16T16:40:11.408Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:33.916 Verification LBA range: start 0x0 length 0x2000 00:20:33.916 TLSTESTn1 : 10.03 4052.14 15.83 0.00 0.00 31526.10 5558.42 78449.02 00:20:33.916 [2024-11-16T16:40:11.408Z] =================================================================================================================== 00:20:33.916 [2024-11-16T16:40:11.408Z] Total : 4052.14 15.83 0.00 0.00 31526.10 5558.42 78449.02 00:20:33.916 0 00:20:33.916 17:40:10 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:33.916 17:40:10 -- target/tls.sh@45 -- # killprocess 1610343 00:20:33.916 17:40:10 -- common/autotest_common.sh@936 -- # '[' -z 1610343 ']' 00:20:33.916 17:40:10 -- common/autotest_common.sh@940 -- # kill -0 1610343 00:20:33.916 17:40:10 -- common/autotest_common.sh@941 -- # uname 00:20:33.916 17:40:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:33.916 17:40:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1610343 00:20:33.916 17:40:10 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:33.916 17:40:10 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:33.916 17:40:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1610343' 00:20:33.916 killing process with pid 1610343 00:20:33.916 17:40:10 -- common/autotest_common.sh@955 -- # kill 1610343 00:20:33.916 Received shutdown signal, test time was about 10.000000 seconds 00:20:33.916 00:20:33.916 Latency(us) 00:20:33.916 [2024-11-16T16:40:11.408Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:33.916 [2024-11-16T16:40:11.408Z] =================================================================================================================== 00:20:33.916 [2024-11-16T16:40:11.408Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:33.916 17:40:10 -- common/autotest_common.sh@960 -- # wait 1610343 00:20:33.916 17:40:11 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.916 17:40:11 -- common/autotest_common.sh@650 -- # local es=0 00:20:33.916 17:40:11 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.916 17:40:11 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:33.916 17:40:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.916 17:40:11 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:33.916 17:40:11 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.916 17:40:11 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.916 17:40:11 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:33.916 17:40:11 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:33.916 17:40:11 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:33.916 17:40:11 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:33.916 17:40:11 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:33.916 17:40:11 -- target/tls.sh@28 -- # bdevperf_pid=1611712 00:20:33.916 17:40:11 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.916 17:40:11 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.916 17:40:11 -- target/tls.sh@31 -- # waitforlisten 1611712 /var/tmp/bdevperf.sock 00:20:33.916 17:40:11 -- common/autotest_common.sh@829 -- # '[' -z 1611712 ']' 00:20:33.916 17:40:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.917 17:40:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:33.917 17:40:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.917 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.917 17:40:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:33.917 17:40:11 -- common/autotest_common.sh@10 -- # set +x 00:20:33.917 [2024-11-16 17:40:11.087965] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:33.917 [2024-11-16 17:40:11.088053] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1611712 ] 00:20:33.917 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.917 [2024-11-16 17:40:11.145442] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.917 [2024-11-16 17:40:11.223519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.849 17:40:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:34.849 17:40:12 -- common/autotest_common.sh@862 -- # return 0 00:20:34.849 17:40:12 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:34.849 [2024-11-16 17:40:12.266398] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:34.849 [2024-11-16 17:40:12.274517] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:34.849 [2024-11-16 17:40:12.275061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe9acf0 (107): Transport endpoint is not connected 00:20:34.849 [2024-11-16 17:40:12.276044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe9acf0 (9): Bad file descriptor 00:20:34.849 [2024-11-16 17:40:12.277043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:34.849 [2024-11-16 17:40:12.277063] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:34.849 [2024-11-16 17:40:12.277075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:34.849 request: 00:20:34.849 { 00:20:34.849 "name": "TLSTEST", 00:20:34.849 "trtype": "tcp", 00:20:34.849 "traddr": "10.0.0.2", 00:20:34.849 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:34.849 "adrfam": "ipv4", 00:20:34.849 "trsvcid": "4420", 00:20:34.849 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:34.849 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:34.849 "method": "bdev_nvme_attach_controller", 00:20:34.849 "req_id": 1 00:20:34.849 } 00:20:34.849 Got JSON-RPC error response 00:20:34.849 response: 00:20:34.849 { 00:20:34.849 "code": -32602, 00:20:34.849 "message": "Invalid parameters" 00:20:34.849 } 00:20:34.849 17:40:12 -- target/tls.sh@36 -- # killprocess 1611712 00:20:34.849 17:40:12 -- common/autotest_common.sh@936 -- # '[' -z 1611712 ']' 00:20:34.849 17:40:12 -- common/autotest_common.sh@940 -- # kill -0 1611712 00:20:34.849 17:40:12 -- common/autotest_common.sh@941 -- # uname 00:20:34.849 17:40:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:34.849 17:40:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1611712 00:20:34.849 17:40:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:34.849 17:40:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:34.849 17:40:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1611712' 00:20:34.849 killing process with pid 1611712 00:20:34.849 17:40:12 -- common/autotest_common.sh@955 -- # kill 1611712 00:20:34.849 Received shutdown signal, test time was about 10.000000 seconds 00:20:34.849 00:20:34.849 Latency(us) 00:20:34.849 [2024-11-16T16:40:12.341Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:34.849 [2024-11-16T16:40:12.341Z] =================================================================================================================== 00:20:34.849 [2024-11-16T16:40:12.341Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:34.849 17:40:12 -- common/autotest_common.sh@960 -- # wait 1611712 00:20:35.106 17:40:12 -- target/tls.sh@37 -- # return 1 00:20:35.106 17:40:12 -- common/autotest_common.sh@653 -- # es=1 00:20:35.106 17:40:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:35.106 17:40:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:35.106 17:40:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:35.106 17:40:12 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.106 17:40:12 -- common/autotest_common.sh@650 -- # local es=0 00:20:35.106 17:40:12 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.106 17:40:12 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:35.106 17:40:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:35.106 17:40:12 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:35.106 17:40:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:35.106 17:40:12 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.106 17:40:12 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:35.107 17:40:12 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:35.107 17:40:12 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:35.107 17:40:12 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:35.107 17:40:12 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:35.107 17:40:12 -- target/tls.sh@28 -- # bdevperf_pid=1611859 00:20:35.107 17:40:12 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:35.107 17:40:12 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:35.107 17:40:12 -- target/tls.sh@31 -- # waitforlisten 1611859 /var/tmp/bdevperf.sock 00:20:35.107 17:40:12 -- common/autotest_common.sh@829 -- # '[' -z 1611859 ']' 00:20:35.107 17:40:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:35.107 17:40:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:35.107 17:40:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:35.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:35.107 17:40:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:35.107 17:40:12 -- common/autotest_common.sh@10 -- # set +x 00:20:35.107 [2024-11-16 17:40:12.597830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:35.107 [2024-11-16 17:40:12.597905] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1611859 ] 00:20:35.364 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.364 [2024-11-16 17:40:12.659881] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.364 [2024-11-16 17:40:12.742977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:36.298 17:40:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:36.298 17:40:13 -- common/autotest_common.sh@862 -- # return 0 00:20:36.298 17:40:13 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.556 [2024-11-16 17:40:13.813818] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:36.556 [2024-11-16 17:40:13.819155] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:36.556 [2024-11-16 17:40:13.819187] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:36.556 [2024-11-16 17:40:13.819227] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:36.556 [2024-11-16 17:40:13.819693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x183acf0 (107): Transport endpoint is not connected 00:20:36.556 [2024-11-16 17:40:13.820681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x183acf0 (9): Bad file descriptor 00:20:36.556 [2024-11-16 17:40:13.821679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:36.556 [2024-11-16 17:40:13.821704] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:36.556 [2024-11-16 17:40:13.821719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:36.556 request: 00:20:36.556 { 00:20:36.556 "name": "TLSTEST", 00:20:36.556 "trtype": "tcp", 00:20:36.556 "traddr": "10.0.0.2", 00:20:36.556 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:36.556 "adrfam": "ipv4", 00:20:36.556 "trsvcid": "4420", 00:20:36.556 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:36.556 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:36.556 "method": "bdev_nvme_attach_controller", 00:20:36.556 "req_id": 1 00:20:36.556 } 00:20:36.556 Got JSON-RPC error response 00:20:36.556 response: 00:20:36.556 { 00:20:36.556 "code": -32602, 00:20:36.556 "message": "Invalid parameters" 00:20:36.556 } 00:20:36.556 17:40:13 -- target/tls.sh@36 -- # killprocess 1611859 00:20:36.556 17:40:13 -- common/autotest_common.sh@936 -- # '[' -z 1611859 ']' 00:20:36.556 17:40:13 -- common/autotest_common.sh@940 -- # kill -0 1611859 00:20:36.556 17:40:13 -- common/autotest_common.sh@941 -- # uname 00:20:36.556 17:40:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:36.556 17:40:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1611859 00:20:36.556 17:40:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:36.556 17:40:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:36.556 17:40:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1611859' 00:20:36.556 killing process with pid 1611859 00:20:36.556 17:40:13 -- common/autotest_common.sh@955 -- # kill 1611859 00:20:36.556 Received shutdown signal, test time was about 10.000000 seconds 00:20:36.556 00:20:36.556 Latency(us) 00:20:36.556 [2024-11-16T16:40:14.048Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:36.556 [2024-11-16T16:40:14.048Z] =================================================================================================================== 00:20:36.556 [2024-11-16T16:40:14.048Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:36.556 17:40:13 -- common/autotest_common.sh@960 -- # wait 1611859 00:20:36.815 17:40:14 -- target/tls.sh@37 -- # return 1 00:20:36.815 17:40:14 -- common/autotest_common.sh@653 -- # es=1 00:20:36.815 17:40:14 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:36.815 17:40:14 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:36.815 17:40:14 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:36.815 17:40:14 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.815 17:40:14 -- common/autotest_common.sh@650 -- # local es=0 00:20:36.815 17:40:14 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.815 17:40:14 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:36.815 17:40:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:36.815 17:40:14 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:36.815 17:40:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:36.815 17:40:14 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.815 17:40:14 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:36.815 17:40:14 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:36.815 17:40:14 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:36.815 17:40:14 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:36.815 17:40:14 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:36.815 17:40:14 -- target/tls.sh@28 -- # bdevperf_pid=1612137 00:20:36.815 17:40:14 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:36.815 17:40:14 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:36.815 17:40:14 -- target/tls.sh@31 -- # waitforlisten 1612137 /var/tmp/bdevperf.sock 00:20:36.815 17:40:14 -- common/autotest_common.sh@829 -- # '[' -z 1612137 ']' 00:20:36.815 17:40:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:36.815 17:40:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:36.815 17:40:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:36.815 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:36.815 17:40:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:36.815 17:40:14 -- common/autotest_common.sh@10 -- # set +x 00:20:36.815 [2024-11-16 17:40:14.129135] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:36.815 [2024-11-16 17:40:14.129210] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1612137 ] 00:20:36.815 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.815 [2024-11-16 17:40:14.185585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:36.815 [2024-11-16 17:40:14.266241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:37.749 17:40:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:37.749 17:40:15 -- common/autotest_common.sh@862 -- # return 0 00:20:37.749 17:40:15 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:38.007 [2024-11-16 17:40:15.334205] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:38.007 [2024-11-16 17:40:15.342364] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:38.007 [2024-11-16 17:40:15.342395] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:38.007 [2024-11-16 17:40:15.342434] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:38.007 [2024-11-16 17:40:15.342992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112fcf0 (107): Transport endpoint is not connected 00:20:38.007 [2024-11-16 17:40:15.343981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x112fcf0 (9): Bad file descriptor 00:20:38.007 [2024-11-16 17:40:15.344979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:38.007 [2024-11-16 17:40:15.345000] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:38.007 [2024-11-16 17:40:15.345013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:38.007 request: 00:20:38.007 { 00:20:38.007 "name": "TLSTEST", 00:20:38.007 "trtype": "tcp", 00:20:38.007 "traddr": "10.0.0.2", 00:20:38.007 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:38.007 "adrfam": "ipv4", 00:20:38.007 "trsvcid": "4420", 00:20:38.007 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:38.007 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:38.007 "method": "bdev_nvme_attach_controller", 00:20:38.007 "req_id": 1 00:20:38.007 } 00:20:38.007 Got JSON-RPC error response 00:20:38.007 response: 00:20:38.007 { 00:20:38.007 "code": -32602, 00:20:38.007 "message": "Invalid parameters" 00:20:38.007 } 00:20:38.007 17:40:15 -- target/tls.sh@36 -- # killprocess 1612137 00:20:38.007 17:40:15 -- common/autotest_common.sh@936 -- # '[' -z 1612137 ']' 00:20:38.007 17:40:15 -- common/autotest_common.sh@940 -- # kill -0 1612137 00:20:38.007 17:40:15 -- common/autotest_common.sh@941 -- # uname 00:20:38.007 17:40:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:38.007 17:40:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1612137 00:20:38.007 17:40:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:38.007 17:40:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:38.007 17:40:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1612137' 00:20:38.007 killing process with pid 1612137 00:20:38.007 17:40:15 -- common/autotest_common.sh@955 -- # kill 1612137 00:20:38.007 Received shutdown signal, test time was about 10.000000 seconds 00:20:38.007 00:20:38.007 Latency(us) 00:20:38.007 [2024-11-16T16:40:15.499Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:38.007 [2024-11-16T16:40:15.499Z] =================================================================================================================== 00:20:38.007 [2024-11-16T16:40:15.499Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:38.007 17:40:15 -- common/autotest_common.sh@960 -- # wait 1612137 00:20:38.266 17:40:15 -- target/tls.sh@37 -- # return 1 00:20:38.266 17:40:15 -- common/autotest_common.sh@653 -- # es=1 00:20:38.266 17:40:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:38.266 17:40:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:38.266 17:40:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:38.266 17:40:15 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.266 17:40:15 -- common/autotest_common.sh@650 -- # local es=0 00:20:38.266 17:40:15 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.266 17:40:15 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:38.266 17:40:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:38.266 17:40:15 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:38.266 17:40:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:38.266 17:40:15 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:38.266 17:40:15 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:38.266 17:40:15 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:38.266 17:40:15 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:38.266 17:40:15 -- target/tls.sh@23 -- # psk= 00:20:38.266 17:40:15 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:38.266 17:40:15 -- target/tls.sh@28 -- # bdevperf_pid=1612284 00:20:38.266 17:40:15 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:38.266 17:40:15 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:38.266 17:40:15 -- target/tls.sh@31 -- # waitforlisten 1612284 /var/tmp/bdevperf.sock 00:20:38.266 17:40:15 -- common/autotest_common.sh@829 -- # '[' -z 1612284 ']' 00:20:38.266 17:40:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:38.266 17:40:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:38.266 17:40:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:38.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:38.266 17:40:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:38.266 17:40:15 -- common/autotest_common.sh@10 -- # set +x 00:20:38.266 [2024-11-16 17:40:15.670175] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:38.266 [2024-11-16 17:40:15.670261] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1612284 ] 00:20:38.266 EAL: No free 2048 kB hugepages reported on node 1 00:20:38.266 [2024-11-16 17:40:15.728609] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:38.524 [2024-11-16 17:40:15.808664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:39.458 17:40:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:39.458 17:40:16 -- common/autotest_common.sh@862 -- # return 0 00:20:39.458 17:40:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:39.458 [2024-11-16 17:40:16.916554] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:39.458 [2024-11-16 17:40:16.918687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d87720 (9): Bad file descriptor 00:20:39.458 [2024-11-16 17:40:16.919667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:39.458 [2024-11-16 17:40:16.919690] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:39.458 [2024-11-16 17:40:16.919704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:39.458 request: 00:20:39.458 { 00:20:39.458 "name": "TLSTEST", 00:20:39.458 "trtype": "tcp", 00:20:39.458 "traddr": "10.0.0.2", 00:20:39.458 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:39.458 "adrfam": "ipv4", 00:20:39.458 "trsvcid": "4420", 00:20:39.458 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:39.458 "method": "bdev_nvme_attach_controller", 00:20:39.458 "req_id": 1 00:20:39.458 } 00:20:39.458 Got JSON-RPC error response 00:20:39.458 response: 00:20:39.458 { 00:20:39.458 "code": -32602, 00:20:39.458 "message": "Invalid parameters" 00:20:39.458 } 00:20:39.458 17:40:16 -- target/tls.sh@36 -- # killprocess 1612284 00:20:39.458 17:40:16 -- common/autotest_common.sh@936 -- # '[' -z 1612284 ']' 00:20:39.458 17:40:16 -- common/autotest_common.sh@940 -- # kill -0 1612284 00:20:39.458 17:40:16 -- common/autotest_common.sh@941 -- # uname 00:20:39.458 17:40:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:39.458 17:40:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1612284 00:20:39.717 17:40:16 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:39.717 17:40:16 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:39.717 17:40:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1612284' 00:20:39.717 killing process with pid 1612284 00:20:39.717 17:40:16 -- common/autotest_common.sh@955 -- # kill 1612284 00:20:39.717 Received shutdown signal, test time was about 10.000000 seconds 00:20:39.717 00:20:39.717 Latency(us) 00:20:39.717 [2024-11-16T16:40:17.209Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:39.717 [2024-11-16T16:40:17.209Z] =================================================================================================================== 00:20:39.717 [2024-11-16T16:40:17.209Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:39.717 17:40:16 -- common/autotest_common.sh@960 -- # wait 1612284 00:20:39.717 17:40:17 -- target/tls.sh@37 -- # return 1 00:20:39.717 17:40:17 -- common/autotest_common.sh@653 -- # es=1 00:20:39.717 17:40:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:39.717 17:40:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:39.717 17:40:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:39.717 17:40:17 -- target/tls.sh@167 -- # killprocess 1608381 00:20:39.717 17:40:17 -- common/autotest_common.sh@936 -- # '[' -z 1608381 ']' 00:20:39.717 17:40:17 -- common/autotest_common.sh@940 -- # kill -0 1608381 00:20:39.717 17:40:17 -- common/autotest_common.sh@941 -- # uname 00:20:39.717 17:40:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:39.717 17:40:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1608381 00:20:39.975 17:40:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:39.975 17:40:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:39.975 17:40:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1608381' 00:20:39.975 killing process with pid 1608381 00:20:39.975 17:40:17 -- common/autotest_common.sh@955 -- # kill 1608381 00:20:39.975 17:40:17 -- common/autotest_common.sh@960 -- # wait 1608381 00:20:40.234 17:40:17 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:40.234 17:40:17 -- target/tls.sh@49 -- # local key hash crc 00:20:40.234 17:40:17 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:40.234 17:40:17 -- target/tls.sh@51 -- # hash=02 00:20:40.234 17:40:17 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:40.234 17:40:17 -- target/tls.sh@52 -- # gzip -1 -c 00:20:40.234 17:40:17 -- target/tls.sh@52 -- # tail -c8 00:20:40.234 17:40:17 -- target/tls.sh@52 -- # head -c 4 00:20:40.234 17:40:17 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:40.234 17:40:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:40.234 17:40:17 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:40.234 17:40:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.234 17:40:17 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.234 17:40:17 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.234 17:40:17 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:40.234 17:40:17 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.234 17:40:17 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:40.234 17:40:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:40.234 17:40:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:40.234 17:40:17 -- common/autotest_common.sh@10 -- # set +x 00:20:40.234 17:40:17 -- nvmf/common.sh@469 -- # nvmfpid=1612577 00:20:40.234 17:40:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:40.234 17:40:17 -- nvmf/common.sh@470 -- # waitforlisten 1612577 00:20:40.234 17:40:17 -- common/autotest_common.sh@829 -- # '[' -z 1612577 ']' 00:20:40.234 17:40:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:40.234 17:40:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:40.234 17:40:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:40.234 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:40.234 17:40:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:40.234 17:40:17 -- common/autotest_common.sh@10 -- # set +x 00:20:40.234 [2024-11-16 17:40:17.546300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:40.234 [2024-11-16 17:40:17.546389] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:40.234 EAL: No free 2048 kB hugepages reported on node 1 00:20:40.234 [2024-11-16 17:40:17.610594] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:40.234 [2024-11-16 17:40:17.698007] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:40.234 [2024-11-16 17:40:17.698162] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:40.234 [2024-11-16 17:40:17.698178] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:40.234 [2024-11-16 17:40:17.698191] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:40.234 [2024-11-16 17:40:17.698219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:41.169 17:40:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:41.169 17:40:18 -- common/autotest_common.sh@862 -- # return 0 00:20:41.169 17:40:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:41.169 17:40:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:41.169 17:40:18 -- common/autotest_common.sh@10 -- # set +x 00:20:41.169 17:40:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:41.169 17:40:18 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.169 17:40:18 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.169 17:40:18 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:41.427 [2024-11-16 17:40:18.773302] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:41.427 17:40:18 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:41.683 17:40:19 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:41.941 [2024-11-16 17:40:19.266612] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:41.941 [2024-11-16 17:40:19.266882] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:41.941 17:40:19 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:42.199 malloc0 00:20:42.199 17:40:19 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:42.457 17:40:19 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:42.716 17:40:20 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:42.716 17:40:20 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:42.716 17:40:20 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:42.716 17:40:20 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:42.716 17:40:20 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:42.716 17:40:20 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:42.716 17:40:20 -- target/tls.sh@28 -- # bdevperf_pid=1612881 00:20:42.716 17:40:20 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:42.716 17:40:20 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:42.716 17:40:20 -- target/tls.sh@31 -- # waitforlisten 1612881 /var/tmp/bdevperf.sock 00:20:42.716 17:40:20 -- common/autotest_common.sh@829 -- # '[' -z 1612881 ']' 00:20:42.716 17:40:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:42.716 17:40:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:42.716 17:40:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:42.716 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:42.716 17:40:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:42.716 17:40:20 -- common/autotest_common.sh@10 -- # set +x 00:20:42.716 [2024-11-16 17:40:20.111678] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:42.716 [2024-11-16 17:40:20.111768] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1612881 ] 00:20:42.716 EAL: No free 2048 kB hugepages reported on node 1 00:20:42.716 [2024-11-16 17:40:20.171972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:42.975 [2024-11-16 17:40:20.260081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:43.908 17:40:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:43.908 17:40:21 -- common/autotest_common.sh@862 -- # return 0 00:20:43.908 17:40:21 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:43.908 [2024-11-16 17:40:21.362858] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:44.166 TLSTESTn1 00:20:44.166 17:40:21 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:44.166 Running I/O for 10 seconds... 00:20:54.135 00:20:54.135 Latency(us) 00:20:54.135 [2024-11-16T16:40:31.627Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:54.135 [2024-11-16T16:40:31.627Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:54.135 Verification LBA range: start 0x0 length 0x2000 00:20:54.135 TLSTESTn1 : 10.02 4128.53 16.13 0.00 0.00 30953.99 5388.52 39612.87 00:20:54.135 [2024-11-16T16:40:31.627Z] =================================================================================================================== 00:20:54.135 [2024-11-16T16:40:31.627Z] Total : 4128.53 16.13 0.00 0.00 30953.99 5388.52 39612.87 00:20:54.135 0 00:20:54.135 17:40:31 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:54.135 17:40:31 -- target/tls.sh@45 -- # killprocess 1612881 00:20:54.135 17:40:31 -- common/autotest_common.sh@936 -- # '[' -z 1612881 ']' 00:20:54.135 17:40:31 -- common/autotest_common.sh@940 -- # kill -0 1612881 00:20:54.135 17:40:31 -- common/autotest_common.sh@941 -- # uname 00:20:54.135 17:40:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:54.135 17:40:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1612881 00:20:54.393 17:40:31 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:54.393 17:40:31 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:54.393 17:40:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1612881' 00:20:54.393 killing process with pid 1612881 00:20:54.393 17:40:31 -- common/autotest_common.sh@955 -- # kill 1612881 00:20:54.393 Received shutdown signal, test time was about 10.000000 seconds 00:20:54.393 00:20:54.393 Latency(us) 00:20:54.393 [2024-11-16T16:40:31.885Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:54.393 [2024-11-16T16:40:31.885Z] =================================================================================================================== 00:20:54.393 [2024-11-16T16:40:31.885Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:54.393 17:40:31 -- common/autotest_common.sh@960 -- # wait 1612881 00:20:54.393 17:40:31 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:54.652 17:40:31 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:54.652 17:40:31 -- common/autotest_common.sh@650 -- # local es=0 00:20:54.652 17:40:31 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:54.652 17:40:31 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:54.652 17:40:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:54.652 17:40:31 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:54.652 17:40:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:54.652 17:40:31 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:54.652 17:40:31 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:54.652 17:40:31 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:54.652 17:40:31 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:54.652 17:40:31 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:54.652 17:40:31 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:54.652 17:40:31 -- target/tls.sh@28 -- # bdevperf_pid=1614258 00:20:54.652 17:40:31 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:54.652 17:40:31 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:54.652 17:40:31 -- target/tls.sh@31 -- # waitforlisten 1614258 /var/tmp/bdevperf.sock 00:20:54.652 17:40:31 -- common/autotest_common.sh@829 -- # '[' -z 1614258 ']' 00:20:54.652 17:40:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:54.652 17:40:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:54.652 17:40:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:54.652 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:54.652 17:40:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:54.652 17:40:31 -- common/autotest_common.sh@10 -- # set +x 00:20:54.652 [2024-11-16 17:40:31.932727] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:54.652 [2024-11-16 17:40:31.932804] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1614258 ] 00:20:54.652 EAL: No free 2048 kB hugepages reported on node 1 00:20:54.652 [2024-11-16 17:40:31.992837] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:54.652 [2024-11-16 17:40:32.074408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:55.584 17:40:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:55.584 17:40:32 -- common/autotest_common.sh@862 -- # return 0 00:20:55.584 17:40:32 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.842 [2024-11-16 17:40:33.142281] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:55.842 [2024-11-16 17:40:33.142328] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:55.842 request: 00:20:55.842 { 00:20:55.842 "name": "TLSTEST", 00:20:55.842 "trtype": "tcp", 00:20:55.842 "traddr": "10.0.0.2", 00:20:55.842 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:55.842 "adrfam": "ipv4", 00:20:55.842 "trsvcid": "4420", 00:20:55.842 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:55.842 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:55.842 "method": "bdev_nvme_attach_controller", 00:20:55.842 "req_id": 1 00:20:55.842 } 00:20:55.842 Got JSON-RPC error response 00:20:55.842 response: 00:20:55.842 { 00:20:55.842 "code": -22, 00:20:55.842 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:55.842 } 00:20:55.842 17:40:33 -- target/tls.sh@36 -- # killprocess 1614258 00:20:55.842 17:40:33 -- common/autotest_common.sh@936 -- # '[' -z 1614258 ']' 00:20:55.842 17:40:33 -- common/autotest_common.sh@940 -- # kill -0 1614258 00:20:55.842 17:40:33 -- common/autotest_common.sh@941 -- # uname 00:20:55.842 17:40:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:55.842 17:40:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1614258 00:20:55.842 17:40:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:55.842 17:40:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:55.842 17:40:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1614258' 00:20:55.842 killing process with pid 1614258 00:20:55.842 17:40:33 -- common/autotest_common.sh@955 -- # kill 1614258 00:20:55.842 Received shutdown signal, test time was about 10.000000 seconds 00:20:55.842 00:20:55.843 Latency(us) 00:20:55.843 [2024-11-16T16:40:33.335Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:55.843 [2024-11-16T16:40:33.335Z] =================================================================================================================== 00:20:55.843 [2024-11-16T16:40:33.335Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:55.843 17:40:33 -- common/autotest_common.sh@960 -- # wait 1614258 00:20:56.101 17:40:33 -- target/tls.sh@37 -- # return 1 00:20:56.101 17:40:33 -- common/autotest_common.sh@653 -- # es=1 00:20:56.101 17:40:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:56.101 17:40:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:56.101 17:40:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:56.101 17:40:33 -- target/tls.sh@183 -- # killprocess 1612577 00:20:56.101 17:40:33 -- common/autotest_common.sh@936 -- # '[' -z 1612577 ']' 00:20:56.101 17:40:33 -- common/autotest_common.sh@940 -- # kill -0 1612577 00:20:56.101 17:40:33 -- common/autotest_common.sh@941 -- # uname 00:20:56.101 17:40:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.101 17:40:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1612577 00:20:56.101 17:40:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:56.101 17:40:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:56.101 17:40:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1612577' 00:20:56.101 killing process with pid 1612577 00:20:56.101 17:40:33 -- common/autotest_common.sh@955 -- # kill 1612577 00:20:56.101 17:40:33 -- common/autotest_common.sh@960 -- # wait 1612577 00:20:56.359 17:40:33 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:56.359 17:40:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:56.359 17:40:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:56.359 17:40:33 -- common/autotest_common.sh@10 -- # set +x 00:20:56.359 17:40:33 -- nvmf/common.sh@469 -- # nvmfpid=1614528 00:20:56.359 17:40:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:56.359 17:40:33 -- nvmf/common.sh@470 -- # waitforlisten 1614528 00:20:56.359 17:40:33 -- common/autotest_common.sh@829 -- # '[' -z 1614528 ']' 00:20:56.359 17:40:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:56.359 17:40:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:56.359 17:40:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:56.359 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:56.359 17:40:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:56.359 17:40:33 -- common/autotest_common.sh@10 -- # set +x 00:20:56.359 [2024-11-16 17:40:33.761187] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:56.359 [2024-11-16 17:40:33.761282] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:56.359 EAL: No free 2048 kB hugepages reported on node 1 00:20:56.359 [2024-11-16 17:40:33.829506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:56.617 [2024-11-16 17:40:33.915096] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:56.617 [2024-11-16 17:40:33.915277] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:56.617 [2024-11-16 17:40:33.915298] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:56.617 [2024-11-16 17:40:33.915315] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:56.617 [2024-11-16 17:40:33.915359] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:57.550 17:40:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:57.550 17:40:34 -- common/autotest_common.sh@862 -- # return 0 00:20:57.550 17:40:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:57.550 17:40:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:57.550 17:40:34 -- common/autotest_common.sh@10 -- # set +x 00:20:57.550 17:40:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:57.550 17:40:34 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.550 17:40:34 -- common/autotest_common.sh@650 -- # local es=0 00:20:57.550 17:40:34 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.550 17:40:34 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:57.550 17:40:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:57.550 17:40:34 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:57.550 17:40:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:57.550 17:40:34 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.550 17:40:34 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.550 17:40:34 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:57.550 [2024-11-16 17:40:34.963517] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:57.550 17:40:34 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:57.808 17:40:35 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:58.066 [2024-11-16 17:40:35.468907] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:58.066 [2024-11-16 17:40:35.469205] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:58.066 17:40:35 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:58.323 malloc0 00:20:58.323 17:40:35 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:58.581 17:40:35 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.839 [2024-11-16 17:40:36.223026] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:58.839 [2024-11-16 17:40:36.223084] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:58.839 [2024-11-16 17:40:36.223119] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:58.839 request: 00:20:58.839 { 00:20:58.839 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:58.839 "host": "nqn.2016-06.io.spdk:host1", 00:20:58.839 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:58.839 "method": "nvmf_subsystem_add_host", 00:20:58.839 "req_id": 1 00:20:58.839 } 00:20:58.839 Got JSON-RPC error response 00:20:58.839 response: 00:20:58.839 { 00:20:58.839 "code": -32603, 00:20:58.839 "message": "Internal error" 00:20:58.839 } 00:20:58.839 17:40:36 -- common/autotest_common.sh@653 -- # es=1 00:20:58.839 17:40:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:58.839 17:40:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:58.839 17:40:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:58.839 17:40:36 -- target/tls.sh@189 -- # killprocess 1614528 00:20:58.839 17:40:36 -- common/autotest_common.sh@936 -- # '[' -z 1614528 ']' 00:20:58.839 17:40:36 -- common/autotest_common.sh@940 -- # kill -0 1614528 00:20:58.839 17:40:36 -- common/autotest_common.sh@941 -- # uname 00:20:58.839 17:40:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:58.839 17:40:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1614528 00:20:58.839 17:40:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:58.839 17:40:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:58.839 17:40:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1614528' 00:20:58.839 killing process with pid 1614528 00:20:58.839 17:40:36 -- common/autotest_common.sh@955 -- # kill 1614528 00:20:58.839 17:40:36 -- common/autotest_common.sh@960 -- # wait 1614528 00:20:59.097 17:40:36 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:59.097 17:40:36 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:59.097 17:40:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:59.097 17:40:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:59.097 17:40:36 -- common/autotest_common.sh@10 -- # set +x 00:20:59.097 17:40:36 -- nvmf/common.sh@469 -- # nvmfpid=1614958 00:20:59.097 17:40:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:59.097 17:40:36 -- nvmf/common.sh@470 -- # waitforlisten 1614958 00:20:59.097 17:40:36 -- common/autotest_common.sh@829 -- # '[' -z 1614958 ']' 00:20:59.097 17:40:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:59.097 17:40:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:59.097 17:40:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:59.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:59.097 17:40:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:59.097 17:40:36 -- common/autotest_common.sh@10 -- # set +x 00:20:59.356 [2024-11-16 17:40:36.593573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:59.356 [2024-11-16 17:40:36.593667] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:59.356 EAL: No free 2048 kB hugepages reported on node 1 00:20:59.356 [2024-11-16 17:40:36.666491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:59.356 [2024-11-16 17:40:36.754300] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:59.356 [2024-11-16 17:40:36.754457] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:59.356 [2024-11-16 17:40:36.754473] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:59.356 [2024-11-16 17:40:36.754485] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:59.356 [2024-11-16 17:40:36.754520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:00.290 17:40:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:00.290 17:40:37 -- common/autotest_common.sh@862 -- # return 0 00:21:00.290 17:40:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:00.290 17:40:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:00.290 17:40:37 -- common/autotest_common.sh@10 -- # set +x 00:21:00.290 17:40:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:00.290 17:40:37 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:00.290 17:40:37 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:00.290 17:40:37 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:21:00.548 [2024-11-16 17:40:37.892756] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:00.548 17:40:37 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:21:00.807 17:40:38 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:21:01.066 [2024-11-16 17:40:38.442270] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:01.066 [2024-11-16 17:40:38.442591] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:01.066 17:40:38 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:21:01.324 malloc0 00:21:01.324 17:40:38 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:21:01.587 17:40:39 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.919 17:40:39 -- target/tls.sh@197 -- # bdevperf_pid=1615267 00:21:01.919 17:40:39 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:01.919 17:40:39 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:01.919 17:40:39 -- target/tls.sh@200 -- # waitforlisten 1615267 /var/tmp/bdevperf.sock 00:21:01.919 17:40:39 -- common/autotest_common.sh@829 -- # '[' -z 1615267 ']' 00:21:01.919 17:40:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:01.919 17:40:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:01.919 17:40:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:01.919 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:01.919 17:40:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:01.919 17:40:39 -- common/autotest_common.sh@10 -- # set +x 00:21:01.919 [2024-11-16 17:40:39.387251] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:01.919 [2024-11-16 17:40:39.387340] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1615267 ] 00:21:02.206 EAL: No free 2048 kB hugepages reported on node 1 00:21:02.206 [2024-11-16 17:40:39.445849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:02.206 [2024-11-16 17:40:39.527236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:03.147 17:40:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:03.147 17:40:40 -- common/autotest_common.sh@862 -- # return 0 00:21:03.147 17:40:40 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:03.147 [2024-11-16 17:40:40.616866] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:03.406 TLSTESTn1 00:21:03.406 17:40:40 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:03.664 17:40:41 -- target/tls.sh@205 -- # tgtconf='{ 00:21:03.664 "subsystems": [ 00:21:03.664 { 00:21:03.664 "subsystem": "iobuf", 00:21:03.665 "config": [ 00:21:03.665 { 00:21:03.665 "method": "iobuf_set_options", 00:21:03.665 "params": { 00:21:03.665 "small_pool_count": 8192, 00:21:03.665 "large_pool_count": 1024, 00:21:03.665 "small_bufsize": 8192, 00:21:03.665 "large_bufsize": 135168 00:21:03.665 } 00:21:03.665 } 00:21:03.665 ] 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "subsystem": "sock", 00:21:03.665 "config": [ 00:21:03.665 { 00:21:03.665 "method": "sock_impl_set_options", 00:21:03.665 "params": { 00:21:03.665 "impl_name": "posix", 00:21:03.665 "recv_buf_size": 2097152, 00:21:03.665 "send_buf_size": 2097152, 00:21:03.665 "enable_recv_pipe": true, 00:21:03.665 "enable_quickack": false, 00:21:03.665 "enable_placement_id": 0, 00:21:03.665 "enable_zerocopy_send_server": true, 00:21:03.665 "enable_zerocopy_send_client": false, 00:21:03.665 "zerocopy_threshold": 0, 00:21:03.665 "tls_version": 0, 00:21:03.665 "enable_ktls": false 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "sock_impl_set_options", 00:21:03.665 "params": { 00:21:03.665 "impl_name": "ssl", 00:21:03.665 "recv_buf_size": 4096, 00:21:03.665 "send_buf_size": 4096, 00:21:03.665 "enable_recv_pipe": true, 00:21:03.665 "enable_quickack": false, 00:21:03.665 "enable_placement_id": 0, 00:21:03.665 "enable_zerocopy_send_server": true, 00:21:03.665 "enable_zerocopy_send_client": false, 00:21:03.665 "zerocopy_threshold": 0, 00:21:03.665 "tls_version": 0, 00:21:03.665 "enable_ktls": false 00:21:03.665 } 00:21:03.665 } 00:21:03.665 ] 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "subsystem": "vmd", 00:21:03.665 "config": [] 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "subsystem": "accel", 00:21:03.665 "config": [ 00:21:03.665 { 00:21:03.665 "method": "accel_set_options", 00:21:03.665 "params": { 00:21:03.665 "small_cache_size": 128, 00:21:03.665 "large_cache_size": 16, 00:21:03.665 "task_count": 2048, 00:21:03.665 "sequence_count": 2048, 00:21:03.665 "buf_count": 2048 00:21:03.665 } 00:21:03.665 } 00:21:03.665 ] 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "subsystem": "bdev", 00:21:03.665 "config": [ 00:21:03.665 { 00:21:03.665 "method": "bdev_set_options", 00:21:03.665 "params": { 00:21:03.665 "bdev_io_pool_size": 65535, 00:21:03.665 "bdev_io_cache_size": 256, 00:21:03.665 "bdev_auto_examine": true, 00:21:03.665 "iobuf_small_cache_size": 128, 00:21:03.665 "iobuf_large_cache_size": 16 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "bdev_raid_set_options", 00:21:03.665 "params": { 00:21:03.665 "process_window_size_kb": 1024 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "bdev_iscsi_set_options", 00:21:03.665 "params": { 00:21:03.665 "timeout_sec": 30 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "bdev_nvme_set_options", 00:21:03.665 "params": { 00:21:03.665 "action_on_timeout": "none", 00:21:03.665 "timeout_us": 0, 00:21:03.665 "timeout_admin_us": 0, 00:21:03.665 "keep_alive_timeout_ms": 10000, 00:21:03.665 "transport_retry_count": 4, 00:21:03.665 "arbitration_burst": 0, 00:21:03.665 "low_priority_weight": 0, 00:21:03.665 "medium_priority_weight": 0, 00:21:03.665 "high_priority_weight": 0, 00:21:03.665 "nvme_adminq_poll_period_us": 10000, 00:21:03.665 "nvme_ioq_poll_period_us": 0, 00:21:03.665 "io_queue_requests": 0, 00:21:03.665 "delay_cmd_submit": true, 00:21:03.665 "bdev_retry_count": 3, 00:21:03.665 "transport_ack_timeout": 0, 00:21:03.665 "ctrlr_loss_timeout_sec": 0, 00:21:03.665 "reconnect_delay_sec": 0, 00:21:03.665 "fast_io_fail_timeout_sec": 0, 00:21:03.665 "generate_uuids": false, 00:21:03.665 "transport_tos": 0, 00:21:03.665 "io_path_stat": false, 00:21:03.665 "allow_accel_sequence": false 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "bdev_nvme_set_hotplug", 00:21:03.665 "params": { 00:21:03.665 "period_us": 100000, 00:21:03.665 "enable": false 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "bdev_malloc_create", 00:21:03.665 "params": { 00:21:03.665 "name": "malloc0", 00:21:03.665 "num_blocks": 8192, 00:21:03.665 "block_size": 4096, 00:21:03.665 "physical_block_size": 4096, 00:21:03.665 "uuid": "815713cc-2fb6-42a8-9ea5-844fb339d17e", 00:21:03.665 "optimal_io_boundary": 0 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "bdev_wait_for_examine" 00:21:03.665 } 00:21:03.665 ] 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "subsystem": "nbd", 00:21:03.665 "config": [] 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "subsystem": "scheduler", 00:21:03.665 "config": [ 00:21:03.665 { 00:21:03.665 "method": "framework_set_scheduler", 00:21:03.665 "params": { 00:21:03.665 "name": "static" 00:21:03.665 } 00:21:03.665 } 00:21:03.665 ] 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "subsystem": "nvmf", 00:21:03.665 "config": [ 00:21:03.665 { 00:21:03.665 "method": "nvmf_set_config", 00:21:03.665 "params": { 00:21:03.665 "discovery_filter": "match_any", 00:21:03.665 "admin_cmd_passthru": { 00:21:03.665 "identify_ctrlr": false 00:21:03.665 } 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "nvmf_set_max_subsystems", 00:21:03.665 "params": { 00:21:03.665 "max_subsystems": 1024 00:21:03.665 } 00:21:03.665 }, 00:21:03.665 { 00:21:03.665 "method": "nvmf_set_crdt", 00:21:03.665 "params": { 00:21:03.665 "crdt1": 0, 00:21:03.665 "crdt2": 0, 00:21:03.665 "crdt3": 0 00:21:03.665 } 00:21:03.666 }, 00:21:03.666 { 00:21:03.666 "method": "nvmf_create_transport", 00:21:03.666 "params": { 00:21:03.666 "trtype": "TCP", 00:21:03.666 "max_queue_depth": 128, 00:21:03.666 "max_io_qpairs_per_ctrlr": 127, 00:21:03.666 "in_capsule_data_size": 4096, 00:21:03.666 "max_io_size": 131072, 00:21:03.666 "io_unit_size": 131072, 00:21:03.666 "max_aq_depth": 128, 00:21:03.666 "num_shared_buffers": 511, 00:21:03.666 "buf_cache_size": 4294967295, 00:21:03.666 "dif_insert_or_strip": false, 00:21:03.666 "zcopy": false, 00:21:03.666 "c2h_success": false, 00:21:03.666 "sock_priority": 0, 00:21:03.666 "abort_timeout_sec": 1 00:21:03.666 } 00:21:03.666 }, 00:21:03.666 { 00:21:03.666 "method": "nvmf_create_subsystem", 00:21:03.666 "params": { 00:21:03.666 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.666 "allow_any_host": false, 00:21:03.666 "serial_number": "SPDK00000000000001", 00:21:03.666 "model_number": "SPDK bdev Controller", 00:21:03.666 "max_namespaces": 10, 00:21:03.666 "min_cntlid": 1, 00:21:03.666 "max_cntlid": 65519, 00:21:03.666 "ana_reporting": false 00:21:03.666 } 00:21:03.666 }, 00:21:03.666 { 00:21:03.666 "method": "nvmf_subsystem_add_host", 00:21:03.666 "params": { 00:21:03.666 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.666 "host": "nqn.2016-06.io.spdk:host1", 00:21:03.666 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:03.666 } 00:21:03.666 }, 00:21:03.666 { 00:21:03.666 "method": "nvmf_subsystem_add_ns", 00:21:03.666 "params": { 00:21:03.666 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.666 "namespace": { 00:21:03.666 "nsid": 1, 00:21:03.666 "bdev_name": "malloc0", 00:21:03.666 "nguid": "815713CC2FB642A89EA5844FB339D17E", 00:21:03.666 "uuid": "815713cc-2fb6-42a8-9ea5-844fb339d17e" 00:21:03.666 } 00:21:03.666 } 00:21:03.666 }, 00:21:03.666 { 00:21:03.666 "method": "nvmf_subsystem_add_listener", 00:21:03.666 "params": { 00:21:03.666 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.666 "listen_address": { 00:21:03.666 "trtype": "TCP", 00:21:03.666 "adrfam": "IPv4", 00:21:03.666 "traddr": "10.0.0.2", 00:21:03.666 "trsvcid": "4420" 00:21:03.666 }, 00:21:03.666 "secure_channel": true 00:21:03.666 } 00:21:03.666 } 00:21:03.666 ] 00:21:03.666 } 00:21:03.666 ] 00:21:03.666 }' 00:21:03.666 17:40:41 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:04.232 17:40:41 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:04.232 "subsystems": [ 00:21:04.232 { 00:21:04.232 "subsystem": "iobuf", 00:21:04.232 "config": [ 00:21:04.232 { 00:21:04.232 "method": "iobuf_set_options", 00:21:04.232 "params": { 00:21:04.232 "small_pool_count": 8192, 00:21:04.232 "large_pool_count": 1024, 00:21:04.232 "small_bufsize": 8192, 00:21:04.232 "large_bufsize": 135168 00:21:04.232 } 00:21:04.232 } 00:21:04.232 ] 00:21:04.232 }, 00:21:04.232 { 00:21:04.232 "subsystem": "sock", 00:21:04.232 "config": [ 00:21:04.232 { 00:21:04.232 "method": "sock_impl_set_options", 00:21:04.232 "params": { 00:21:04.232 "impl_name": "posix", 00:21:04.232 "recv_buf_size": 2097152, 00:21:04.232 "send_buf_size": 2097152, 00:21:04.232 "enable_recv_pipe": true, 00:21:04.232 "enable_quickack": false, 00:21:04.232 "enable_placement_id": 0, 00:21:04.232 "enable_zerocopy_send_server": true, 00:21:04.232 "enable_zerocopy_send_client": false, 00:21:04.232 "zerocopy_threshold": 0, 00:21:04.232 "tls_version": 0, 00:21:04.232 "enable_ktls": false 00:21:04.232 } 00:21:04.232 }, 00:21:04.232 { 00:21:04.232 "method": "sock_impl_set_options", 00:21:04.232 "params": { 00:21:04.232 "impl_name": "ssl", 00:21:04.232 "recv_buf_size": 4096, 00:21:04.232 "send_buf_size": 4096, 00:21:04.232 "enable_recv_pipe": true, 00:21:04.232 "enable_quickack": false, 00:21:04.232 "enable_placement_id": 0, 00:21:04.232 "enable_zerocopy_send_server": true, 00:21:04.232 "enable_zerocopy_send_client": false, 00:21:04.232 "zerocopy_threshold": 0, 00:21:04.232 "tls_version": 0, 00:21:04.232 "enable_ktls": false 00:21:04.232 } 00:21:04.232 } 00:21:04.232 ] 00:21:04.232 }, 00:21:04.232 { 00:21:04.232 "subsystem": "vmd", 00:21:04.232 "config": [] 00:21:04.232 }, 00:21:04.232 { 00:21:04.232 "subsystem": "accel", 00:21:04.232 "config": [ 00:21:04.232 { 00:21:04.232 "method": "accel_set_options", 00:21:04.232 "params": { 00:21:04.232 "small_cache_size": 128, 00:21:04.232 "large_cache_size": 16, 00:21:04.232 "task_count": 2048, 00:21:04.232 "sequence_count": 2048, 00:21:04.232 "buf_count": 2048 00:21:04.232 } 00:21:04.232 } 00:21:04.232 ] 00:21:04.232 }, 00:21:04.232 { 00:21:04.232 "subsystem": "bdev", 00:21:04.232 "config": [ 00:21:04.232 { 00:21:04.232 "method": "bdev_set_options", 00:21:04.232 "params": { 00:21:04.232 "bdev_io_pool_size": 65535, 00:21:04.232 "bdev_io_cache_size": 256, 00:21:04.232 "bdev_auto_examine": true, 00:21:04.232 "iobuf_small_cache_size": 128, 00:21:04.232 "iobuf_large_cache_size": 16 00:21:04.232 } 00:21:04.232 }, 00:21:04.232 { 00:21:04.232 "method": "bdev_raid_set_options", 00:21:04.232 "params": { 00:21:04.232 "process_window_size_kb": 1024 00:21:04.232 } 00:21:04.232 }, 00:21:04.232 { 00:21:04.232 "method": "bdev_iscsi_set_options", 00:21:04.232 "params": { 00:21:04.232 "timeout_sec": 30 00:21:04.232 } 00:21:04.232 }, 00:21:04.232 { 00:21:04.232 "method": "bdev_nvme_set_options", 00:21:04.232 "params": { 00:21:04.232 "action_on_timeout": "none", 00:21:04.232 "timeout_us": 0, 00:21:04.233 "timeout_admin_us": 0, 00:21:04.233 "keep_alive_timeout_ms": 10000, 00:21:04.233 "transport_retry_count": 4, 00:21:04.233 "arbitration_burst": 0, 00:21:04.233 "low_priority_weight": 0, 00:21:04.233 "medium_priority_weight": 0, 00:21:04.233 "high_priority_weight": 0, 00:21:04.233 "nvme_adminq_poll_period_us": 10000, 00:21:04.233 "nvme_ioq_poll_period_us": 0, 00:21:04.233 "io_queue_requests": 512, 00:21:04.233 "delay_cmd_submit": true, 00:21:04.233 "bdev_retry_count": 3, 00:21:04.233 "transport_ack_timeout": 0, 00:21:04.233 "ctrlr_loss_timeout_sec": 0, 00:21:04.233 "reconnect_delay_sec": 0, 00:21:04.233 "fast_io_fail_timeout_sec": 0, 00:21:04.233 "generate_uuids": false, 00:21:04.233 "transport_tos": 0, 00:21:04.233 "io_path_stat": false, 00:21:04.233 "allow_accel_sequence": false 00:21:04.233 } 00:21:04.233 }, 00:21:04.233 { 00:21:04.233 "method": "bdev_nvme_attach_controller", 00:21:04.233 "params": { 00:21:04.233 "name": "TLSTEST", 00:21:04.233 "trtype": "TCP", 00:21:04.233 "adrfam": "IPv4", 00:21:04.233 "traddr": "10.0.0.2", 00:21:04.233 "trsvcid": "4420", 00:21:04.233 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.233 "prchk_reftag": false, 00:21:04.233 "prchk_guard": false, 00:21:04.233 "ctrlr_loss_timeout_sec": 0, 00:21:04.233 "reconnect_delay_sec": 0, 00:21:04.233 "fast_io_fail_timeout_sec": 0, 00:21:04.233 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:04.233 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:04.233 "hdgst": false, 00:21:04.233 "ddgst": false 00:21:04.233 } 00:21:04.233 }, 00:21:04.233 { 00:21:04.233 "method": "bdev_nvme_set_hotplug", 00:21:04.233 "params": { 00:21:04.233 "period_us": 100000, 00:21:04.233 "enable": false 00:21:04.233 } 00:21:04.233 }, 00:21:04.233 { 00:21:04.233 "method": "bdev_wait_for_examine" 00:21:04.233 } 00:21:04.233 ] 00:21:04.233 }, 00:21:04.233 { 00:21:04.233 "subsystem": "nbd", 00:21:04.233 "config": [] 00:21:04.233 } 00:21:04.233 ] 00:21:04.233 }' 00:21:04.233 17:40:41 -- target/tls.sh@208 -- # killprocess 1615267 00:21:04.233 17:40:41 -- common/autotest_common.sh@936 -- # '[' -z 1615267 ']' 00:21:04.233 17:40:41 -- common/autotest_common.sh@940 -- # kill -0 1615267 00:21:04.233 17:40:41 -- common/autotest_common.sh@941 -- # uname 00:21:04.233 17:40:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:04.233 17:40:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1615267 00:21:04.233 17:40:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:04.233 17:40:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:04.233 17:40:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1615267' 00:21:04.233 killing process with pid 1615267 00:21:04.233 17:40:41 -- common/autotest_common.sh@955 -- # kill 1615267 00:21:04.233 Received shutdown signal, test time was about 10.000000 seconds 00:21:04.233 00:21:04.233 Latency(us) 00:21:04.233 [2024-11-16T16:40:41.725Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:04.233 [2024-11-16T16:40:41.725Z] =================================================================================================================== 00:21:04.233 [2024-11-16T16:40:41.725Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:04.233 17:40:41 -- common/autotest_common.sh@960 -- # wait 1615267 00:21:04.233 17:40:41 -- target/tls.sh@209 -- # killprocess 1614958 00:21:04.233 17:40:41 -- common/autotest_common.sh@936 -- # '[' -z 1614958 ']' 00:21:04.233 17:40:41 -- common/autotest_common.sh@940 -- # kill -0 1614958 00:21:04.233 17:40:41 -- common/autotest_common.sh@941 -- # uname 00:21:04.233 17:40:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:04.233 17:40:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1614958 00:21:04.491 17:40:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:04.491 17:40:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:04.491 17:40:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1614958' 00:21:04.491 killing process with pid 1614958 00:21:04.491 17:40:41 -- common/autotest_common.sh@955 -- # kill 1614958 00:21:04.491 17:40:41 -- common/autotest_common.sh@960 -- # wait 1614958 00:21:04.775 17:40:41 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:04.775 17:40:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:04.775 17:40:41 -- target/tls.sh@212 -- # echo '{ 00:21:04.775 "subsystems": [ 00:21:04.775 { 00:21:04.775 "subsystem": "iobuf", 00:21:04.775 "config": [ 00:21:04.775 { 00:21:04.775 "method": "iobuf_set_options", 00:21:04.775 "params": { 00:21:04.775 "small_pool_count": 8192, 00:21:04.775 "large_pool_count": 1024, 00:21:04.775 "small_bufsize": 8192, 00:21:04.775 "large_bufsize": 135168 00:21:04.775 } 00:21:04.775 } 00:21:04.775 ] 00:21:04.775 }, 00:21:04.775 { 00:21:04.775 "subsystem": "sock", 00:21:04.775 "config": [ 00:21:04.775 { 00:21:04.775 "method": "sock_impl_set_options", 00:21:04.775 "params": { 00:21:04.775 "impl_name": "posix", 00:21:04.775 "recv_buf_size": 2097152, 00:21:04.775 "send_buf_size": 2097152, 00:21:04.775 "enable_recv_pipe": true, 00:21:04.775 "enable_quickack": false, 00:21:04.775 "enable_placement_id": 0, 00:21:04.775 "enable_zerocopy_send_server": true, 00:21:04.775 "enable_zerocopy_send_client": false, 00:21:04.775 "zerocopy_threshold": 0, 00:21:04.775 "tls_version": 0, 00:21:04.775 "enable_ktls": false 00:21:04.775 } 00:21:04.775 }, 00:21:04.775 { 00:21:04.775 "method": "sock_impl_set_options", 00:21:04.775 "params": { 00:21:04.775 "impl_name": "ssl", 00:21:04.775 "recv_buf_size": 4096, 00:21:04.775 "send_buf_size": 4096, 00:21:04.775 "enable_recv_pipe": true, 00:21:04.775 "enable_quickack": false, 00:21:04.775 "enable_placement_id": 0, 00:21:04.775 "enable_zerocopy_send_server": true, 00:21:04.775 "enable_zerocopy_send_client": false, 00:21:04.775 "zerocopy_threshold": 0, 00:21:04.775 "tls_version": 0, 00:21:04.775 "enable_ktls": false 00:21:04.775 } 00:21:04.775 } 00:21:04.775 ] 00:21:04.775 }, 00:21:04.775 { 00:21:04.775 "subsystem": "vmd", 00:21:04.775 "config": [] 00:21:04.775 }, 00:21:04.775 { 00:21:04.775 "subsystem": "accel", 00:21:04.775 "config": [ 00:21:04.775 { 00:21:04.775 "method": "accel_set_options", 00:21:04.775 "params": { 00:21:04.775 "small_cache_size": 128, 00:21:04.775 "large_cache_size": 16, 00:21:04.775 "task_count": 2048, 00:21:04.775 "sequence_count": 2048, 00:21:04.775 "buf_count": 2048 00:21:04.775 } 00:21:04.775 } 00:21:04.775 ] 00:21:04.775 }, 00:21:04.775 { 00:21:04.775 "subsystem": "bdev", 00:21:04.775 "config": [ 00:21:04.775 { 00:21:04.775 "method": "bdev_set_options", 00:21:04.775 "params": { 00:21:04.775 "bdev_io_pool_size": 65535, 00:21:04.776 "bdev_io_cache_size": 256, 00:21:04.776 "bdev_auto_examine": true, 00:21:04.776 "iobuf_small_cache_size": 128, 00:21:04.776 "iobuf_large_cache_size": 16 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "bdev_raid_set_options", 00:21:04.776 "params": { 00:21:04.776 "process_window_size_kb": 1024 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "bdev_iscsi_set_options", 00:21:04.776 "params": { 00:21:04.776 "timeout_sec": 30 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "bdev_nvme_set_options", 00:21:04.776 "params": { 00:21:04.776 "action_on_timeout": "none", 00:21:04.776 "timeout_us": 0, 00:21:04.776 "timeout_admin_us": 0, 00:21:04.776 "keep_alive_timeout_ms": 10000, 00:21:04.776 "transport_retry_count": 4, 00:21:04.776 "arbitration_burst": 0, 00:21:04.776 "low_priority_weight": 0, 00:21:04.776 "medium_priority_weight": 0, 00:21:04.776 "high_priority_weight": 0, 00:21:04.776 "nvme_adminq_poll_period_us": 10000, 00:21:04.776 "nvme_ioq_poll_period_us": 0, 00:21:04.776 "io_queue_requests": 0, 00:21:04.776 "delay_cmd_submit": true, 00:21:04.776 "bdev_retry_count": 3, 00:21:04.776 "transport_ack_timeout": 0, 00:21:04.776 "ctrlr_loss_timeout_sec": 0, 00:21:04.776 "reconnect_delay_sec": 0, 00:21:04.776 "fast_io_fail_timeout_sec": 0, 00:21:04.776 "generate_uuids": false, 00:21:04.776 "transport_tos": 0, 00:21:04.776 "io_path_stat": false, 00:21:04.776 "allow_accel_sequence": false 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "bdev_nvme_set_hotplug", 00:21:04.776 "params": { 00:21:04.776 "period_us": 100000, 00:21:04.776 "enable": false 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "bdev_malloc_create", 00:21:04.776 "params": { 00:21:04.776 "name": "malloc0", 00:21:04.776 "num_blocks": 8192, 00:21:04.776 "block_size": 4096, 00:21:04.776 "physical_block_size": 4096, 00:21:04.776 "uuid": "815713cc-2fb6-42a8-9ea5-844fb339d17e", 00:21:04.776 "optimal_io_boundary": 0 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "bdev_wait_for_examine" 00:21:04.776 } 00:21:04.776 ] 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "subsystem": "nbd", 00:21:04.776 "config": [] 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "subsystem": "sch 17:40:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:04.776 eduler", 00:21:04.776 "config": [ 00:21:04.776 { 00:21:04.776 "method": "framework_set_scheduler", 00:21:04.776 "params": { 00:21:04.776 "name": "static" 00:21:04.776 } 00:21:04.776 } 00:21:04.776 ] 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "subsystem": "nvmf", 00:21:04.776 "config": [ 00:21:04.776 { 00:21:04.776 "method": "nvmf_set_config", 00:21:04.776 "params": { 00:21:04.776 "discovery_filter": "match_any", 00:21:04.776 "admin_cmd_passthru": { 00:21:04.776 "identify_ctrlr": false 00:21:04.776 } 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "nvmf_set_max_subsystems", 00:21:04.776 "params": { 00:21:04.776 "max_subsystems": 1024 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "nvmf_set_crdt", 00:21:04.776 "params": { 00:21:04.776 "crdt1": 0, 00:21:04.776 "crdt2": 0, 00:21:04.776 "crdt3": 0 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "nvmf_create_transport", 00:21:04.776 "params": { 00:21:04.776 "trtype": "TCP", 00:21:04.776 "max_queue_depth": 128, 00:21:04.776 "max_io_qpairs_per_ctrlr": 127, 00:21:04.776 "in_capsule_data_size": 4096, 00:21:04.776 "max_io_size": 131072, 00:21:04.776 "io_unit_size": 131072, 00:21:04.776 "max_aq_depth": 128, 00:21:04.776 "num_shared_buffers": 511, 00:21:04.776 "buf_cache_size": 4294967295, 00:21:04.776 "dif_insert_or_strip": false, 00:21:04.776 "zcopy": false, 00:21:04.776 "c2h_success": false, 00:21:04.776 "sock_priority": 0, 00:21:04.776 "abort_timeout_sec": 1 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "nvmf_create_subsystem", 00:21:04.776 "params": { 00:21:04.776 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.776 "allow_any_host": false, 00:21:04.776 "serial_number": "SPDK00000000000001", 00:21:04.776 "model_number": "SPDK bdev Controller", 00:21:04.776 "max_namespaces": 10, 00:21:04.776 "min_cntlid": 1, 00:21:04.776 "max_cntlid": 65519, 00:21:04.776 "ana_reporting": false 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "nvmf_subsystem_add_host", 00:21:04.776 "params": { 00:21:04.776 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.776 "host": "nqn.2016-06.io.spdk:host1", 00:21:04.776 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "nvmf_subsystem_add_ns", 00:21:04.776 "params": { 00:21:04.776 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.776 "namespace": { 00:21:04.776 "nsid": 1, 00:21:04.776 "bdev_name": "malloc0", 00:21:04.776 "nguid": "815713CC2FB642A89EA5844FB339D17E", 00:21:04.776 "uuid": "815713cc-2fb6-42a8-9ea5-844fb339d17e" 00:21:04.776 } 00:21:04.776 } 00:21:04.776 }, 00:21:04.776 { 00:21:04.776 "method": "nvmf_subsystem_add_listener", 00:21:04.776 "params": { 00:21:04.776 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:04.776 "listen_address": { 00:21:04.776 "trtype": "TCP", 00:21:04.776 "adrfam": "IPv4", 00:21:04.776 "traddr": "10.0.0.2", 00:21:04.776 "trsvcid": "4420" 00:21:04.776 }, 00:21:04.776 "secure_channel": true 00:21:04.777 } 00:21:04.777 } 00:21:04.777 ] 00:21:04.777 } 00:21:04.777 ] 00:21:04.777 }' 00:21:04.777 17:40:41 -- common/autotest_common.sh@10 -- # set +x 00:21:04.777 17:40:41 -- nvmf/common.sh@469 -- # nvmfpid=1615560 00:21:04.777 17:40:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:04.777 17:40:41 -- nvmf/common.sh@470 -- # waitforlisten 1615560 00:21:04.777 17:40:41 -- common/autotest_common.sh@829 -- # '[' -z 1615560 ']' 00:21:04.777 17:40:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:04.777 17:40:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:04.777 17:40:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:04.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:04.777 17:40:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:04.777 17:40:41 -- common/autotest_common.sh@10 -- # set +x 00:21:04.777 [2024-11-16 17:40:42.042116] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:04.777 [2024-11-16 17:40:42.042204] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:04.777 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.777 [2024-11-16 17:40:42.111648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:04.777 [2024-11-16 17:40:42.205289] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:04.777 [2024-11-16 17:40:42.205468] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:04.777 [2024-11-16 17:40:42.205488] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:04.777 [2024-11-16 17:40:42.205503] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:04.777 [2024-11-16 17:40:42.205532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:05.035 [2024-11-16 17:40:42.426572] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:05.035 [2024-11-16 17:40:42.458594] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:05.035 [2024-11-16 17:40:42.458886] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:05.601 17:40:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:05.601 17:40:42 -- common/autotest_common.sh@862 -- # return 0 00:21:05.601 17:40:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:05.601 17:40:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:05.601 17:40:42 -- common/autotest_common.sh@10 -- # set +x 00:21:05.601 17:40:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:05.601 17:40:43 -- target/tls.sh@216 -- # bdevperf_pid=1615718 00:21:05.601 17:40:43 -- target/tls.sh@217 -- # waitforlisten 1615718 /var/tmp/bdevperf.sock 00:21:05.601 17:40:43 -- common/autotest_common.sh@829 -- # '[' -z 1615718 ']' 00:21:05.601 17:40:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:05.601 17:40:43 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:05.601 17:40:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:05.601 17:40:43 -- target/tls.sh@213 -- # echo '{ 00:21:05.601 "subsystems": [ 00:21:05.601 { 00:21:05.601 "subsystem": "iobuf", 00:21:05.601 "config": [ 00:21:05.601 { 00:21:05.601 "method": "iobuf_set_options", 00:21:05.601 "params": { 00:21:05.601 "small_pool_count": 8192, 00:21:05.601 "large_pool_count": 1024, 00:21:05.601 "small_bufsize": 8192, 00:21:05.601 "large_bufsize": 135168 00:21:05.601 } 00:21:05.601 } 00:21:05.601 ] 00:21:05.601 }, 00:21:05.601 { 00:21:05.601 "subsystem": "sock", 00:21:05.601 "config": [ 00:21:05.601 { 00:21:05.601 "method": "sock_impl_set_options", 00:21:05.601 "params": { 00:21:05.601 "impl_name": "posix", 00:21:05.601 "recv_buf_size": 2097152, 00:21:05.601 "send_buf_size": 2097152, 00:21:05.601 "enable_recv_pipe": true, 00:21:05.601 "enable_quickack": false, 00:21:05.601 "enable_placement_id": 0, 00:21:05.601 "enable_zerocopy_send_server": true, 00:21:05.601 "enable_zerocopy_send_client": false, 00:21:05.601 "zerocopy_threshold": 0, 00:21:05.601 "tls_version": 0, 00:21:05.601 "enable_ktls": false 00:21:05.601 } 00:21:05.601 }, 00:21:05.601 { 00:21:05.601 "method": "sock_impl_set_options", 00:21:05.601 "params": { 00:21:05.601 "impl_name": "ssl", 00:21:05.601 "recv_buf_size": 4096, 00:21:05.601 "send_buf_size": 4096, 00:21:05.601 "enable_recv_pipe": true, 00:21:05.601 "enable_quickack": false, 00:21:05.601 "enable_placement_id": 0, 00:21:05.601 "enable_zerocopy_send_server": true, 00:21:05.601 "enable_zerocopy_send_client": false, 00:21:05.601 "zerocopy_threshold": 0, 00:21:05.601 "tls_version": 0, 00:21:05.601 "enable_ktls": false 00:21:05.601 } 00:21:05.601 } 00:21:05.601 ] 00:21:05.601 }, 00:21:05.601 { 00:21:05.601 "subsystem": "vmd", 00:21:05.601 "config": [] 00:21:05.601 }, 00:21:05.601 { 00:21:05.601 "subsystem": "accel", 00:21:05.601 "config": [ 00:21:05.601 { 00:21:05.601 "method": "accel_set_options", 00:21:05.601 "params": { 00:21:05.601 "small_cache_size": 128, 00:21:05.601 "large_cache_size": 16, 00:21:05.601 "task_count": 2048, 00:21:05.601 "sequence_count": 2048, 00:21:05.601 "buf_count": 2048 00:21:05.601 } 00:21:05.601 } 00:21:05.601 ] 00:21:05.601 }, 00:21:05.601 { 00:21:05.601 "subsystem": "bdev", 00:21:05.601 "config": [ 00:21:05.601 { 00:21:05.601 "method": "bdev_set_options", 00:21:05.601 "params": { 00:21:05.601 "bdev_io_pool_size": 65535, 00:21:05.601 "bdev_io_cache_size": 256, 00:21:05.601 "bdev_auto_examine": true, 00:21:05.601 "iobuf_small_cache_size": 128, 00:21:05.601 "iobuf_large_cache_size": 16 00:21:05.601 } 00:21:05.601 }, 00:21:05.601 { 00:21:05.601 "method": "bdev_raid_set_options", 00:21:05.601 "params": { 00:21:05.601 "process_window_size_kb": 1024 00:21:05.601 } 00:21:05.601 }, 00:21:05.601 { 00:21:05.601 "method": "bdev_iscsi_set_options", 00:21:05.601 "params": { 00:21:05.601 "timeout_sec": 30 00:21:05.601 } 00:21:05.601 }, 00:21:05.601 { 00:21:05.601 "method": "bdev_nvme_set_options", 00:21:05.601 "params": { 00:21:05.601 "action_on_timeout": "none", 00:21:05.601 "timeout_us": 0, 00:21:05.601 "timeout_admin_us": 0, 00:21:05.601 "keep_alive_timeout_ms": 10000, 00:21:05.601 "transport_retry_count": 4, 00:21:05.601 "arbitration_burst": 0, 00:21:05.601 "low_priority_weight": 0, 00:21:05.601 "medium_priority_weight": 0, 00:21:05.602 "high_priority_weight": 0, 00:21:05.602 "nvme_adminq_poll_period_us": 10000, 00:21:05.602 "nvme_ioq_poll_period_us": 0, 00:21:05.602 "io_queue_requests": 512, 00:21:05.602 "delay_cmd_submit": true, 00:21:05.602 "bdev_retry_count": 3, 00:21:05.602 "transport_ack_timeout": 0, 00:21:05.602 "ctrlr_loss_timeout_sec": 0, 00:21:05.602 "reconnect_delay_sec": 0, 00:21:05.602 "fast_io_fail_timeout_sec": 0, 00:21:05.602 "generate_uuids": false, 00:21:05.602 "transport_tos": 0, 00:21:05.602 "io_path_stat": false, 00:21:05.602 "allow_accel_sequence": false 00:21:05.602 } 00:21:05.602 }, 00:21:05.602 { 00:21:05.602 "method": "bdev_nvme_attach_controller", 00:21:05.602 "params": { 00:21:05.602 "name": "TLSTEST", 00:21:05.602 "trtype": "TCP", 00:21:05.602 "adrfam": "IPv4", 00:21:05.602 "traddr": "10.0.0.2", 00:21:05.602 "trsvcid": "4420", 00:21:05.602 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:05.602 "prchk_reftag": false, 00:21:05.602 "prchk_guard": false, 00:21:05.602 "ctrlr_loss_timeout_sec": 0, 00:21:05.602 "reconnect_delay_sec": 0, 00:21:05.602 "fast_io_fail_timeout_sec": 0, 00:21:05.602 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:05.602 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:05.602 "hdgst": 17:40:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:05.602 false, 00:21:05.602 "ddgst": false 00:21:05.602 } 00:21:05.602 }, 00:21:05.602 { 00:21:05.602 "method": "bdev_nvme_set_hotplug", 00:21:05.602 "params": { 00:21:05.602 "period_us": 100000, 00:21:05.602 "enable": false 00:21:05.602 } 00:21:05.602 }, 00:21:05.602 { 00:21:05.602 "method": "bdev_wait_for_examine" 00:21:05.602 } 00:21:05.602 ] 00:21:05.602 }, 00:21:05.602 { 00:21:05.602 "subsystem": "nbd", 00:21:05.602 "config": [] 00:21:05.602 } 00:21:05.602 ] 00:21:05.602 }' 00:21:05.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:05.602 17:40:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:05.602 17:40:43 -- common/autotest_common.sh@10 -- # set +x 00:21:05.602 [2024-11-16 17:40:43.060279] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:05.602 [2024-11-16 17:40:43.060372] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1615718 ] 00:21:05.602 EAL: No free 2048 kB hugepages reported on node 1 00:21:05.860 [2024-11-16 17:40:43.124239] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:05.860 [2024-11-16 17:40:43.218342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:06.119 [2024-11-16 17:40:43.382604] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:06.684 17:40:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:06.684 17:40:44 -- common/autotest_common.sh@862 -- # return 0 00:21:06.684 17:40:44 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:06.684 Running I/O for 10 seconds... 00:21:18.881 00:21:18.881 Latency(us) 00:21:18.881 [2024-11-16T16:40:56.373Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:18.881 [2024-11-16T16:40:56.373Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:18.881 Verification LBA range: start 0x0 length 0x2000 00:21:18.881 TLSTESTn1 : 10.02 3796.56 14.83 0.00 0.00 33666.59 6310.87 41166.32 00:21:18.881 [2024-11-16T16:40:56.373Z] =================================================================================================================== 00:21:18.881 [2024-11-16T16:40:56.373Z] Total : 3796.56 14.83 0.00 0.00 33666.59 6310.87 41166.32 00:21:18.881 0 00:21:18.881 17:40:54 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:18.882 17:40:54 -- target/tls.sh@223 -- # killprocess 1615718 00:21:18.882 17:40:54 -- common/autotest_common.sh@936 -- # '[' -z 1615718 ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@940 -- # kill -0 1615718 00:21:18.882 17:40:54 -- common/autotest_common.sh@941 -- # uname 00:21:18.882 17:40:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1615718 00:21:18.882 17:40:54 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:18.882 17:40:54 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1615718' 00:21:18.882 killing process with pid 1615718 00:21:18.882 17:40:54 -- common/autotest_common.sh@955 -- # kill 1615718 00:21:18.882 Received shutdown signal, test time was about 10.000000 seconds 00:21:18.882 00:21:18.882 Latency(us) 00:21:18.882 [2024-11-16T16:40:56.374Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:18.882 [2024-11-16T16:40:56.374Z] =================================================================================================================== 00:21:18.882 [2024-11-16T16:40:56.374Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:18.882 17:40:54 -- common/autotest_common.sh@960 -- # wait 1615718 00:21:18.882 17:40:54 -- target/tls.sh@224 -- # killprocess 1615560 00:21:18.882 17:40:54 -- common/autotest_common.sh@936 -- # '[' -z 1615560 ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@940 -- # kill -0 1615560 00:21:18.882 17:40:54 -- common/autotest_common.sh@941 -- # uname 00:21:18.882 17:40:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1615560 00:21:18.882 17:40:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:18.882 17:40:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1615560' 00:21:18.882 killing process with pid 1615560 00:21:18.882 17:40:54 -- common/autotest_common.sh@955 -- # kill 1615560 00:21:18.882 17:40:54 -- common/autotest_common.sh@960 -- # wait 1615560 00:21:18.882 17:40:54 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:18.882 17:40:54 -- target/tls.sh@227 -- # cleanup 00:21:18.882 17:40:54 -- target/tls.sh@15 -- # process_shm --id 0 00:21:18.882 17:40:54 -- common/autotest_common.sh@806 -- # type=--id 00:21:18.882 17:40:54 -- common/autotest_common.sh@807 -- # id=0 00:21:18.882 17:40:54 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:18.882 17:40:54 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:18.882 17:40:54 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:18.882 17:40:54 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:18.882 17:40:54 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:18.882 nvmf_trace.0 00:21:18.882 17:40:54 -- common/autotest_common.sh@821 -- # return 0 00:21:18.882 17:40:54 -- target/tls.sh@16 -- # killprocess 1615718 00:21:18.882 17:40:54 -- common/autotest_common.sh@936 -- # '[' -z 1615718 ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@940 -- # kill -0 1615718 00:21:18.882 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1615718) - No such process 00:21:18.882 17:40:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1615718 is not found' 00:21:18.882 Process with pid 1615718 is not found 00:21:18.882 17:40:54 -- target/tls.sh@17 -- # nvmftestfini 00:21:18.882 17:40:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:18.882 17:40:54 -- nvmf/common.sh@116 -- # sync 00:21:18.882 17:40:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:18.882 17:40:54 -- nvmf/common.sh@119 -- # set +e 00:21:18.882 17:40:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:18.882 17:40:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:18.882 rmmod nvme_tcp 00:21:18.882 rmmod nvme_fabrics 00:21:18.882 rmmod nvme_keyring 00:21:18.882 17:40:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:18.882 17:40:54 -- nvmf/common.sh@123 -- # set -e 00:21:18.882 17:40:54 -- nvmf/common.sh@124 -- # return 0 00:21:18.882 17:40:54 -- nvmf/common.sh@477 -- # '[' -n 1615560 ']' 00:21:18.882 17:40:54 -- nvmf/common.sh@478 -- # killprocess 1615560 00:21:18.882 17:40:54 -- common/autotest_common.sh@936 -- # '[' -z 1615560 ']' 00:21:18.882 17:40:54 -- common/autotest_common.sh@940 -- # kill -0 1615560 00:21:18.882 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1615560) - No such process 00:21:18.882 17:40:54 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1615560 is not found' 00:21:18.882 Process with pid 1615560 is not found 00:21:18.882 17:40:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:18.882 17:40:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:18.882 17:40:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:18.882 17:40:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:18.882 17:40:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:18.882 17:40:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:18.882 17:40:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:18.882 17:40:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:19.450 17:40:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:19.450 17:40:56 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:19.450 00:21:19.450 real 1m15.598s 00:21:19.450 user 1m53.751s 00:21:19.450 sys 0m26.304s 00:21:19.450 17:40:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:19.450 17:40:56 -- common/autotest_common.sh@10 -- # set +x 00:21:19.450 ************************************ 00:21:19.450 END TEST nvmf_tls 00:21:19.450 ************************************ 00:21:19.450 17:40:56 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:19.450 17:40:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:19.450 17:40:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:19.450 17:40:56 -- common/autotest_common.sh@10 -- # set +x 00:21:19.451 ************************************ 00:21:19.451 START TEST nvmf_fips 00:21:19.451 ************************************ 00:21:19.451 17:40:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:19.709 * Looking for test storage... 00:21:19.709 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:19.709 17:40:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:19.709 17:40:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:19.709 17:40:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:19.709 17:40:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:19.709 17:40:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:19.709 17:40:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:19.709 17:40:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:19.709 17:40:57 -- scripts/common.sh@335 -- # IFS=.-: 00:21:19.709 17:40:57 -- scripts/common.sh@335 -- # read -ra ver1 00:21:19.709 17:40:57 -- scripts/common.sh@336 -- # IFS=.-: 00:21:19.709 17:40:57 -- scripts/common.sh@336 -- # read -ra ver2 00:21:19.709 17:40:57 -- scripts/common.sh@337 -- # local 'op=<' 00:21:19.709 17:40:57 -- scripts/common.sh@339 -- # ver1_l=2 00:21:19.709 17:40:57 -- scripts/common.sh@340 -- # ver2_l=1 00:21:19.709 17:40:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:19.709 17:40:57 -- scripts/common.sh@343 -- # case "$op" in 00:21:19.709 17:40:57 -- scripts/common.sh@344 -- # : 1 00:21:19.709 17:40:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:19.709 17:40:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:19.709 17:40:57 -- scripts/common.sh@364 -- # decimal 1 00:21:19.709 17:40:57 -- scripts/common.sh@352 -- # local d=1 00:21:19.709 17:40:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:19.709 17:40:57 -- scripts/common.sh@354 -- # echo 1 00:21:19.709 17:40:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:19.710 17:40:57 -- scripts/common.sh@365 -- # decimal 2 00:21:19.710 17:40:57 -- scripts/common.sh@352 -- # local d=2 00:21:19.710 17:40:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:19.710 17:40:57 -- scripts/common.sh@354 -- # echo 2 00:21:19.710 17:40:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:19.710 17:40:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:19.710 17:40:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:19.710 17:40:57 -- scripts/common.sh@367 -- # return 0 00:21:19.710 17:40:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:19.710 17:40:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:19.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:19.710 --rc genhtml_branch_coverage=1 00:21:19.710 --rc genhtml_function_coverage=1 00:21:19.710 --rc genhtml_legend=1 00:21:19.710 --rc geninfo_all_blocks=1 00:21:19.710 --rc geninfo_unexecuted_blocks=1 00:21:19.710 00:21:19.710 ' 00:21:19.710 17:40:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:19.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:19.710 --rc genhtml_branch_coverage=1 00:21:19.710 --rc genhtml_function_coverage=1 00:21:19.710 --rc genhtml_legend=1 00:21:19.710 --rc geninfo_all_blocks=1 00:21:19.710 --rc geninfo_unexecuted_blocks=1 00:21:19.710 00:21:19.710 ' 00:21:19.710 17:40:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:19.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:19.710 --rc genhtml_branch_coverage=1 00:21:19.710 --rc genhtml_function_coverage=1 00:21:19.710 --rc genhtml_legend=1 00:21:19.710 --rc geninfo_all_blocks=1 00:21:19.710 --rc geninfo_unexecuted_blocks=1 00:21:19.710 00:21:19.710 ' 00:21:19.710 17:40:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:19.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:19.710 --rc genhtml_branch_coverage=1 00:21:19.710 --rc genhtml_function_coverage=1 00:21:19.710 --rc genhtml_legend=1 00:21:19.710 --rc geninfo_all_blocks=1 00:21:19.710 --rc geninfo_unexecuted_blocks=1 00:21:19.710 00:21:19.710 ' 00:21:19.710 17:40:57 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:19.710 17:40:57 -- nvmf/common.sh@7 -- # uname -s 00:21:19.710 17:40:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:19.710 17:40:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:19.710 17:40:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:19.710 17:40:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:19.710 17:40:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:19.710 17:40:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:19.710 17:40:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:19.710 17:40:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:19.710 17:40:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:19.710 17:40:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:19.710 17:40:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:19.710 17:40:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:19.710 17:40:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:19.710 17:40:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:19.710 17:40:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:19.710 17:40:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:19.710 17:40:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:19.710 17:40:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:19.710 17:40:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:19.710 17:40:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:19.710 17:40:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:19.710 17:40:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:19.710 17:40:57 -- paths/export.sh@5 -- # export PATH 00:21:19.710 17:40:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:19.710 17:40:57 -- nvmf/common.sh@46 -- # : 0 00:21:19.710 17:40:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:19.710 17:40:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:19.710 17:40:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:19.710 17:40:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:19.710 17:40:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:19.710 17:40:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:19.710 17:40:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:19.710 17:40:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:19.710 17:40:57 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:19.710 17:40:57 -- fips/fips.sh@89 -- # check_openssl_version 00:21:19.710 17:40:57 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:19.710 17:40:57 -- fips/fips.sh@85 -- # openssl version 00:21:19.710 17:40:57 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:19.710 17:40:57 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:19.710 17:40:57 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:19.710 17:40:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:19.710 17:40:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:19.710 17:40:57 -- scripts/common.sh@335 -- # IFS=.-: 00:21:19.710 17:40:57 -- scripts/common.sh@335 -- # read -ra ver1 00:21:19.710 17:40:57 -- scripts/common.sh@336 -- # IFS=.-: 00:21:19.710 17:40:57 -- scripts/common.sh@336 -- # read -ra ver2 00:21:19.710 17:40:57 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:19.710 17:40:57 -- scripts/common.sh@339 -- # ver1_l=3 00:21:19.710 17:40:57 -- scripts/common.sh@340 -- # ver2_l=3 00:21:19.710 17:40:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:19.710 17:40:57 -- scripts/common.sh@343 -- # case "$op" in 00:21:19.710 17:40:57 -- scripts/common.sh@347 -- # : 1 00:21:19.710 17:40:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:19.710 17:40:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:19.710 17:40:57 -- scripts/common.sh@364 -- # decimal 3 00:21:19.710 17:40:57 -- scripts/common.sh@352 -- # local d=3 00:21:19.710 17:40:57 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:19.710 17:40:57 -- scripts/common.sh@354 -- # echo 3 00:21:19.710 17:40:57 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:19.710 17:40:57 -- scripts/common.sh@365 -- # decimal 3 00:21:19.710 17:40:57 -- scripts/common.sh@352 -- # local d=3 00:21:19.710 17:40:57 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:19.710 17:40:57 -- scripts/common.sh@354 -- # echo 3 00:21:19.710 17:40:57 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:19.710 17:40:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:19.710 17:40:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:19.710 17:40:57 -- scripts/common.sh@363 -- # (( v++ )) 00:21:19.710 17:40:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:19.710 17:40:57 -- scripts/common.sh@364 -- # decimal 1 00:21:19.710 17:40:57 -- scripts/common.sh@352 -- # local d=1 00:21:19.710 17:40:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:19.710 17:40:57 -- scripts/common.sh@354 -- # echo 1 00:21:19.710 17:40:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:19.710 17:40:57 -- scripts/common.sh@365 -- # decimal 0 00:21:19.710 17:40:57 -- scripts/common.sh@352 -- # local d=0 00:21:19.710 17:40:57 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:19.710 17:40:57 -- scripts/common.sh@354 -- # echo 0 00:21:19.710 17:40:57 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:19.710 17:40:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:19.710 17:40:57 -- scripts/common.sh@366 -- # return 0 00:21:19.710 17:40:57 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:19.710 17:40:57 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:19.710 17:40:57 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:19.710 17:40:57 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:19.710 17:40:57 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:19.710 17:40:57 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:19.710 17:40:57 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:19.710 17:40:57 -- fips/fips.sh@113 -- # build_openssl_config 00:21:19.710 17:40:57 -- fips/fips.sh@37 -- # cat 00:21:19.710 17:40:57 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:19.710 17:40:57 -- fips/fips.sh@58 -- # cat - 00:21:19.710 17:40:57 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:19.710 17:40:57 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:19.710 17:40:57 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:19.710 17:40:57 -- fips/fips.sh@116 -- # openssl list -providers 00:21:19.710 17:40:57 -- fips/fips.sh@116 -- # grep name 00:21:19.710 17:40:57 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:19.710 17:40:57 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:19.711 17:40:57 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:19.711 17:40:57 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:19.711 17:40:57 -- fips/fips.sh@127 -- # : 00:21:19.711 17:40:57 -- common/autotest_common.sh@650 -- # local es=0 00:21:19.711 17:40:57 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:19.711 17:40:57 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:19.711 17:40:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:19.711 17:40:57 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:19.711 17:40:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:19.711 17:40:57 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:19.711 17:40:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:19.711 17:40:57 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:19.711 17:40:57 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:19.711 17:40:57 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:19.711 Error setting digest 00:21:19.711 40B2813B207F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:19.711 40B2813B207F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:19.711 17:40:57 -- common/autotest_common.sh@653 -- # es=1 00:21:19.711 17:40:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:19.711 17:40:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:19.711 17:40:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:19.711 17:40:57 -- fips/fips.sh@130 -- # nvmftestinit 00:21:19.711 17:40:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:19.711 17:40:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:19.711 17:40:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:19.711 17:40:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:19.711 17:40:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:19.711 17:40:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:19.711 17:40:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:19.711 17:40:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:19.711 17:40:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:19.711 17:40:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:19.711 17:40:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:19.711 17:40:57 -- common/autotest_common.sh@10 -- # set +x 00:21:22.241 17:40:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:22.241 17:40:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:22.241 17:40:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:22.241 17:40:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:22.241 17:40:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:22.241 17:40:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:22.241 17:40:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:22.241 17:40:59 -- nvmf/common.sh@294 -- # net_devs=() 00:21:22.241 17:40:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:22.241 17:40:59 -- nvmf/common.sh@295 -- # e810=() 00:21:22.241 17:40:59 -- nvmf/common.sh@295 -- # local -ga e810 00:21:22.241 17:40:59 -- nvmf/common.sh@296 -- # x722=() 00:21:22.241 17:40:59 -- nvmf/common.sh@296 -- # local -ga x722 00:21:22.241 17:40:59 -- nvmf/common.sh@297 -- # mlx=() 00:21:22.241 17:40:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:22.241 17:40:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:22.241 17:40:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:22.241 17:40:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:22.241 17:40:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:22.241 17:40:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:22.241 17:40:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:22.241 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:22.241 17:40:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:22.241 17:40:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:22.241 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:22.241 17:40:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:22.241 17:40:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:22.241 17:40:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:22.241 17:40:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:22.241 17:40:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:22.241 17:40:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:22.242 17:40:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:22.242 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:22.242 17:40:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:22.242 17:40:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:22.242 17:40:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:22.242 17:40:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:22.242 17:40:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:22.242 17:40:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:22.242 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:22.242 17:40:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:22.242 17:40:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:22.242 17:40:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:22.242 17:40:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:22.242 17:40:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:22.242 17:40:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:22.242 17:40:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:22.242 17:40:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:22.242 17:40:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:22.242 17:40:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:22.242 17:40:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:22.242 17:40:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:22.242 17:40:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:22.242 17:40:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:22.242 17:40:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:22.242 17:40:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:22.242 17:40:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:22.242 17:40:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:22.242 17:40:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:22.242 17:40:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:22.242 17:40:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:22.242 17:40:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:22.242 17:40:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:22.242 17:40:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:22.242 17:40:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:22.242 17:40:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:22.242 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:22.242 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:21:22.242 00:21:22.242 --- 10.0.0.2 ping statistics --- 00:21:22.242 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:22.242 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:21:22.242 17:40:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:22.242 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:22.242 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:21:22.242 00:21:22.242 --- 10.0.0.1 ping statistics --- 00:21:22.242 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:22.242 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:21:22.242 17:40:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:22.242 17:40:59 -- nvmf/common.sh@410 -- # return 0 00:21:22.242 17:40:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:22.242 17:40:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:22.242 17:40:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:22.242 17:40:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:22.242 17:40:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:22.242 17:40:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:22.242 17:40:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:22.242 17:40:59 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:22.242 17:40:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:22.242 17:40:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:22.242 17:40:59 -- common/autotest_common.sh@10 -- # set +x 00:21:22.242 17:40:59 -- nvmf/common.sh@469 -- # nvmfpid=1619174 00:21:22.242 17:40:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:22.242 17:40:59 -- nvmf/common.sh@470 -- # waitforlisten 1619174 00:21:22.242 17:40:59 -- common/autotest_common.sh@829 -- # '[' -z 1619174 ']' 00:21:22.242 17:40:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:22.242 17:40:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:22.242 17:40:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:22.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:22.242 17:40:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:22.242 17:40:59 -- common/autotest_common.sh@10 -- # set +x 00:21:22.242 [2024-11-16 17:40:59.434642] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:22.242 [2024-11-16 17:40:59.434745] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:22.242 EAL: No free 2048 kB hugepages reported on node 1 00:21:22.242 [2024-11-16 17:40:59.504186] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:22.242 [2024-11-16 17:40:59.596183] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:22.242 [2024-11-16 17:40:59.596377] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:22.242 [2024-11-16 17:40:59.596398] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:22.242 [2024-11-16 17:40:59.596413] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:22.242 [2024-11-16 17:40:59.596446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:23.176 17:41:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:23.176 17:41:00 -- common/autotest_common.sh@862 -- # return 0 00:21:23.176 17:41:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:23.176 17:41:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:23.176 17:41:00 -- common/autotest_common.sh@10 -- # set +x 00:21:23.176 17:41:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:23.176 17:41:00 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:23.176 17:41:00 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:23.176 17:41:00 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:23.176 17:41:00 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:23.176 17:41:00 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:23.176 17:41:00 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:23.176 17:41:00 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:23.176 17:41:00 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:23.434 [2024-11-16 17:41:00.678284] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:23.434 [2024-11-16 17:41:00.694238] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:23.434 [2024-11-16 17:41:00.694505] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:23.434 malloc0 00:21:23.434 17:41:00 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:23.434 17:41:00 -- fips/fips.sh@147 -- # bdevperf_pid=1619341 00:21:23.434 17:41:00 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:23.434 17:41:00 -- fips/fips.sh@148 -- # waitforlisten 1619341 /var/tmp/bdevperf.sock 00:21:23.434 17:41:00 -- common/autotest_common.sh@829 -- # '[' -z 1619341 ']' 00:21:23.434 17:41:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:23.434 17:41:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:23.434 17:41:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:23.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:23.434 17:41:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:23.434 17:41:00 -- common/autotest_common.sh@10 -- # set +x 00:21:23.434 [2024-11-16 17:41:00.822154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:23.434 [2024-11-16 17:41:00.822245] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1619341 ] 00:21:23.434 EAL: No free 2048 kB hugepages reported on node 1 00:21:23.434 [2024-11-16 17:41:00.880593] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:23.692 [2024-11-16 17:41:00.963452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:24.626 17:41:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:24.626 17:41:01 -- common/autotest_common.sh@862 -- # return 0 00:21:24.626 17:41:01 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:24.626 [2024-11-16 17:41:01.997509] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:24.626 TLSTESTn1 00:21:24.626 17:41:02 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:24.884 Running I/O for 10 seconds... 00:21:34.857 00:21:34.857 Latency(us) 00:21:34.857 [2024-11-16T16:41:12.349Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:34.857 [2024-11-16T16:41:12.349Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:34.857 Verification LBA range: start 0x0 length 0x2000 00:21:34.857 TLSTESTn1 : 10.02 3818.85 14.92 0.00 0.00 33466.38 6213.78 88546.42 00:21:34.857 [2024-11-16T16:41:12.349Z] =================================================================================================================== 00:21:34.857 [2024-11-16T16:41:12.349Z] Total : 3818.85 14.92 0.00 0.00 33466.38 6213.78 88546.42 00:21:34.857 0 00:21:34.857 17:41:12 -- fips/fips.sh@1 -- # cleanup 00:21:34.857 17:41:12 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:34.857 17:41:12 -- common/autotest_common.sh@806 -- # type=--id 00:21:34.857 17:41:12 -- common/autotest_common.sh@807 -- # id=0 00:21:34.857 17:41:12 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:34.857 17:41:12 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:34.857 17:41:12 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:34.857 17:41:12 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:34.857 17:41:12 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:34.857 17:41:12 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:34.857 nvmf_trace.0 00:21:34.857 17:41:12 -- common/autotest_common.sh@821 -- # return 0 00:21:34.857 17:41:12 -- fips/fips.sh@16 -- # killprocess 1619341 00:21:34.857 17:41:12 -- common/autotest_common.sh@936 -- # '[' -z 1619341 ']' 00:21:34.857 17:41:12 -- common/autotest_common.sh@940 -- # kill -0 1619341 00:21:34.857 17:41:12 -- common/autotest_common.sh@941 -- # uname 00:21:34.857 17:41:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:34.857 17:41:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1619341 00:21:34.857 17:41:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:34.857 17:41:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:34.857 17:41:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1619341' 00:21:34.857 killing process with pid 1619341 00:21:34.857 17:41:12 -- common/autotest_common.sh@955 -- # kill 1619341 00:21:34.857 Received shutdown signal, test time was about 10.000000 seconds 00:21:34.857 00:21:34.857 Latency(us) 00:21:34.857 [2024-11-16T16:41:12.349Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:34.857 [2024-11-16T16:41:12.349Z] =================================================================================================================== 00:21:34.857 [2024-11-16T16:41:12.349Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:34.857 17:41:12 -- common/autotest_common.sh@960 -- # wait 1619341 00:21:35.116 17:41:12 -- fips/fips.sh@17 -- # nvmftestfini 00:21:35.116 17:41:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:35.116 17:41:12 -- nvmf/common.sh@116 -- # sync 00:21:35.116 17:41:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:35.116 17:41:12 -- nvmf/common.sh@119 -- # set +e 00:21:35.116 17:41:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:35.116 17:41:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:35.116 rmmod nvme_tcp 00:21:35.116 rmmod nvme_fabrics 00:21:35.116 rmmod nvme_keyring 00:21:35.374 17:41:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:35.374 17:41:12 -- nvmf/common.sh@123 -- # set -e 00:21:35.374 17:41:12 -- nvmf/common.sh@124 -- # return 0 00:21:35.374 17:41:12 -- nvmf/common.sh@477 -- # '[' -n 1619174 ']' 00:21:35.374 17:41:12 -- nvmf/common.sh@478 -- # killprocess 1619174 00:21:35.374 17:41:12 -- common/autotest_common.sh@936 -- # '[' -z 1619174 ']' 00:21:35.374 17:41:12 -- common/autotest_common.sh@940 -- # kill -0 1619174 00:21:35.374 17:41:12 -- common/autotest_common.sh@941 -- # uname 00:21:35.374 17:41:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:35.374 17:41:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1619174 00:21:35.374 17:41:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:35.374 17:41:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:35.374 17:41:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1619174' 00:21:35.374 killing process with pid 1619174 00:21:35.374 17:41:12 -- common/autotest_common.sh@955 -- # kill 1619174 00:21:35.374 17:41:12 -- common/autotest_common.sh@960 -- # wait 1619174 00:21:35.632 17:41:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:35.632 17:41:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:35.632 17:41:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:35.632 17:41:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:35.632 17:41:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:35.632 17:41:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:35.632 17:41:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:35.632 17:41:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:37.532 17:41:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:37.532 17:41:14 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:37.532 00:21:37.532 real 0m18.017s 00:21:37.532 user 0m20.221s 00:21:37.532 sys 0m7.160s 00:21:37.532 17:41:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:37.532 17:41:14 -- common/autotest_common.sh@10 -- # set +x 00:21:37.532 ************************************ 00:21:37.532 END TEST nvmf_fips 00:21:37.532 ************************************ 00:21:37.532 17:41:14 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:37.532 17:41:14 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:37.532 17:41:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:37.532 17:41:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:37.532 17:41:14 -- common/autotest_common.sh@10 -- # set +x 00:21:37.532 ************************************ 00:21:37.532 START TEST nvmf_fuzz 00:21:37.532 ************************************ 00:21:37.532 17:41:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:37.532 * Looking for test storage... 00:21:37.532 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:37.532 17:41:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:37.532 17:41:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:37.532 17:41:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:37.792 17:41:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:37.792 17:41:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:37.792 17:41:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:37.792 17:41:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:37.792 17:41:15 -- scripts/common.sh@335 -- # IFS=.-: 00:21:37.792 17:41:15 -- scripts/common.sh@335 -- # read -ra ver1 00:21:37.792 17:41:15 -- scripts/common.sh@336 -- # IFS=.-: 00:21:37.792 17:41:15 -- scripts/common.sh@336 -- # read -ra ver2 00:21:37.792 17:41:15 -- scripts/common.sh@337 -- # local 'op=<' 00:21:37.792 17:41:15 -- scripts/common.sh@339 -- # ver1_l=2 00:21:37.792 17:41:15 -- scripts/common.sh@340 -- # ver2_l=1 00:21:37.792 17:41:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:37.792 17:41:15 -- scripts/common.sh@343 -- # case "$op" in 00:21:37.792 17:41:15 -- scripts/common.sh@344 -- # : 1 00:21:37.792 17:41:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:37.792 17:41:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:37.792 17:41:15 -- scripts/common.sh@364 -- # decimal 1 00:21:37.792 17:41:15 -- scripts/common.sh@352 -- # local d=1 00:21:37.792 17:41:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:37.792 17:41:15 -- scripts/common.sh@354 -- # echo 1 00:21:37.792 17:41:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:37.792 17:41:15 -- scripts/common.sh@365 -- # decimal 2 00:21:37.792 17:41:15 -- scripts/common.sh@352 -- # local d=2 00:21:37.792 17:41:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:37.792 17:41:15 -- scripts/common.sh@354 -- # echo 2 00:21:37.792 17:41:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:37.792 17:41:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:37.792 17:41:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:37.792 17:41:15 -- scripts/common.sh@367 -- # return 0 00:21:37.792 17:41:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:37.792 17:41:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:37.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.792 --rc genhtml_branch_coverage=1 00:21:37.792 --rc genhtml_function_coverage=1 00:21:37.792 --rc genhtml_legend=1 00:21:37.792 --rc geninfo_all_blocks=1 00:21:37.792 --rc geninfo_unexecuted_blocks=1 00:21:37.792 00:21:37.792 ' 00:21:37.792 17:41:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:37.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.792 --rc genhtml_branch_coverage=1 00:21:37.792 --rc genhtml_function_coverage=1 00:21:37.792 --rc genhtml_legend=1 00:21:37.792 --rc geninfo_all_blocks=1 00:21:37.792 --rc geninfo_unexecuted_blocks=1 00:21:37.792 00:21:37.792 ' 00:21:37.792 17:41:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:37.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.792 --rc genhtml_branch_coverage=1 00:21:37.792 --rc genhtml_function_coverage=1 00:21:37.792 --rc genhtml_legend=1 00:21:37.792 --rc geninfo_all_blocks=1 00:21:37.792 --rc geninfo_unexecuted_blocks=1 00:21:37.792 00:21:37.792 ' 00:21:37.792 17:41:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:37.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:37.792 --rc genhtml_branch_coverage=1 00:21:37.792 --rc genhtml_function_coverage=1 00:21:37.792 --rc genhtml_legend=1 00:21:37.792 --rc geninfo_all_blocks=1 00:21:37.792 --rc geninfo_unexecuted_blocks=1 00:21:37.792 00:21:37.792 ' 00:21:37.792 17:41:15 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:37.792 17:41:15 -- nvmf/common.sh@7 -- # uname -s 00:21:37.792 17:41:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:37.792 17:41:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:37.792 17:41:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:37.792 17:41:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:37.792 17:41:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:37.792 17:41:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:37.792 17:41:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:37.792 17:41:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:37.792 17:41:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:37.792 17:41:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:37.792 17:41:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:37.792 17:41:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:37.792 17:41:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:37.792 17:41:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:37.792 17:41:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:37.792 17:41:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:37.792 17:41:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:37.792 17:41:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:37.792 17:41:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:37.792 17:41:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.792 17:41:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.792 17:41:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.792 17:41:15 -- paths/export.sh@5 -- # export PATH 00:21:37.792 17:41:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:37.792 17:41:15 -- nvmf/common.sh@46 -- # : 0 00:21:37.792 17:41:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:37.792 17:41:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:37.792 17:41:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:37.792 17:41:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:37.792 17:41:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:37.792 17:41:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:37.792 17:41:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:37.792 17:41:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:37.792 17:41:15 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:37.792 17:41:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:37.793 17:41:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:37.793 17:41:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:37.793 17:41:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:37.793 17:41:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:37.793 17:41:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:37.793 17:41:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:37.793 17:41:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:37.793 17:41:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:37.793 17:41:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:37.793 17:41:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:37.793 17:41:15 -- common/autotest_common.sh@10 -- # set +x 00:21:39.694 17:41:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:39.694 17:41:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:39.694 17:41:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:39.694 17:41:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:39.694 17:41:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:39.694 17:41:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:39.694 17:41:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:39.694 17:41:17 -- nvmf/common.sh@294 -- # net_devs=() 00:21:39.694 17:41:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:39.694 17:41:17 -- nvmf/common.sh@295 -- # e810=() 00:21:39.694 17:41:17 -- nvmf/common.sh@295 -- # local -ga e810 00:21:39.694 17:41:17 -- nvmf/common.sh@296 -- # x722=() 00:21:39.694 17:41:17 -- nvmf/common.sh@296 -- # local -ga x722 00:21:39.694 17:41:17 -- nvmf/common.sh@297 -- # mlx=() 00:21:39.694 17:41:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:39.694 17:41:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:39.694 17:41:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:39.694 17:41:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:39.694 17:41:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:39.694 17:41:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.694 17:41:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:39.694 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:39.694 17:41:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:39.694 17:41:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:39.694 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:39.694 17:41:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:39.694 17:41:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:39.694 17:41:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.694 17:41:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.694 17:41:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.694 17:41:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.694 17:41:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:39.694 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:39.694 17:41:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.695 17:41:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:39.695 17:41:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:39.695 17:41:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:39.695 17:41:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:39.695 17:41:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:39.695 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:39.695 17:41:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:39.695 17:41:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:39.695 17:41:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:39.695 17:41:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:39.695 17:41:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:39.695 17:41:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:39.695 17:41:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:39.695 17:41:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:39.695 17:41:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:39.695 17:41:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:39.695 17:41:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:39.695 17:41:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:39.695 17:41:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:39.695 17:41:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:39.695 17:41:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:39.695 17:41:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:39.695 17:41:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:39.695 17:41:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:39.695 17:41:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:39.953 17:41:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:39.953 17:41:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:39.953 17:41:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:39.953 17:41:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:39.953 17:41:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:39.953 17:41:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:39.953 17:41:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:39.953 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:39.953 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.184 ms 00:21:39.953 00:21:39.953 --- 10.0.0.2 ping statistics --- 00:21:39.953 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.953 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:21:39.953 17:41:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:39.953 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:39.953 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:21:39.953 00:21:39.953 --- 10.0.0.1 ping statistics --- 00:21:39.953 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:39.953 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:21:39.953 17:41:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:39.953 17:41:17 -- nvmf/common.sh@410 -- # return 0 00:21:39.953 17:41:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:39.953 17:41:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:39.953 17:41:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:39.953 17:41:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:39.953 17:41:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:39.953 17:41:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:39.953 17:41:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:39.953 17:41:17 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1622693 00:21:39.953 17:41:17 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:39.953 17:41:17 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:39.953 17:41:17 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1622693 00:21:39.953 17:41:17 -- common/autotest_common.sh@829 -- # '[' -z 1622693 ']' 00:21:39.953 17:41:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:39.953 17:41:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:39.953 17:41:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:39.953 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:39.953 17:41:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:39.953 17:41:17 -- common/autotest_common.sh@10 -- # set +x 00:21:40.887 17:41:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:40.887 17:41:18 -- common/autotest_common.sh@862 -- # return 0 00:21:40.887 17:41:18 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:40.887 17:41:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.887 17:41:18 -- common/autotest_common.sh@10 -- # set +x 00:21:40.887 17:41:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.887 17:41:18 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:40.887 17:41:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.887 17:41:18 -- common/autotest_common.sh@10 -- # set +x 00:21:40.887 Malloc0 00:21:40.887 17:41:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:40.887 17:41:18 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:40.887 17:41:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:40.887 17:41:18 -- common/autotest_common.sh@10 -- # set +x 00:21:41.145 17:41:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.145 17:41:18 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:41.145 17:41:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.145 17:41:18 -- common/autotest_common.sh@10 -- # set +x 00:21:41.145 17:41:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.145 17:41:18 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:41.145 17:41:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:41.145 17:41:18 -- common/autotest_common.sh@10 -- # set +x 00:21:41.145 17:41:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:41.145 17:41:18 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:41.145 17:41:18 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:13.213 Fuzzing completed. Shutting down the fuzz application 00:22:13.213 00:22:13.213 Dumping successful admin opcodes: 00:22:13.213 8, 9, 10, 24, 00:22:13.213 Dumping successful io opcodes: 00:22:13.213 0, 9, 00:22:13.213 NS: 0x200003aeff00 I/O qp, Total commands completed: 457981, total successful commands: 2657, random_seed: 1165070208 00:22:13.213 NS: 0x200003aeff00 admin qp, Total commands completed: 56352, total successful commands: 447, random_seed: 1354939584 00:22:13.214 17:41:49 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:13.214 Fuzzing completed. Shutting down the fuzz application 00:22:13.214 00:22:13.214 Dumping successful admin opcodes: 00:22:13.214 24, 00:22:13.214 Dumping successful io opcodes: 00:22:13.214 00:22:13.214 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 2023299263 00:22:13.214 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 2023405508 00:22:13.214 17:41:50 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:13.214 17:41:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:13.214 17:41:50 -- common/autotest_common.sh@10 -- # set +x 00:22:13.214 17:41:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:13.214 17:41:50 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:13.214 17:41:50 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:13.214 17:41:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:13.214 17:41:50 -- nvmf/common.sh@116 -- # sync 00:22:13.214 17:41:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:13.214 17:41:50 -- nvmf/common.sh@119 -- # set +e 00:22:13.214 17:41:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:13.214 17:41:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:13.214 rmmod nvme_tcp 00:22:13.214 rmmod nvme_fabrics 00:22:13.214 rmmod nvme_keyring 00:22:13.214 17:41:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:13.214 17:41:50 -- nvmf/common.sh@123 -- # set -e 00:22:13.214 17:41:50 -- nvmf/common.sh@124 -- # return 0 00:22:13.214 17:41:50 -- nvmf/common.sh@477 -- # '[' -n 1622693 ']' 00:22:13.214 17:41:50 -- nvmf/common.sh@478 -- # killprocess 1622693 00:22:13.214 17:41:50 -- common/autotest_common.sh@936 -- # '[' -z 1622693 ']' 00:22:13.214 17:41:50 -- common/autotest_common.sh@940 -- # kill -0 1622693 00:22:13.214 17:41:50 -- common/autotest_common.sh@941 -- # uname 00:22:13.214 17:41:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:13.214 17:41:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1622693 00:22:13.214 17:41:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:13.214 17:41:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:13.214 17:41:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1622693' 00:22:13.214 killing process with pid 1622693 00:22:13.214 17:41:50 -- common/autotest_common.sh@955 -- # kill 1622693 00:22:13.214 17:41:50 -- common/autotest_common.sh@960 -- # wait 1622693 00:22:13.473 17:41:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:13.473 17:41:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:13.473 17:41:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:13.473 17:41:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:13.473 17:41:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:13.473 17:41:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:13.473 17:41:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:13.473 17:41:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.376 17:41:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:15.376 17:41:52 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:15.636 00:22:15.636 real 0m37.920s 00:22:15.636 user 0m51.204s 00:22:15.636 sys 0m15.748s 00:22:15.636 17:41:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:15.636 17:41:52 -- common/autotest_common.sh@10 -- # set +x 00:22:15.636 ************************************ 00:22:15.636 END TEST nvmf_fuzz 00:22:15.636 ************************************ 00:22:15.636 17:41:52 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:15.636 17:41:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:15.636 17:41:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:15.636 17:41:52 -- common/autotest_common.sh@10 -- # set +x 00:22:15.636 ************************************ 00:22:15.636 START TEST nvmf_multiconnection 00:22:15.636 ************************************ 00:22:15.636 17:41:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:15.636 * Looking for test storage... 00:22:15.636 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:15.636 17:41:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:15.636 17:41:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:15.636 17:41:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:15.636 17:41:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:15.636 17:41:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:15.636 17:41:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:15.636 17:41:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:15.636 17:41:53 -- scripts/common.sh@335 -- # IFS=.-: 00:22:15.636 17:41:53 -- scripts/common.sh@335 -- # read -ra ver1 00:22:15.636 17:41:53 -- scripts/common.sh@336 -- # IFS=.-: 00:22:15.636 17:41:53 -- scripts/common.sh@336 -- # read -ra ver2 00:22:15.636 17:41:53 -- scripts/common.sh@337 -- # local 'op=<' 00:22:15.636 17:41:53 -- scripts/common.sh@339 -- # ver1_l=2 00:22:15.636 17:41:53 -- scripts/common.sh@340 -- # ver2_l=1 00:22:15.636 17:41:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:15.636 17:41:53 -- scripts/common.sh@343 -- # case "$op" in 00:22:15.636 17:41:53 -- scripts/common.sh@344 -- # : 1 00:22:15.636 17:41:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:15.636 17:41:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:15.636 17:41:53 -- scripts/common.sh@364 -- # decimal 1 00:22:15.636 17:41:53 -- scripts/common.sh@352 -- # local d=1 00:22:15.636 17:41:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:15.636 17:41:53 -- scripts/common.sh@354 -- # echo 1 00:22:15.636 17:41:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:15.636 17:41:53 -- scripts/common.sh@365 -- # decimal 2 00:22:15.636 17:41:53 -- scripts/common.sh@352 -- # local d=2 00:22:15.636 17:41:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:15.636 17:41:53 -- scripts/common.sh@354 -- # echo 2 00:22:15.636 17:41:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:15.636 17:41:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:15.636 17:41:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:15.636 17:41:53 -- scripts/common.sh@367 -- # return 0 00:22:15.636 17:41:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:15.636 17:41:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:15.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.636 --rc genhtml_branch_coverage=1 00:22:15.636 --rc genhtml_function_coverage=1 00:22:15.636 --rc genhtml_legend=1 00:22:15.636 --rc geninfo_all_blocks=1 00:22:15.636 --rc geninfo_unexecuted_blocks=1 00:22:15.636 00:22:15.636 ' 00:22:15.636 17:41:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:15.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.636 --rc genhtml_branch_coverage=1 00:22:15.636 --rc genhtml_function_coverage=1 00:22:15.636 --rc genhtml_legend=1 00:22:15.636 --rc geninfo_all_blocks=1 00:22:15.636 --rc geninfo_unexecuted_blocks=1 00:22:15.636 00:22:15.636 ' 00:22:15.636 17:41:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:15.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.636 --rc genhtml_branch_coverage=1 00:22:15.636 --rc genhtml_function_coverage=1 00:22:15.636 --rc genhtml_legend=1 00:22:15.636 --rc geninfo_all_blocks=1 00:22:15.636 --rc geninfo_unexecuted_blocks=1 00:22:15.636 00:22:15.636 ' 00:22:15.636 17:41:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:15.636 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:15.636 --rc genhtml_branch_coverage=1 00:22:15.636 --rc genhtml_function_coverage=1 00:22:15.636 --rc genhtml_legend=1 00:22:15.636 --rc geninfo_all_blocks=1 00:22:15.636 --rc geninfo_unexecuted_blocks=1 00:22:15.636 00:22:15.636 ' 00:22:15.636 17:41:53 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:15.636 17:41:53 -- nvmf/common.sh@7 -- # uname -s 00:22:15.636 17:41:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:15.636 17:41:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:15.636 17:41:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:15.636 17:41:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:15.636 17:41:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:15.636 17:41:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:15.637 17:41:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:15.637 17:41:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:15.637 17:41:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:15.637 17:41:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:15.637 17:41:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:15.637 17:41:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:15.637 17:41:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:15.637 17:41:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:15.637 17:41:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:15.637 17:41:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:15.637 17:41:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:15.637 17:41:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:15.637 17:41:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:15.637 17:41:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.637 17:41:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.637 17:41:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.637 17:41:53 -- paths/export.sh@5 -- # export PATH 00:22:15.637 17:41:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:15.637 17:41:53 -- nvmf/common.sh@46 -- # : 0 00:22:15.637 17:41:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:15.637 17:41:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:15.637 17:41:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:15.637 17:41:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:15.637 17:41:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:15.637 17:41:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:15.637 17:41:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:15.637 17:41:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:15.637 17:41:53 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:15.637 17:41:53 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:15.637 17:41:53 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:15.637 17:41:53 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:15.637 17:41:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:15.637 17:41:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:15.637 17:41:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:15.637 17:41:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:15.637 17:41:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:15.637 17:41:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:15.637 17:41:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:15.637 17:41:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:15.637 17:41:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:15.637 17:41:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:15.637 17:41:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:15.637 17:41:53 -- common/autotest_common.sh@10 -- # set +x 00:22:18.244 17:41:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:18.244 17:41:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:18.244 17:41:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:18.244 17:41:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:18.244 17:41:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:18.244 17:41:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:18.244 17:41:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:18.244 17:41:55 -- nvmf/common.sh@294 -- # net_devs=() 00:22:18.244 17:41:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:18.244 17:41:55 -- nvmf/common.sh@295 -- # e810=() 00:22:18.244 17:41:55 -- nvmf/common.sh@295 -- # local -ga e810 00:22:18.244 17:41:55 -- nvmf/common.sh@296 -- # x722=() 00:22:18.244 17:41:55 -- nvmf/common.sh@296 -- # local -ga x722 00:22:18.244 17:41:55 -- nvmf/common.sh@297 -- # mlx=() 00:22:18.244 17:41:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:18.244 17:41:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:18.244 17:41:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:18.244 17:41:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:18.244 17:41:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:18.244 17:41:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.244 17:41:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:18.244 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:18.244 17:41:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.244 17:41:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:18.244 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:18.244 17:41:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:18.244 17:41:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.244 17:41:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.244 17:41:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.244 17:41:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.244 17:41:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:18.244 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:18.244 17:41:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.244 17:41:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.244 17:41:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.244 17:41:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.244 17:41:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.244 17:41:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:18.244 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:18.244 17:41:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.244 17:41:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:18.244 17:41:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:18.244 17:41:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:18.244 17:41:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:18.244 17:41:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:18.244 17:41:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:18.244 17:41:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:18.244 17:41:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:18.244 17:41:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:18.244 17:41:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:18.244 17:41:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:18.244 17:41:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:18.244 17:41:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:18.244 17:41:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:18.245 17:41:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:18.245 17:41:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:18.245 17:41:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:18.245 17:41:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:18.245 17:41:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:18.245 17:41:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:18.245 17:41:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:18.245 17:41:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:18.245 17:41:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:18.245 17:41:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:18.245 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:18.245 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:22:18.245 00:22:18.245 --- 10.0.0.2 ping statistics --- 00:22:18.245 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.245 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:22:18.245 17:41:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:18.245 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:18.245 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:22:18.245 00:22:18.245 --- 10.0.0.1 ping statistics --- 00:22:18.245 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.245 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:22:18.245 17:41:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:18.245 17:41:55 -- nvmf/common.sh@410 -- # return 0 00:22:18.245 17:41:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:18.245 17:41:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:18.245 17:41:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:18.245 17:41:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:18.245 17:41:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:18.245 17:41:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:18.245 17:41:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:18.245 17:41:55 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:18.245 17:41:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:18.245 17:41:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:18.245 17:41:55 -- common/autotest_common.sh@10 -- # set +x 00:22:18.245 17:41:55 -- nvmf/common.sh@469 -- # nvmfpid=1628655 00:22:18.245 17:41:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:18.245 17:41:55 -- nvmf/common.sh@470 -- # waitforlisten 1628655 00:22:18.245 17:41:55 -- common/autotest_common.sh@829 -- # '[' -z 1628655 ']' 00:22:18.245 17:41:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:18.245 17:41:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:18.245 17:41:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:18.245 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:18.245 17:41:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:18.245 17:41:55 -- common/autotest_common.sh@10 -- # set +x 00:22:18.245 [2024-11-16 17:41:55.329176] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:18.245 [2024-11-16 17:41:55.329247] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:18.245 EAL: No free 2048 kB hugepages reported on node 1 00:22:18.245 [2024-11-16 17:41:55.400303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:18.245 [2024-11-16 17:41:55.495157] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:18.245 [2024-11-16 17:41:55.495330] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:18.245 [2024-11-16 17:41:55.495351] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:18.245 [2024-11-16 17:41:55.495367] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:18.245 [2024-11-16 17:41:55.495444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:18.245 [2024-11-16 17:41:55.495499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:18.245 [2024-11-16 17:41:55.495525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:18.245 [2024-11-16 17:41:55.495528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:18.811 17:41:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:18.811 17:41:56 -- common/autotest_common.sh@862 -- # return 0 00:22:18.811 17:41:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:18.811 17:41:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:18.811 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:19.072 17:41:56 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 [2024-11-16 17:41:56.323272] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:19.072 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.072 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 Malloc1 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 [2024-11-16 17:41:56.380310] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.072 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 Malloc2 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.072 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 Malloc3 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.072 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 Malloc4 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.072 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 Malloc5 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.072 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:19.072 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.072 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.072 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.331 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 Malloc6 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.331 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 Malloc7 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.331 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 Malloc8 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:19.331 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.331 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.331 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.331 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.331 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:19.332 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.332 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.332 Malloc9 00:22:19.332 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.332 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:19.332 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.332 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.332 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.332 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:19.332 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.332 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.332 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.332 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:19.332 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.332 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.332 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.332 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.332 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:19.332 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.332 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.332 Malloc10 00:22:19.332 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.332 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:19.332 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.332 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.332 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.332 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:19.332 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.332 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.332 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.332 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:19.332 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.332 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.590 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.590 17:41:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.590 17:41:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:19.590 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.590 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.590 Malloc11 00:22:19.590 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.590 17:41:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:19.590 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.590 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.590 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.590 17:41:56 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:19.590 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.590 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.590 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.590 17:41:56 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:19.590 17:41:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.591 17:41:56 -- common/autotest_common.sh@10 -- # set +x 00:22:19.591 17:41:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.591 17:41:56 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:19.591 17:41:56 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.591 17:41:56 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:20.157 17:41:57 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:20.157 17:41:57 -- common/autotest_common.sh@1187 -- # local i=0 00:22:20.157 17:41:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:20.157 17:41:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:20.157 17:41:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:22.061 17:41:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:22.061 17:41:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:22.061 17:41:59 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:22.061 17:41:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:22.061 17:41:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:22.061 17:41:59 -- common/autotest_common.sh@1197 -- # return 0 00:22:22.061 17:41:59 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:22.061 17:41:59 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:22.998 17:42:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:22.998 17:42:00 -- common/autotest_common.sh@1187 -- # local i=0 00:22:22.998 17:42:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:22.998 17:42:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:22.998 17:42:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:24.899 17:42:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:24.899 17:42:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:24.899 17:42:02 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:24.899 17:42:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:24.899 17:42:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:24.899 17:42:02 -- common/autotest_common.sh@1197 -- # return 0 00:22:24.899 17:42:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:24.899 17:42:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:25.467 17:42:02 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:25.467 17:42:02 -- common/autotest_common.sh@1187 -- # local i=0 00:22:25.467 17:42:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:25.467 17:42:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:25.467 17:42:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:27.373 17:42:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:27.373 17:42:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:27.373 17:42:04 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:27.373 17:42:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:27.373 17:42:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:27.373 17:42:04 -- common/autotest_common.sh@1197 -- # return 0 00:22:27.373 17:42:04 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:27.373 17:42:04 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:28.309 17:42:05 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:28.309 17:42:05 -- common/autotest_common.sh@1187 -- # local i=0 00:22:28.309 17:42:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:28.309 17:42:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:28.309 17:42:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:30.213 17:42:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:30.213 17:42:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:30.213 17:42:07 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:30.213 17:42:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:30.213 17:42:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:30.213 17:42:07 -- common/autotest_common.sh@1197 -- # return 0 00:22:30.213 17:42:07 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:30.213 17:42:07 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:30.778 17:42:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:30.778 17:42:08 -- common/autotest_common.sh@1187 -- # local i=0 00:22:30.778 17:42:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:30.778 17:42:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:30.778 17:42:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:33.306 17:42:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:33.306 17:42:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:33.306 17:42:10 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:33.306 17:42:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:33.306 17:42:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:33.306 17:42:10 -- common/autotest_common.sh@1197 -- # return 0 00:22:33.306 17:42:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:33.306 17:42:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:33.564 17:42:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:33.564 17:42:11 -- common/autotest_common.sh@1187 -- # local i=0 00:22:33.564 17:42:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:33.564 17:42:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:33.564 17:42:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:36.092 17:42:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:36.092 17:42:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:36.092 17:42:13 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:36.092 17:42:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:36.092 17:42:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:36.092 17:42:13 -- common/autotest_common.sh@1197 -- # return 0 00:22:36.092 17:42:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:36.092 17:42:13 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:36.350 17:42:13 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:36.350 17:42:13 -- common/autotest_common.sh@1187 -- # local i=0 00:22:36.350 17:42:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:36.350 17:42:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:36.350 17:42:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:38.878 17:42:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:38.878 17:42:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:38.878 17:42:15 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:38.878 17:42:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:38.878 17:42:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:38.878 17:42:15 -- common/autotest_common.sh@1197 -- # return 0 00:22:38.878 17:42:15 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:38.878 17:42:15 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:39.137 17:42:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:39.137 17:42:16 -- common/autotest_common.sh@1187 -- # local i=0 00:22:39.137 17:42:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:39.137 17:42:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:39.137 17:42:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:41.664 17:42:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:41.664 17:42:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:41.664 17:42:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:41.664 17:42:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:41.664 17:42:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:41.664 17:42:18 -- common/autotest_common.sh@1197 -- # return 0 00:22:41.664 17:42:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:41.664 17:42:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:42.233 17:42:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:42.233 17:42:19 -- common/autotest_common.sh@1187 -- # local i=0 00:22:42.233 17:42:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:42.233 17:42:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:42.233 17:42:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:44.130 17:42:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:44.130 17:42:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:44.130 17:42:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:44.130 17:42:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:44.130 17:42:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:44.130 17:42:21 -- common/autotest_common.sh@1197 -- # return 0 00:22:44.130 17:42:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:44.130 17:42:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:45.063 17:42:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:45.063 17:42:22 -- common/autotest_common.sh@1187 -- # local i=0 00:22:45.063 17:42:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:45.063 17:42:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:45.063 17:42:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:46.961 17:42:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:46.961 17:42:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:46.961 17:42:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:46.961 17:42:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:46.961 17:42:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:46.961 17:42:24 -- common/autotest_common.sh@1197 -- # return 0 00:22:46.961 17:42:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.961 17:42:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:48.334 17:42:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:48.334 17:42:25 -- common/autotest_common.sh@1187 -- # local i=0 00:22:48.334 17:42:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:48.334 17:42:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:48.334 17:42:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:50.231 17:42:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:50.231 17:42:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:50.231 17:42:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:50.231 17:42:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:50.231 17:42:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:50.231 17:42:27 -- common/autotest_common.sh@1197 -- # return 0 00:22:50.231 17:42:27 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:50.231 [global] 00:22:50.231 thread=1 00:22:50.231 invalidate=1 00:22:50.231 rw=read 00:22:50.231 time_based=1 00:22:50.231 runtime=10 00:22:50.231 ioengine=libaio 00:22:50.231 direct=1 00:22:50.231 bs=262144 00:22:50.231 iodepth=64 00:22:50.232 norandommap=1 00:22:50.232 numjobs=1 00:22:50.232 00:22:50.232 [job0] 00:22:50.232 filename=/dev/nvme0n1 00:22:50.232 [job1] 00:22:50.232 filename=/dev/nvme10n1 00:22:50.232 [job2] 00:22:50.232 filename=/dev/nvme1n1 00:22:50.232 [job3] 00:22:50.232 filename=/dev/nvme2n1 00:22:50.232 [job4] 00:22:50.232 filename=/dev/nvme3n1 00:22:50.232 [job5] 00:22:50.232 filename=/dev/nvme4n1 00:22:50.232 [job6] 00:22:50.232 filename=/dev/nvme5n1 00:22:50.232 [job7] 00:22:50.232 filename=/dev/nvme6n1 00:22:50.232 [job8] 00:22:50.232 filename=/dev/nvme7n1 00:22:50.232 [job9] 00:22:50.232 filename=/dev/nvme8n1 00:22:50.232 [job10] 00:22:50.232 filename=/dev/nvme9n1 00:22:50.232 Could not set queue depth (nvme0n1) 00:22:50.232 Could not set queue depth (nvme10n1) 00:22:50.232 Could not set queue depth (nvme1n1) 00:22:50.232 Could not set queue depth (nvme2n1) 00:22:50.232 Could not set queue depth (nvme3n1) 00:22:50.232 Could not set queue depth (nvme4n1) 00:22:50.232 Could not set queue depth (nvme5n1) 00:22:50.232 Could not set queue depth (nvme6n1) 00:22:50.232 Could not set queue depth (nvme7n1) 00:22:50.232 Could not set queue depth (nvme8n1) 00:22:50.232 Could not set queue depth (nvme9n1) 00:22:50.489 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:50.489 fio-3.35 00:22:50.489 Starting 11 threads 00:23:02.774 00:23:02.774 job0: (groupid=0, jobs=1): err= 0: pid=1633683: Sat Nov 16 17:42:38 2024 00:23:02.774 read: IOPS=557, BW=139MiB/s (146MB/s)(1408MiB/10098msec) 00:23:02.774 slat (usec): min=9, max=75652, avg=1544.98, stdev=4779.42 00:23:02.774 clat (msec): min=11, max=253, avg=113.14, stdev=36.44 00:23:02.774 lat (msec): min=11, max=264, avg=114.68, stdev=37.13 00:23:02.774 clat percentiles (msec): 00:23:02.774 | 1.00th=[ 26], 5.00th=[ 58], 10.00th=[ 73], 20.00th=[ 83], 00:23:02.774 | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 112], 60.00th=[ 121], 00:23:02.774 | 70.00th=[ 131], 80.00th=[ 142], 90.00th=[ 161], 95.00th=[ 180], 00:23:02.774 | 99.00th=[ 201], 99.50th=[ 207], 99.90th=[ 226], 99.95th=[ 255], 00:23:02.774 | 99.99th=[ 255] 00:23:02.774 bw ( KiB/s): min=101888, max=211456, per=7.34%, avg=142540.45, stdev=30621.64, samples=20 00:23:02.774 iops : min= 398, max= 826, avg=556.75, stdev=119.60, samples=20 00:23:02.774 lat (msec) : 20=0.37%, 50=3.76%, 100=33.85%, 250=61.96%, 500=0.05% 00:23:02.774 cpu : usr=0.38%, sys=1.91%, ctx=1082, majf=0, minf=4097 00:23:02.774 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:02.774 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.774 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.774 issued rwts: total=5631,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.774 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.774 job1: (groupid=0, jobs=1): err= 0: pid=1633699: Sat Nov 16 17:42:38 2024 00:23:02.774 read: IOPS=981, BW=245MiB/s (257MB/s)(2461MiB/10025msec) 00:23:02.774 slat (usec): min=13, max=102661, avg=889.88, stdev=3552.12 00:23:02.774 clat (usec): min=1969, max=228837, avg=64250.23, stdev=45181.07 00:23:02.774 lat (usec): min=1989, max=233741, avg=65140.11, stdev=45784.17 00:23:02.774 clat percentiles (msec): 00:23:02.774 | 1.00th=[ 8], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 32], 00:23:02.774 | 30.00th=[ 33], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 57], 00:23:02.774 | 70.00th=[ 70], 80.00th=[ 109], 90.00th=[ 142], 95.00th=[ 163], 00:23:02.774 | 99.00th=[ 186], 99.50th=[ 192], 99.90th=[ 203], 99.95th=[ 222], 00:23:02.774 | 99.99th=[ 230] 00:23:02.774 bw ( KiB/s): min=92672, max=512512, per=12.90%, avg=250328.85, stdev=127230.35, samples=20 00:23:02.774 iops : min= 362, max= 2002, avg=977.80, stdev=497.04, samples=20 00:23:02.774 lat (msec) : 2=0.01%, 4=0.21%, 10=1.28%, 20=2.37%, 50=50.42% 00:23:02.774 lat (msec) : 100=22.66%, 250=23.05% 00:23:02.774 cpu : usr=0.49%, sys=3.11%, ctx=1660, majf=0, minf=4098 00:23:02.774 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:23:02.774 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.774 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.774 issued rwts: total=9842,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.774 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.775 job2: (groupid=0, jobs=1): err= 0: pid=1633737: Sat Nov 16 17:42:38 2024 00:23:02.775 read: IOPS=618, BW=155MiB/s (162MB/s)(1562MiB/10095msec) 00:23:02.775 slat (usec): min=13, max=79807, avg=1479.72, stdev=4466.91 00:23:02.775 clat (msec): min=25, max=269, avg=101.84, stdev=42.75 00:23:02.775 lat (msec): min=26, max=289, avg=103.32, stdev=43.42 00:23:02.775 clat percentiles (msec): 00:23:02.775 | 1.00th=[ 29], 5.00th=[ 34], 10.00th=[ 48], 20.00th=[ 66], 00:23:02.775 | 30.00th=[ 78], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 110], 00:23:02.775 | 70.00th=[ 123], 80.00th=[ 140], 90.00th=[ 161], 95.00th=[ 182], 00:23:02.775 | 99.00th=[ 205], 99.50th=[ 211], 99.90th=[ 226], 99.95th=[ 226], 00:23:02.775 | 99.99th=[ 271] 00:23:02.775 bw ( KiB/s): min=83968, max=385536, per=8.16%, avg=158314.30, stdev=68547.23, samples=20 00:23:02.775 iops : min= 328, max= 1506, avg=618.40, stdev=267.75, samples=20 00:23:02.775 lat (msec) : 50=11.84%, 100=40.91%, 250=47.22%, 500=0.03% 00:23:02.775 cpu : usr=0.43%, sys=2.13%, ctx=1131, majf=0, minf=4097 00:23:02.775 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:02.775 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.775 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.775 issued rwts: total=6248,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.775 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.775 job3: (groupid=0, jobs=1): err= 0: pid=1633753: Sat Nov 16 17:42:38 2024 00:23:02.775 read: IOPS=679, BW=170MiB/s (178MB/s)(1716MiB/10100msec) 00:23:02.775 slat (usec): min=8, max=90134, avg=1097.00, stdev=4112.78 00:23:02.775 clat (usec): min=1628, max=286796, avg=93031.84, stdev=42318.65 00:23:02.775 lat (usec): min=1679, max=286833, avg=94128.84, stdev=42906.18 00:23:02.775 clat percentiles (msec): 00:23:02.775 | 1.00th=[ 4], 5.00th=[ 31], 10.00th=[ 47], 20.00th=[ 59], 00:23:02.775 | 30.00th=[ 71], 40.00th=[ 81], 50.00th=[ 89], 60.00th=[ 97], 00:23:02.775 | 70.00th=[ 107], 80.00th=[ 122], 90.00th=[ 153], 95.00th=[ 178], 00:23:02.775 | 99.00th=[ 203], 99.50th=[ 211], 99.90th=[ 271], 99.95th=[ 275], 00:23:02.775 | 99.99th=[ 288] 00:23:02.775 bw ( KiB/s): min=89088, max=321916, per=8.97%, avg=174039.15, stdev=58197.02, samples=20 00:23:02.775 iops : min= 348, max= 1257, avg=679.80, stdev=227.27, samples=20 00:23:02.775 lat (msec) : 2=0.03%, 4=1.01%, 10=1.17%, 20=1.25%, 50=7.81% 00:23:02.775 lat (msec) : 100=51.85%, 250=36.71%, 500=0.17% 00:23:02.775 cpu : usr=0.39%, sys=2.16%, ctx=1375, majf=0, minf=4097 00:23:02.775 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:02.775 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.775 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.775 issued rwts: total=6862,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.775 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.775 job4: (groupid=0, jobs=1): err= 0: pid=1633764: Sat Nov 16 17:42:38 2024 00:23:02.775 read: IOPS=645, BW=161MiB/s (169MB/s)(1629MiB/10100msec) 00:23:02.775 slat (usec): min=8, max=90168, avg=1195.56, stdev=4479.62 00:23:02.775 clat (usec): min=901, max=265201, avg=97926.90, stdev=41747.63 00:23:02.775 lat (usec): min=936, max=280929, avg=99122.46, stdev=42243.53 00:23:02.775 clat percentiles (msec): 00:23:02.775 | 1.00th=[ 3], 5.00th=[ 22], 10.00th=[ 48], 20.00th=[ 69], 00:23:02.775 | 30.00th=[ 80], 40.00th=[ 90], 50.00th=[ 100], 60.00th=[ 108], 00:23:02.775 | 70.00th=[ 115], 80.00th=[ 127], 90.00th=[ 142], 95.00th=[ 180], 00:23:02.775 | 99.00th=[ 211], 99.50th=[ 222], 99.90th=[ 259], 99.95th=[ 259], 00:23:02.775 | 99.99th=[ 266] 00:23:02.775 bw ( KiB/s): min=76288, max=317952, per=8.51%, avg=165134.80, stdev=53431.41, samples=20 00:23:02.775 iops : min= 298, max= 1242, avg=645.00, stdev=208.73, samples=20 00:23:02.775 lat (usec) : 1000=0.08% 00:23:02.775 lat (msec) : 2=0.89%, 4=0.60%, 10=1.32%, 20=1.57%, 50=6.57% 00:23:02.775 lat (msec) : 100=39.86%, 250=48.88%, 500=0.25% 00:23:02.775 cpu : usr=0.31%, sys=2.19%, ctx=1290, majf=0, minf=3721 00:23:02.775 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:02.775 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.775 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.775 issued rwts: total=6516,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.775 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.775 job5: (groupid=0, jobs=1): err= 0: pid=1633808: Sat Nov 16 17:42:38 2024 00:23:02.775 read: IOPS=682, BW=171MiB/s (179MB/s)(1723MiB/10102msec) 00:23:02.775 slat (usec): min=13, max=166938, avg=1335.14, stdev=4741.44 00:23:02.775 clat (msec): min=19, max=349, avg=92.41, stdev=34.55 00:23:02.775 lat (msec): min=19, max=349, avg=93.74, stdev=35.11 00:23:02.775 clat percentiles (msec): 00:23:02.775 | 1.00th=[ 35], 5.00th=[ 42], 10.00th=[ 53], 20.00th=[ 65], 00:23:02.775 | 30.00th=[ 73], 40.00th=[ 83], 50.00th=[ 90], 60.00th=[ 97], 00:23:02.775 | 70.00th=[ 105], 80.00th=[ 116], 90.00th=[ 133], 95.00th=[ 153], 00:23:02.775 | 99.00th=[ 209], 99.50th=[ 243], 99.90th=[ 288], 99.95th=[ 288], 00:23:02.775 | 99.99th=[ 351] 00:23:02.775 bw ( KiB/s): min=107520, max=308736, per=9.00%, avg=174780.80, stdev=47914.34, samples=20 00:23:02.775 iops : min= 420, max= 1206, avg=682.70, stdev=187.18, samples=20 00:23:02.775 lat (msec) : 20=0.01%, 50=8.72%, 100=55.84%, 250=35.13%, 500=0.29% 00:23:02.775 cpu : usr=0.44%, sys=2.24%, ctx=1058, majf=0, minf=4097 00:23:02.775 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:02.775 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.775 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.775 issued rwts: total=6891,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.775 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.775 job6: (groupid=0, jobs=1): err= 0: pid=1633812: Sat Nov 16 17:42:38 2024 00:23:02.775 read: IOPS=773, BW=193MiB/s (203MB/s)(1952MiB/10099msec) 00:23:02.775 slat (usec): min=9, max=120208, avg=1156.30, stdev=4008.79 00:23:02.775 clat (msec): min=8, max=231, avg=81.54, stdev=39.07 00:23:02.775 lat (msec): min=8, max=301, avg=82.70, stdev=39.58 00:23:02.775 clat percentiles (msec): 00:23:02.775 | 1.00th=[ 13], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 51], 00:23:02.775 | 30.00th=[ 59], 40.00th=[ 68], 50.00th=[ 80], 60.00th=[ 89], 00:23:02.775 | 70.00th=[ 101], 80.00th=[ 113], 90.00th=[ 133], 95.00th=[ 155], 00:23:02.775 | 99.00th=[ 184], 99.50th=[ 209], 99.90th=[ 230], 99.95th=[ 232], 00:23:02.775 | 99.99th=[ 232] 00:23:02.775 bw ( KiB/s): min=103936, max=393216, per=10.21%, avg=198251.70, stdev=71334.13, samples=20 00:23:02.775 iops : min= 406, max= 1536, avg=774.40, stdev=278.65, samples=20 00:23:02.775 lat (msec) : 10=0.29%, 20=3.69%, 50=15.44%, 100=50.38%, 250=30.20% 00:23:02.775 cpu : usr=0.42%, sys=2.53%, ctx=1400, majf=0, minf=4097 00:23:02.775 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:02.775 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.775 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.775 issued rwts: total=7809,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.775 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.775 job7: (groupid=0, jobs=1): err= 0: pid=1633813: Sat Nov 16 17:42:38 2024 00:23:02.775 read: IOPS=601, BW=150MiB/s (158MB/s)(1518MiB/10100msec) 00:23:02.775 slat (usec): min=8, max=91647, avg=1415.45, stdev=4976.65 00:23:02.775 clat (msec): min=13, max=282, avg=104.98, stdev=38.04 00:23:02.775 lat (msec): min=13, max=282, avg=106.40, stdev=38.65 00:23:02.775 clat percentiles (msec): 00:23:02.775 | 1.00th=[ 28], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 75], 00:23:02.775 | 30.00th=[ 85], 40.00th=[ 92], 50.00th=[ 101], 60.00th=[ 109], 00:23:02.775 | 70.00th=[ 117], 80.00th=[ 130], 90.00th=[ 157], 95.00th=[ 184], 00:23:02.775 | 99.00th=[ 215], 99.50th=[ 230], 99.90th=[ 251], 99.95th=[ 264], 00:23:02.775 | 99.99th=[ 284] 00:23:02.775 bw ( KiB/s): min=71680, max=222208, per=7.92%, avg=153760.40, stdev=40955.48, samples=20 00:23:02.775 iops : min= 280, max= 868, avg=600.60, stdev=159.96, samples=20 00:23:02.775 lat (msec) : 20=0.25%, 50=2.40%, 100=47.50%, 250=49.60%, 500=0.25% 00:23:02.775 cpu : usr=0.33%, sys=2.00%, ctx=1094, majf=0, minf=4097 00:23:02.775 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:02.775 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.775 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.775 issued rwts: total=6071,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.775 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.775 job8: (groupid=0, jobs=1): err= 0: pid=1633820: Sat Nov 16 17:42:38 2024 00:23:02.775 read: IOPS=608, BW=152MiB/s (160MB/s)(1536MiB/10097msec) 00:23:02.775 slat (usec): min=8, max=105304, avg=956.84, stdev=3994.38 00:23:02.775 clat (usec): min=1240, max=261481, avg=104108.53, stdev=46353.99 00:23:02.775 lat (usec): min=1270, max=261501, avg=105065.38, stdev=46878.28 00:23:02.775 clat percentiles (msec): 00:23:02.775 | 1.00th=[ 4], 5.00th=[ 16], 10.00th=[ 42], 20.00th=[ 63], 00:23:02.775 | 30.00th=[ 86], 40.00th=[ 99], 50.00th=[ 108], 60.00th=[ 116], 00:23:02.775 | 70.00th=[ 128], 80.00th=[ 140], 90.00th=[ 165], 95.00th=[ 182], 00:23:02.775 | 99.00th=[ 203], 99.50th=[ 211], 99.90th=[ 226], 99.95th=[ 230], 00:23:02.775 | 99.99th=[ 262] 00:23:02.775 bw ( KiB/s): min=99328, max=286720, per=8.02%, avg=155683.55, stdev=49236.11, samples=20 00:23:02.775 iops : min= 388, max= 1120, avg=608.10, stdev=192.33, samples=20 00:23:02.775 lat (msec) : 2=0.23%, 4=0.88%, 10=2.88%, 20=1.48%, 50=8.27% 00:23:02.775 lat (msec) : 100=29.41%, 250=56.84%, 500=0.02% 00:23:02.775 cpu : usr=0.28%, sys=1.48%, ctx=1388, majf=0, minf=4097 00:23:02.775 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:02.775 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.775 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.775 issued rwts: total=6145,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.775 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.775 job9: (groupid=0, jobs=1): err= 0: pid=1633821: Sat Nov 16 17:42:38 2024 00:23:02.775 read: IOPS=696, BW=174MiB/s (183MB/s)(1746MiB/10024msec) 00:23:02.775 slat (usec): min=9, max=117603, avg=1152.81, stdev=4617.57 00:23:02.775 clat (usec): min=1243, max=239601, avg=90657.61, stdev=50170.33 00:23:02.775 lat (usec): min=1262, max=307364, avg=91810.42, stdev=51040.05 00:23:02.775 clat percentiles (msec): 00:23:02.775 | 1.00th=[ 6], 5.00th=[ 13], 10.00th=[ 22], 20.00th=[ 37], 00:23:02.776 | 30.00th=[ 61], 40.00th=[ 80], 50.00th=[ 92], 60.00th=[ 107], 00:23:02.776 | 70.00th=[ 120], 80.00th=[ 138], 90.00th=[ 157], 95.00th=[ 174], 00:23:02.776 | 99.00th=[ 201], 99.50th=[ 207], 99.90th=[ 226], 99.95th=[ 230], 00:23:02.776 | 99.99th=[ 241] 00:23:02.776 bw ( KiB/s): min=89600, max=277504, per=9.12%, avg=177111.95, stdev=59209.53, samples=20 00:23:02.776 iops : min= 350, max= 1084, avg=691.80, stdev=231.31, samples=20 00:23:02.776 lat (msec) : 2=0.09%, 4=0.49%, 10=3.08%, 20=5.77%, 50=16.47% 00:23:02.776 lat (msec) : 100=29.56%, 250=44.54% 00:23:02.776 cpu : usr=0.35%, sys=2.33%, ctx=1385, majf=0, minf=4097 00:23:02.776 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:23:02.776 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.776 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.776 issued rwts: total=6982,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.776 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.776 job10: (groupid=0, jobs=1): err= 0: pid=1633822: Sat Nov 16 17:42:38 2024 00:23:02.776 read: IOPS=752, BW=188MiB/s (197MB/s)(1899MiB/10096msec) 00:23:02.776 slat (usec): min=8, max=120787, avg=1072.48, stdev=3894.46 00:23:02.776 clat (usec): min=651, max=258697, avg=83918.76, stdev=46991.64 00:23:02.776 lat (usec): min=705, max=258721, avg=84991.24, stdev=47499.65 00:23:02.776 clat percentiles (msec): 00:23:02.776 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 23], 20.00th=[ 43], 00:23:02.776 | 30.00th=[ 56], 40.00th=[ 66], 50.00th=[ 79], 60.00th=[ 94], 00:23:02.776 | 70.00th=[ 114], 80.00th=[ 129], 90.00th=[ 150], 95.00th=[ 163], 00:23:02.776 | 99.00th=[ 184], 99.50th=[ 194], 99.90th=[ 236], 99.95th=[ 236], 00:23:02.776 | 99.99th=[ 259] 00:23:02.776 bw ( KiB/s): min=102400, max=350208, per=9.94%, avg=192842.50, stdev=80035.66, samples=20 00:23:02.776 iops : min= 400, max= 1368, avg=753.20, stdev=312.70, samples=20 00:23:02.776 lat (usec) : 750=0.03%, 1000=0.13% 00:23:02.776 lat (msec) : 2=0.25%, 4=0.67%, 10=2.75%, 20=5.09%, 50=15.82% 00:23:02.776 lat (msec) : 100=38.05%, 250=37.17%, 500=0.03% 00:23:02.776 cpu : usr=0.51%, sys=2.28%, ctx=1519, majf=0, minf=4097 00:23:02.776 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:02.776 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:02.776 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:02.776 issued rwts: total=7597,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:02.776 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:02.776 00:23:02.776 Run status group 0 (all jobs): 00:23:02.776 READ: bw=1896MiB/s (1988MB/s), 139MiB/s-245MiB/s (146MB/s-257MB/s), io=18.7GiB (20.1GB), run=10024-10102msec 00:23:02.776 00:23:02.776 Disk stats (read/write): 00:23:02.776 nvme0n1: ios=11049/0, merge=0/0, ticks=1235647/0, in_queue=1235647, util=97.16% 00:23:02.776 nvme10n1: ios=19412/0, merge=0/0, ticks=1238033/0, in_queue=1238033, util=97.39% 00:23:02.776 nvme1n1: ios=12301/0, merge=0/0, ticks=1229280/0, in_queue=1229280, util=97.68% 00:23:02.776 nvme2n1: ios=13516/0, merge=0/0, ticks=1229955/0, in_queue=1229955, util=97.83% 00:23:02.776 nvme3n1: ios=12887/0, merge=0/0, ticks=1236786/0, in_queue=1236786, util=97.94% 00:23:02.776 nvme4n1: ios=13590/0, merge=0/0, ticks=1227041/0, in_queue=1227041, util=98.30% 00:23:02.776 nvme5n1: ios=15416/0, merge=0/0, ticks=1236277/0, in_queue=1236277, util=98.45% 00:23:02.776 nvme6n1: ios=11983/0, merge=0/0, ticks=1231217/0, in_queue=1231217, util=98.55% 00:23:02.776 nvme7n1: ios=12107/0, merge=0/0, ticks=1240448/0, in_queue=1240448, util=98.91% 00:23:02.776 nvme8n1: ios=13657/0, merge=0/0, ticks=1231599/0, in_queue=1231599, util=99.12% 00:23:02.776 nvme9n1: ios=14961/0, merge=0/0, ticks=1236618/0, in_queue=1236618, util=99.20% 00:23:02.776 17:42:38 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:02.776 [global] 00:23:02.776 thread=1 00:23:02.776 invalidate=1 00:23:02.776 rw=randwrite 00:23:02.776 time_based=1 00:23:02.776 runtime=10 00:23:02.776 ioengine=libaio 00:23:02.776 direct=1 00:23:02.776 bs=262144 00:23:02.776 iodepth=64 00:23:02.776 norandommap=1 00:23:02.776 numjobs=1 00:23:02.776 00:23:02.776 [job0] 00:23:02.776 filename=/dev/nvme0n1 00:23:02.776 [job1] 00:23:02.776 filename=/dev/nvme10n1 00:23:02.776 [job2] 00:23:02.776 filename=/dev/nvme1n1 00:23:02.776 [job3] 00:23:02.776 filename=/dev/nvme2n1 00:23:02.776 [job4] 00:23:02.776 filename=/dev/nvme3n1 00:23:02.776 [job5] 00:23:02.776 filename=/dev/nvme4n1 00:23:02.776 [job6] 00:23:02.776 filename=/dev/nvme5n1 00:23:02.776 [job7] 00:23:02.776 filename=/dev/nvme6n1 00:23:02.776 [job8] 00:23:02.776 filename=/dev/nvme7n1 00:23:02.776 [job9] 00:23:02.776 filename=/dev/nvme8n1 00:23:02.776 [job10] 00:23:02.776 filename=/dev/nvme9n1 00:23:02.776 Could not set queue depth (nvme0n1) 00:23:02.776 Could not set queue depth (nvme10n1) 00:23:02.776 Could not set queue depth (nvme1n1) 00:23:02.776 Could not set queue depth (nvme2n1) 00:23:02.776 Could not set queue depth (nvme3n1) 00:23:02.776 Could not set queue depth (nvme4n1) 00:23:02.776 Could not set queue depth (nvme5n1) 00:23:02.776 Could not set queue depth (nvme6n1) 00:23:02.776 Could not set queue depth (nvme7n1) 00:23:02.776 Could not set queue depth (nvme8n1) 00:23:02.776 Could not set queue depth (nvme9n1) 00:23:02.776 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:02.776 fio-3.35 00:23:02.776 Starting 11 threads 00:23:12.746 00:23:12.746 job0: (groupid=0, jobs=1): err= 0: pid=1634866: Sat Nov 16 17:42:49 2024 00:23:12.746 write: IOPS=441, BW=110MiB/s (116MB/s)(1120MiB/10149msec); 0 zone resets 00:23:12.746 slat (usec): min=15, max=42397, avg=1783.96, stdev=4849.90 00:23:12.746 clat (usec): min=784, max=398663, avg=143159.91, stdev=98713.94 00:23:12.746 lat (usec): min=830, max=398693, avg=144943.87, stdev=100136.13 00:23:12.746 clat percentiles (msec): 00:23:12.746 | 1.00th=[ 3], 5.00th=[ 14], 10.00th=[ 28], 20.00th=[ 46], 00:23:12.746 | 30.00th=[ 73], 40.00th=[ 91], 50.00th=[ 109], 60.00th=[ 180], 00:23:12.746 | 70.00th=[ 213], 80.00th=[ 239], 90.00th=[ 284], 95.00th=[ 317], 00:23:12.746 | 99.00th=[ 376], 99.50th=[ 388], 99.90th=[ 397], 99.95th=[ 401], 00:23:12.746 | 99.99th=[ 401] 00:23:12.746 bw ( KiB/s): min=43008, max=313856, per=8.66%, avg=113031.05, stdev=71948.55, samples=20 00:23:12.746 iops : min= 168, max= 1226, avg=441.50, stdev=281.02, samples=20 00:23:12.746 lat (usec) : 1000=0.16% 00:23:12.746 lat (msec) : 2=0.58%, 4=1.85%, 10=1.45%, 20=2.61%, 50=16.50% 00:23:12.746 lat (msec) : 100=23.00%, 250=38.58%, 500=15.27% 00:23:12.746 cpu : usr=1.40%, sys=1.40%, ctx=2297, majf=0, minf=1 00:23:12.746 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:23:12.746 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.746 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.746 issued rwts: total=0,4479,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.746 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.746 job1: (groupid=0, jobs=1): err= 0: pid=1634867: Sat Nov 16 17:42:49 2024 00:23:12.746 write: IOPS=491, BW=123MiB/s (129MB/s)(1254MiB/10195msec); 0 zone resets 00:23:12.746 slat (usec): min=14, max=181301, avg=1443.71, stdev=5935.40 00:23:12.746 clat (usec): min=911, max=546942, avg=128595.63, stdev=96468.63 00:23:12.746 lat (usec): min=977, max=562234, avg=130039.34, stdev=97398.02 00:23:12.746 clat percentiles (msec): 00:23:12.746 | 1.00th=[ 8], 5.00th=[ 20], 10.00th=[ 31], 20.00th=[ 39], 00:23:12.746 | 30.00th=[ 56], 40.00th=[ 77], 50.00th=[ 107], 60.00th=[ 138], 00:23:12.746 | 70.00th=[ 182], 80.00th=[ 218], 90.00th=[ 264], 95.00th=[ 300], 00:23:12.746 | 99.00th=[ 418], 99.50th=[ 468], 99.90th=[ 535], 99.95th=[ 550], 00:23:12.746 | 99.99th=[ 550] 00:23:12.746 bw ( KiB/s): min=59392, max=248320, per=9.71%, avg=126762.55, stdev=61003.62, samples=20 00:23:12.746 iops : min= 232, max= 970, avg=495.10, stdev=238.29, samples=20 00:23:12.746 lat (usec) : 1000=0.04% 00:23:12.746 lat (msec) : 2=0.30%, 4=0.16%, 10=1.32%, 20=3.69%, 50=22.49% 00:23:12.746 lat (msec) : 100=20.40%, 250=39.24%, 500=12.04%, 750=0.32% 00:23:12.746 cpu : usr=1.54%, sys=1.78%, ctx=2560, majf=0, minf=1 00:23:12.746 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:12.746 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.746 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.746 issued rwts: total=0,5015,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.746 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.746 job2: (groupid=0, jobs=1): err= 0: pid=1634868: Sat Nov 16 17:42:49 2024 00:23:12.746 write: IOPS=542, BW=136MiB/s (142MB/s)(1363MiB/10053msec); 0 zone resets 00:23:12.746 slat (usec): min=20, max=92185, avg=1321.62, stdev=4301.00 00:23:12.746 clat (usec): min=811, max=459280, avg=116564.82, stdev=90981.52 00:23:12.746 lat (usec): min=850, max=459346, avg=117886.45, stdev=92018.81 00:23:12.746 clat percentiles (msec): 00:23:12.746 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 29], 20.00th=[ 42], 00:23:12.746 | 30.00th=[ 51], 40.00th=[ 72], 50.00th=[ 95], 60.00th=[ 114], 00:23:12.746 | 70.00th=[ 138], 80.00th=[ 197], 90.00th=[ 239], 95.00th=[ 296], 00:23:12.746 | 99.00th=[ 409], 99.50th=[ 439], 99.90th=[ 456], 99.95th=[ 460], 00:23:12.746 | 99.99th=[ 460] 00:23:12.746 bw ( KiB/s): min=36352, max=355328, per=10.57%, avg=137967.65, stdev=75651.85, samples=20 00:23:12.746 iops : min= 142, max= 1388, avg=538.80, stdev=295.52, samples=20 00:23:12.746 lat (usec) : 1000=0.04% 00:23:12.746 lat (msec) : 2=0.13%, 4=0.39%, 10=2.26%, 20=3.74%, 50=21.38% 00:23:12.746 lat (msec) : 100=26.54%, 250=36.97%, 500=8.56% 00:23:12.746 cpu : usr=1.77%, sys=1.90%, ctx=2879, majf=0, minf=1 00:23:12.746 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:12.746 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.746 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.746 issued rwts: total=0,5453,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.746 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.746 job3: (groupid=0, jobs=1): err= 0: pid=1634878: Sat Nov 16 17:42:49 2024 00:23:12.746 write: IOPS=380, BW=95.2MiB/s (99.8MB/s)(970MiB/10196msec); 0 zone resets 00:23:12.746 slat (usec): min=17, max=140183, avg=2035.79, stdev=5430.17 00:23:12.746 clat (usec): min=856, max=503148, avg=166021.78, stdev=88192.76 00:23:12.746 lat (usec): min=931, max=503200, avg=168057.58, stdev=89346.89 00:23:12.746 clat percentiles (msec): 00:23:12.746 | 1.00th=[ 5], 5.00th=[ 23], 10.00th=[ 54], 20.00th=[ 105], 00:23:12.746 | 30.00th=[ 123], 40.00th=[ 140], 50.00th=[ 157], 60.00th=[ 180], 00:23:12.746 | 70.00th=[ 211], 80.00th=[ 232], 90.00th=[ 253], 95.00th=[ 351], 00:23:12.746 | 99.00th=[ 422], 99.50th=[ 435], 99.90th=[ 485], 99.95th=[ 502], 00:23:12.746 | 99.99th=[ 502] 00:23:12.746 bw ( KiB/s): min=38912, max=187904, per=7.49%, avg=97720.60, stdev=36721.57, samples=20 00:23:12.746 iops : min= 152, max= 734, avg=381.70, stdev=143.44, samples=20 00:23:12.746 lat (usec) : 1000=0.08% 00:23:12.746 lat (msec) : 2=0.23%, 4=0.62%, 10=1.83%, 20=1.78%, 50=4.90% 00:23:12.746 lat (msec) : 100=9.64%, 250=70.29%, 500=10.56%, 750=0.08% 00:23:12.746 cpu : usr=1.00%, sys=1.20%, ctx=1872, majf=0, minf=1 00:23:12.746 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:23:12.746 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.746 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.746 issued rwts: total=0,3881,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.746 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.746 job4: (groupid=0, jobs=1): err= 0: pid=1634881: Sat Nov 16 17:42:49 2024 00:23:12.746 write: IOPS=402, BW=101MiB/s (106MB/s)(1020MiB/10126msec); 0 zone resets 00:23:12.746 slat (usec): min=19, max=48375, avg=2294.03, stdev=4895.27 00:23:12.747 clat (usec): min=1785, max=398414, avg=156496.42, stdev=77421.52 00:23:12.747 lat (usec): min=1826, max=398458, avg=158790.45, stdev=78554.34 00:23:12.747 clat percentiles (msec): 00:23:12.747 | 1.00th=[ 6], 5.00th=[ 37], 10.00th=[ 85], 20.00th=[ 99], 00:23:12.747 | 30.00th=[ 114], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 161], 00:23:12.747 | 70.00th=[ 190], 80.00th=[ 211], 90.00th=[ 275], 95.00th=[ 313], 00:23:12.747 | 99.00th=[ 376], 99.50th=[ 393], 99.90th=[ 397], 99.95th=[ 397], 00:23:12.747 | 99.99th=[ 397] 00:23:12.747 bw ( KiB/s): min=43008, max=172544, per=7.87%, avg=102793.50, stdev=40855.43, samples=20 00:23:12.747 iops : min= 168, max= 674, avg=401.50, stdev=159.54, samples=20 00:23:12.747 lat (msec) : 2=0.05%, 4=0.34%, 10=2.18%, 20=1.81%, 50=1.13% 00:23:12.747 lat (msec) : 100=15.54%, 250=66.93%, 500=12.01% 00:23:12.747 cpu : usr=1.23%, sys=1.39%, ctx=1411, majf=0, minf=1 00:23:12.747 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:23:12.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.747 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.747 issued rwts: total=0,4079,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.747 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.747 job5: (groupid=0, jobs=1): err= 0: pid=1634884: Sat Nov 16 17:42:49 2024 00:23:12.747 write: IOPS=304, BW=76.0MiB/s (79.7MB/s)(775MiB/10198msec); 0 zone resets 00:23:12.747 slat (usec): min=17, max=69960, avg=2897.02, stdev=6615.27 00:23:12.747 clat (msec): min=3, max=438, avg=207.46, stdev=88.97 00:23:12.747 lat (msec): min=4, max=453, avg=210.35, stdev=90.12 00:23:12.747 clat percentiles (msec): 00:23:12.747 | 1.00th=[ 11], 5.00th=[ 29], 10.00th=[ 93], 20.00th=[ 140], 00:23:12.747 | 30.00th=[ 161], 40.00th=[ 201], 50.00th=[ 215], 60.00th=[ 228], 00:23:12.747 | 70.00th=[ 239], 80.00th=[ 268], 90.00th=[ 326], 95.00th=[ 363], 00:23:12.747 | 99.00th=[ 426], 99.50th=[ 430], 99.90th=[ 439], 99.95th=[ 439], 00:23:12.747 | 99.99th=[ 439] 00:23:12.747 bw ( KiB/s): min=46080, max=116736, per=5.96%, avg=77737.35, stdev=21448.68, samples=20 00:23:12.747 iops : min= 180, max= 456, avg=303.65, stdev=83.77, samples=20 00:23:12.747 lat (msec) : 4=0.03%, 10=0.81%, 20=2.90%, 50=2.87%, 100=3.93% 00:23:12.747 lat (msec) : 250=64.56%, 500=24.90% 00:23:12.747 cpu : usr=1.04%, sys=0.97%, ctx=1223, majf=0, minf=1 00:23:12.747 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.3%, 16=0.5%, 32=1.0%, >=64=98.0% 00:23:12.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.747 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.747 issued rwts: total=0,3101,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.747 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.747 job6: (groupid=0, jobs=1): err= 0: pid=1634885: Sat Nov 16 17:42:49 2024 00:23:12.747 write: IOPS=532, BW=133MiB/s (139MB/s)(1356MiB/10191msec); 0 zone resets 00:23:12.747 slat (usec): min=18, max=70387, avg=1265.27, stdev=4114.55 00:23:12.747 clat (usec): min=921, max=435741, avg=118970.77, stdev=95958.10 00:23:12.747 lat (usec): min=980, max=448529, avg=120236.04, stdev=97049.51 00:23:12.747 clat percentiles (usec): 00:23:12.747 | 1.00th=[ 1909], 5.00th=[ 5080], 10.00th=[ 8979], 20.00th=[ 27395], 00:23:12.747 | 30.00th=[ 51119], 40.00th=[ 80217], 50.00th=[106431], 60.00th=[125305], 00:23:12.747 | 70.00th=[154141], 80.00th=[189793], 90.00th=[244319], 95.00th=[320865], 00:23:12.747 | 99.00th=[396362], 99.50th=[404751], 99.90th=[421528], 99.95th=[434111], 00:23:12.747 | 99.99th=[434111] 00:23:12.747 bw ( KiB/s): min=40448, max=299008, per=10.51%, avg=137167.65, stdev=59089.91, samples=20 00:23:12.747 iops : min= 158, max= 1168, avg=535.75, stdev=230.83, samples=20 00:23:12.747 lat (usec) : 1000=0.07% 00:23:12.747 lat (msec) : 2=0.96%, 4=2.31%, 10=7.71%, 20=5.68%, 50=12.74% 00:23:12.747 lat (msec) : 100=18.42%, 250=42.55%, 500=9.55% 00:23:12.747 cpu : usr=1.39%, sys=1.85%, ctx=3237, majf=0, minf=1 00:23:12.747 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:12.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.747 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.747 issued rwts: total=0,5422,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.747 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.747 job7: (groupid=0, jobs=1): err= 0: pid=1634886: Sat Nov 16 17:42:49 2024 00:23:12.747 write: IOPS=349, BW=87.4MiB/s (91.7MB/s)(886MiB/10130msec); 0 zone resets 00:23:12.747 slat (usec): min=24, max=41656, avg=2469.00, stdev=5552.21 00:23:12.747 clat (usec): min=1321, max=409627, avg=180373.95, stdev=82024.15 00:23:12.747 lat (usec): min=1948, max=409660, avg=182842.96, stdev=83319.00 00:23:12.747 clat percentiles (msec): 00:23:12.747 | 1.00th=[ 8], 5.00th=[ 35], 10.00th=[ 66], 20.00th=[ 117], 00:23:12.747 | 30.00th=[ 140], 40.00th=[ 155], 50.00th=[ 186], 60.00th=[ 203], 00:23:12.747 | 70.00th=[ 224], 80.00th=[ 245], 90.00th=[ 288], 95.00th=[ 321], 00:23:12.747 | 99.00th=[ 388], 99.50th=[ 401], 99.90th=[ 409], 99.95th=[ 409], 00:23:12.747 | 99.99th=[ 409] 00:23:12.747 bw ( KiB/s): min=40960, max=150016, per=6.82%, avg=89081.30, stdev=30960.16, samples=20 00:23:12.747 iops : min= 160, max= 586, avg=347.90, stdev=120.90, samples=20 00:23:12.747 lat (msec) : 2=0.06%, 4=0.42%, 10=0.59%, 20=0.59%, 50=5.08% 00:23:12.747 lat (msec) : 100=8.64%, 250=66.72%, 500=17.89% 00:23:12.747 cpu : usr=1.16%, sys=1.22%, ctx=1504, majf=0, minf=1 00:23:12.747 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=0.9%, >=64=98.2% 00:23:12.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.747 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.747 issued rwts: total=0,3543,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.747 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.747 job8: (groupid=0, jobs=1): err= 0: pid=1634889: Sat Nov 16 17:42:49 2024 00:23:12.747 write: IOPS=629, BW=157MiB/s (165MB/s)(1604MiB/10195msec); 0 zone resets 00:23:12.747 slat (usec): min=20, max=41123, avg=1441.97, stdev=3127.74 00:23:12.747 clat (usec): min=822, max=409433, avg=100182.82, stdev=59133.91 00:23:12.747 lat (usec): min=844, max=409473, avg=101624.79, stdev=59847.04 00:23:12.747 clat percentiles (msec): 00:23:12.747 | 1.00th=[ 4], 5.00th=[ 20], 10.00th=[ 44], 20.00th=[ 48], 00:23:12.747 | 30.00th=[ 63], 40.00th=[ 80], 50.00th=[ 85], 60.00th=[ 107], 00:23:12.747 | 70.00th=[ 120], 80.00th=[ 146], 90.00th=[ 192], 95.00th=[ 211], 00:23:12.747 | 99.00th=[ 255], 99.50th=[ 313], 99.90th=[ 388], 99.95th=[ 397], 00:23:12.747 | 99.99th=[ 409] 00:23:12.747 bw ( KiB/s): min=76288, max=295424, per=12.46%, avg=162653.05, stdev=66895.17, samples=20 00:23:12.747 iops : min= 298, max= 1154, avg=635.30, stdev=261.35, samples=20 00:23:12.747 lat (usec) : 1000=0.11% 00:23:12.747 lat (msec) : 2=0.44%, 4=0.67%, 10=2.10%, 20=1.84%, 50=20.38% 00:23:12.747 lat (msec) : 100=32.65%, 250=40.60%, 500=1.22% 00:23:12.747 cpu : usr=2.20%, sys=2.09%, ctx=2115, majf=0, minf=2 00:23:12.747 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:12.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.747 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.747 issued rwts: total=0,6417,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.747 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.747 job9: (groupid=0, jobs=1): err= 0: pid=1634890: Sat Nov 16 17:42:49 2024 00:23:12.747 write: IOPS=570, BW=143MiB/s (149MB/s)(1443MiB/10125msec); 0 zone resets 00:23:12.747 slat (usec): min=16, max=40055, avg=1473.52, stdev=3342.53 00:23:12.747 clat (usec): min=894, max=349558, avg=110730.32, stdev=60790.58 00:23:12.747 lat (usec): min=936, max=349600, avg=112203.84, stdev=61506.84 00:23:12.747 clat percentiles (msec): 00:23:12.747 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 27], 20.00th=[ 46], 00:23:12.747 | 30.00th=[ 92], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 122], 00:23:12.747 | 70.00th=[ 133], 80.00th=[ 153], 90.00th=[ 186], 95.00th=[ 222], 00:23:12.747 | 99.00th=[ 288], 99.50th=[ 305], 99.90th=[ 338], 99.95th=[ 342], 00:23:12.747 | 99.99th=[ 351] 00:23:12.747 bw ( KiB/s): min=77824, max=366592, per=11.20%, avg=146147.70, stdev=71567.75, samples=20 00:23:12.747 iops : min= 304, max= 1432, avg=570.80, stdev=279.57, samples=20 00:23:12.747 lat (usec) : 1000=0.07% 00:23:12.747 lat (msec) : 2=0.31%, 4=1.00%, 10=2.96%, 20=3.78%, 50=12.84% 00:23:12.747 lat (msec) : 100=19.79%, 250=57.10%, 500=2.15% 00:23:12.747 cpu : usr=1.66%, sys=1.92%, ctx=2529, majf=0, minf=1 00:23:12.747 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:12.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.747 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.747 issued rwts: total=0,5772,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.747 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.747 job10: (groupid=0, jobs=1): err= 0: pid=1634891: Sat Nov 16 17:42:49 2024 00:23:12.747 write: IOPS=477, BW=119MiB/s (125MB/s)(1209MiB/10126msec); 0 zone resets 00:23:12.747 slat (usec): min=14, max=156624, avg=1564.34, stdev=5335.58 00:23:12.747 clat (usec): min=964, max=516014, avg=132291.41, stdev=103130.26 00:23:12.747 lat (usec): min=1008, max=516051, avg=133855.75, stdev=104506.79 00:23:12.747 clat percentiles (msec): 00:23:12.747 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 17], 20.00th=[ 41], 00:23:12.747 | 30.00th=[ 56], 40.00th=[ 88], 50.00th=[ 114], 60.00th=[ 150], 00:23:12.747 | 70.00th=[ 182], 80.00th=[ 205], 90.00th=[ 271], 95.00th=[ 317], 00:23:12.747 | 99.00th=[ 464], 99.50th=[ 485], 99.90th=[ 502], 99.95th=[ 506], 00:23:12.747 | 99.99th=[ 518] 00:23:12.747 bw ( KiB/s): min=43008, max=272929, per=9.36%, avg=122223.80, stdev=57897.46, samples=20 00:23:12.747 iops : min= 168, max= 1066, avg=477.40, stdev=226.17, samples=20 00:23:12.747 lat (usec) : 1000=0.04% 00:23:12.747 lat (msec) : 2=0.70%, 4=1.67%, 10=3.70%, 20=5.64%, 50=15.86% 00:23:12.747 lat (msec) : 100=17.18%, 250=43.81%, 500=11.29%, 750=0.10% 00:23:12.747 cpu : usr=1.18%, sys=1.70%, ctx=2738, majf=0, minf=1 00:23:12.747 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:12.747 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:12.747 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:12.747 issued rwts: total=0,4837,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:12.747 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:12.747 00:23:12.747 Run status group 0 (all jobs): 00:23:12.748 WRITE: bw=1275MiB/s (1337MB/s), 76.0MiB/s-157MiB/s (79.7MB/s-165MB/s), io=12.7GiB (13.6GB), run=10053-10198msec 00:23:12.748 00:23:12.748 Disk stats (read/write): 00:23:12.748 nvme0n1: ios=49/8724, merge=0/0, ticks=33/1214949, in_queue=1214982, util=97.27% 00:23:12.748 nvme10n1: ios=47/10016, merge=0/0, ticks=3094/1206513, in_queue=1209607, util=99.77% 00:23:12.748 nvme1n1: ios=49/10663, merge=0/0, ticks=1949/1221833, in_queue=1223782, util=99.94% 00:23:12.748 nvme2n1: ios=46/7748, merge=0/0, ticks=30/1243167, in_queue=1243197, util=97.94% 00:23:12.748 nvme3n1: ios=45/7977, merge=0/0, ticks=1239/1208104, in_queue=1209343, util=100.00% 00:23:12.748 nvme4n1: ios=0/6164, merge=0/0, ticks=0/1234252, in_queue=1234252, util=98.15% 00:23:12.748 nvme5n1: ios=0/10831, merge=0/0, ticks=0/1247518, in_queue=1247518, util=98.33% 00:23:12.748 nvme6n1: ios=35/6906, merge=0/0, ticks=882/1212097, in_queue=1212979, util=100.00% 00:23:12.748 nvme7n1: ios=0/12820, merge=0/0, ticks=0/1236172, in_queue=1236172, util=98.86% 00:23:12.748 nvme8n1: ios=39/11359, merge=0/0, ticks=1422/1211642, in_queue=1213064, util=100.00% 00:23:12.748 nvme9n1: ios=40/9445, merge=0/0, ticks=652/1221043, in_queue=1221695, util=100.00% 00:23:12.748 17:42:49 -- target/multiconnection.sh@36 -- # sync 00:23:12.748 17:42:49 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:12.748 17:42:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.748 17:42:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:12.748 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:12.748 17:42:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:12.748 17:42:49 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.748 17:42:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.748 17:42:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:12.748 17:42:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.748 17:42:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:12.748 17:42:49 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.748 17:42:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:12.748 17:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.748 17:42:49 -- common/autotest_common.sh@10 -- # set +x 00:23:12.748 17:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.748 17:42:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.748 17:42:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:12.748 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:12.748 17:42:49 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:12.748 17:42:49 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.748 17:42:49 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.748 17:42:49 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:12.748 17:42:49 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.748 17:42:49 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:12.748 17:42:49 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.748 17:42:49 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:12.748 17:42:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.748 17:42:49 -- common/autotest_common.sh@10 -- # set +x 00:23:12.748 17:42:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.748 17:42:49 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.748 17:42:49 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:13.006 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:13.006 17:42:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:13.006 17:42:50 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.006 17:42:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.006 17:42:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:13.006 17:42:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.006 17:42:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:13.006 17:42:50 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.006 17:42:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:13.006 17:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.006 17:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:13.006 17:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.006 17:42:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.006 17:42:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:13.264 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:13.264 17:42:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:13.264 17:42:50 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.264 17:42:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.264 17:42:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:13.264 17:42:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.264 17:42:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:13.264 17:42:50 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.264 17:42:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:13.264 17:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.264 17:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:13.264 17:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.264 17:42:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.264 17:42:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:13.522 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:13.522 17:42:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:13.522 17:42:50 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.522 17:42:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.522 17:42:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:13.522 17:42:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.522 17:42:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:13.522 17:42:50 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.522 17:42:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:13.522 17:42:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.522 17:42:50 -- common/autotest_common.sh@10 -- # set +x 00:23:13.522 17:42:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.522 17:42:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.522 17:42:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:13.780 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:13.780 17:42:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:13.780 17:42:51 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.780 17:42:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.780 17:42:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:13.780 17:42:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.780 17:42:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:13.780 17:42:51 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.780 17:42:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:13.780 17:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.780 17:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:13.780 17:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.780 17:42:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.780 17:42:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:13.780 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:13.780 17:42:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:13.780 17:42:51 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.780 17:42:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.780 17:42:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:13.780 17:42:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.780 17:42:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:13.780 17:42:51 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.780 17:42:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:13.780 17:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.780 17:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:14.039 17:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.039 17:42:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.039 17:42:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:14.039 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:14.039 17:42:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:14.039 17:42:51 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.039 17:42:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.039 17:42:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:14.039 17:42:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.039 17:42:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:14.039 17:42:51 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.039 17:42:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:14.039 17:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.039 17:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:14.297 17:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.297 17:42:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.297 17:42:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:14.297 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:14.297 17:42:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:14.297 17:42:51 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.297 17:42:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.297 17:42:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:14.297 17:42:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.297 17:42:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:14.297 17:42:51 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.297 17:42:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:14.297 17:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.297 17:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:14.297 17:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.297 17:42:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.297 17:42:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:14.297 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:14.297 17:42:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:14.297 17:42:51 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.297 17:42:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.297 17:42:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:14.556 17:42:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.556 17:42:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:14.556 17:42:51 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.556 17:42:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:14.556 17:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.556 17:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:14.556 17:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.556 17:42:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:14.556 17:42:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:14.556 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:14.556 17:42:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:14.556 17:42:51 -- common/autotest_common.sh@1208 -- # local i=0 00:23:14.556 17:42:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:14.556 17:42:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:14.556 17:42:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:14.556 17:42:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:14.556 17:42:51 -- common/autotest_common.sh@1220 -- # return 0 00:23:14.556 17:42:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:14.556 17:42:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.556 17:42:51 -- common/autotest_common.sh@10 -- # set +x 00:23:14.556 17:42:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.556 17:42:51 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:14.556 17:42:51 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:14.556 17:42:51 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:14.556 17:42:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:14.556 17:42:51 -- nvmf/common.sh@116 -- # sync 00:23:14.556 17:42:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:14.556 17:42:51 -- nvmf/common.sh@119 -- # set +e 00:23:14.556 17:42:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:14.556 17:42:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:14.556 rmmod nvme_tcp 00:23:14.556 rmmod nvme_fabrics 00:23:14.556 rmmod nvme_keyring 00:23:14.556 17:42:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:14.556 17:42:51 -- nvmf/common.sh@123 -- # set -e 00:23:14.556 17:42:51 -- nvmf/common.sh@124 -- # return 0 00:23:14.556 17:42:51 -- nvmf/common.sh@477 -- # '[' -n 1628655 ']' 00:23:14.556 17:42:51 -- nvmf/common.sh@478 -- # killprocess 1628655 00:23:14.556 17:42:51 -- common/autotest_common.sh@936 -- # '[' -z 1628655 ']' 00:23:14.556 17:42:51 -- common/autotest_common.sh@940 -- # kill -0 1628655 00:23:14.556 17:42:51 -- common/autotest_common.sh@941 -- # uname 00:23:14.556 17:42:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:14.556 17:42:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1628655 00:23:14.556 17:42:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:14.556 17:42:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:14.556 17:42:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1628655' 00:23:14.556 killing process with pid 1628655 00:23:14.556 17:42:51 -- common/autotest_common.sh@955 -- # kill 1628655 00:23:14.556 17:42:51 -- common/autotest_common.sh@960 -- # wait 1628655 00:23:15.123 17:42:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:15.123 17:42:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:15.123 17:42:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:15.123 17:42:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:15.123 17:42:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:15.123 17:42:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:15.123 17:42:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:15.123 17:42:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.657 17:42:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:17.657 00:23:17.657 real 1m1.651s 00:23:17.657 user 3m26.534s 00:23:17.657 sys 0m25.184s 00:23:17.657 17:42:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:17.657 17:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:17.657 ************************************ 00:23:17.657 END TEST nvmf_multiconnection 00:23:17.657 ************************************ 00:23:17.657 17:42:54 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:17.657 17:42:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:17.657 17:42:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:17.657 17:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:17.657 ************************************ 00:23:17.657 START TEST nvmf_initiator_timeout 00:23:17.657 ************************************ 00:23:17.657 17:42:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:17.657 * Looking for test storage... 00:23:17.657 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:17.657 17:42:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:17.657 17:42:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:17.657 17:42:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:17.657 17:42:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:17.657 17:42:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:17.657 17:42:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:17.657 17:42:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:17.657 17:42:54 -- scripts/common.sh@335 -- # IFS=.-: 00:23:17.657 17:42:54 -- scripts/common.sh@335 -- # read -ra ver1 00:23:17.658 17:42:54 -- scripts/common.sh@336 -- # IFS=.-: 00:23:17.658 17:42:54 -- scripts/common.sh@336 -- # read -ra ver2 00:23:17.658 17:42:54 -- scripts/common.sh@337 -- # local 'op=<' 00:23:17.658 17:42:54 -- scripts/common.sh@339 -- # ver1_l=2 00:23:17.658 17:42:54 -- scripts/common.sh@340 -- # ver2_l=1 00:23:17.658 17:42:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:17.658 17:42:54 -- scripts/common.sh@343 -- # case "$op" in 00:23:17.658 17:42:54 -- scripts/common.sh@344 -- # : 1 00:23:17.658 17:42:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:17.658 17:42:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:17.658 17:42:54 -- scripts/common.sh@364 -- # decimal 1 00:23:17.658 17:42:54 -- scripts/common.sh@352 -- # local d=1 00:23:17.658 17:42:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:17.658 17:42:54 -- scripts/common.sh@354 -- # echo 1 00:23:17.658 17:42:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:17.658 17:42:54 -- scripts/common.sh@365 -- # decimal 2 00:23:17.658 17:42:54 -- scripts/common.sh@352 -- # local d=2 00:23:17.658 17:42:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:17.658 17:42:54 -- scripts/common.sh@354 -- # echo 2 00:23:17.658 17:42:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:17.658 17:42:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:17.658 17:42:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:17.658 17:42:54 -- scripts/common.sh@367 -- # return 0 00:23:17.658 17:42:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:17.658 17:42:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:17.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.658 --rc genhtml_branch_coverage=1 00:23:17.658 --rc genhtml_function_coverage=1 00:23:17.658 --rc genhtml_legend=1 00:23:17.658 --rc geninfo_all_blocks=1 00:23:17.658 --rc geninfo_unexecuted_blocks=1 00:23:17.658 00:23:17.658 ' 00:23:17.658 17:42:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:17.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.658 --rc genhtml_branch_coverage=1 00:23:17.658 --rc genhtml_function_coverage=1 00:23:17.658 --rc genhtml_legend=1 00:23:17.658 --rc geninfo_all_blocks=1 00:23:17.658 --rc geninfo_unexecuted_blocks=1 00:23:17.658 00:23:17.658 ' 00:23:17.658 17:42:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:17.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.658 --rc genhtml_branch_coverage=1 00:23:17.658 --rc genhtml_function_coverage=1 00:23:17.658 --rc genhtml_legend=1 00:23:17.658 --rc geninfo_all_blocks=1 00:23:17.658 --rc geninfo_unexecuted_blocks=1 00:23:17.658 00:23:17.658 ' 00:23:17.658 17:42:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:17.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.658 --rc genhtml_branch_coverage=1 00:23:17.658 --rc genhtml_function_coverage=1 00:23:17.658 --rc genhtml_legend=1 00:23:17.658 --rc geninfo_all_blocks=1 00:23:17.658 --rc geninfo_unexecuted_blocks=1 00:23:17.658 00:23:17.658 ' 00:23:17.658 17:42:54 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:17.658 17:42:54 -- nvmf/common.sh@7 -- # uname -s 00:23:17.658 17:42:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:17.658 17:42:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:17.658 17:42:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:17.658 17:42:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:17.658 17:42:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:17.658 17:42:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:17.658 17:42:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:17.658 17:42:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:17.658 17:42:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:17.658 17:42:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:17.658 17:42:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.658 17:42:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.658 17:42:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:17.658 17:42:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:17.658 17:42:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:17.658 17:42:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:17.658 17:42:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:17.658 17:42:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:17.658 17:42:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:17.658 17:42:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.658 17:42:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.658 17:42:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.658 17:42:54 -- paths/export.sh@5 -- # export PATH 00:23:17.658 17:42:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.658 17:42:54 -- nvmf/common.sh@46 -- # : 0 00:23:17.658 17:42:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:17.658 17:42:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:17.658 17:42:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:17.658 17:42:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:17.658 17:42:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:17.658 17:42:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:17.658 17:42:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:17.658 17:42:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:17.658 17:42:54 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:17.658 17:42:54 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:17.658 17:42:54 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:17.658 17:42:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:17.658 17:42:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:17.658 17:42:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:17.658 17:42:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:17.658 17:42:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:17.658 17:42:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:17.658 17:42:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:17.658 17:42:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.658 17:42:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:17.658 17:42:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:17.658 17:42:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:17.658 17:42:54 -- common/autotest_common.sh@10 -- # set +x 00:23:19.561 17:42:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:19.561 17:42:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:19.561 17:42:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:19.561 17:42:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:19.561 17:42:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:19.561 17:42:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:19.561 17:42:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:19.561 17:42:56 -- nvmf/common.sh@294 -- # net_devs=() 00:23:19.561 17:42:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:19.561 17:42:56 -- nvmf/common.sh@295 -- # e810=() 00:23:19.561 17:42:56 -- nvmf/common.sh@295 -- # local -ga e810 00:23:19.561 17:42:56 -- nvmf/common.sh@296 -- # x722=() 00:23:19.561 17:42:56 -- nvmf/common.sh@296 -- # local -ga x722 00:23:19.561 17:42:56 -- nvmf/common.sh@297 -- # mlx=() 00:23:19.561 17:42:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:19.561 17:42:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:19.561 17:42:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:19.561 17:42:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:19.561 17:42:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:19.561 17:42:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.561 17:42:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:19.561 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:19.561 17:42:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.561 17:42:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:19.561 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:19.561 17:42:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:19.561 17:42:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.561 17:42:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.561 17:42:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.561 17:42:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.561 17:42:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:19.561 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:19.561 17:42:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.561 17:42:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.561 17:42:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.561 17:42:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.561 17:42:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.561 17:42:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:19.561 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:19.561 17:42:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.561 17:42:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:19.561 17:42:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:19.561 17:42:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:19.561 17:42:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:19.561 17:42:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:19.561 17:42:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:19.561 17:42:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:19.561 17:42:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:19.561 17:42:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:19.561 17:42:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:19.561 17:42:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:19.561 17:42:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:19.561 17:42:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:19.561 17:42:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:19.561 17:42:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:19.561 17:42:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:19.561 17:42:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:19.561 17:42:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:19.561 17:42:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:19.561 17:42:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:19.561 17:42:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:19.561 17:42:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:19.561 17:42:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:19.561 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:19.561 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.158 ms 00:23:19.561 00:23:19.561 --- 10.0.0.2 ping statistics --- 00:23:19.561 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.561 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:23:19.561 17:42:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:19.561 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:19.561 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:23:19.561 00:23:19.561 --- 10.0.0.1 ping statistics --- 00:23:19.561 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.561 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:23:19.561 17:42:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:19.561 17:42:56 -- nvmf/common.sh@410 -- # return 0 00:23:19.561 17:42:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:19.561 17:42:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:19.561 17:42:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:19.561 17:42:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:19.561 17:42:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:19.561 17:42:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:19.561 17:42:56 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:19.561 17:42:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:19.561 17:42:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:19.561 17:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:19.561 17:42:56 -- nvmf/common.sh@469 -- # nvmfpid=1638288 00:23:19.562 17:42:56 -- nvmf/common.sh@470 -- # waitforlisten 1638288 00:23:19.562 17:42:56 -- common/autotest_common.sh@829 -- # '[' -z 1638288 ']' 00:23:19.562 17:42:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:19.562 17:42:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:19.562 17:42:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:19.562 17:42:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:19.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:19.562 17:42:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:19.562 17:42:56 -- common/autotest_common.sh@10 -- # set +x 00:23:19.562 [2024-11-16 17:42:56.993475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:19.562 [2024-11-16 17:42:56.993568] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:19.562 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.820 [2024-11-16 17:42:57.063908] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:19.820 [2024-11-16 17:42:57.159080] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:19.820 [2024-11-16 17:42:57.159264] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:19.820 [2024-11-16 17:42:57.159286] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:19.820 [2024-11-16 17:42:57.159302] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:19.820 [2024-11-16 17:42:57.159398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:19.820 [2024-11-16 17:42:57.159455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:19.820 [2024-11-16 17:42:57.159520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:19.820 [2024-11-16 17:42:57.159524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:20.755 17:42:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:20.755 17:42:57 -- common/autotest_common.sh@862 -- # return 0 00:23:20.755 17:42:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:20.755 17:42:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:20.755 17:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:20.755 17:42:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:20.755 17:42:57 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:20.755 17:42:57 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:20.755 17:42:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.755 17:42:57 -- common/autotest_common.sh@10 -- # set +x 00:23:20.755 Malloc0 00:23:20.755 17:42:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.755 17:42:58 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:20.755 17:42:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.755 17:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:20.755 Delay0 00:23:20.755 17:42:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.755 17:42:58 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:20.755 17:42:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.755 17:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:20.755 [2024-11-16 17:42:58.032124] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:20.755 17:42:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.755 17:42:58 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:20.755 17:42:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.755 17:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:20.755 17:42:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.755 17:42:58 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:20.755 17:42:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.755 17:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:20.755 17:42:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.755 17:42:58 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:20.755 17:42:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.755 17:42:58 -- common/autotest_common.sh@10 -- # set +x 00:23:20.755 [2024-11-16 17:42:58.060364] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:20.755 17:42:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.755 17:42:58 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:21.320 17:42:58 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:21.320 17:42:58 -- common/autotest_common.sh@1187 -- # local i=0 00:23:21.320 17:42:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:21.320 17:42:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:21.320 17:42:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:23.217 17:43:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:23.217 17:43:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:23.217 17:43:00 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:23.217 17:43:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:23.217 17:43:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:23.217 17:43:00 -- common/autotest_common.sh@1197 -- # return 0 00:23:23.217 17:43:00 -- target/initiator_timeout.sh@35 -- # fio_pid=1638857 00:23:23.217 17:43:00 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:23.217 17:43:00 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:23.217 [global] 00:23:23.217 thread=1 00:23:23.217 invalidate=1 00:23:23.217 rw=write 00:23:23.217 time_based=1 00:23:23.217 runtime=60 00:23:23.217 ioengine=libaio 00:23:23.217 direct=1 00:23:23.217 bs=4096 00:23:23.217 iodepth=1 00:23:23.217 norandommap=0 00:23:23.217 numjobs=1 00:23:23.217 00:23:23.217 verify_dump=1 00:23:23.217 verify_backlog=512 00:23:23.217 verify_state_save=0 00:23:23.217 do_verify=1 00:23:23.217 verify=crc32c-intel 00:23:23.217 [job0] 00:23:23.217 filename=/dev/nvme0n1 00:23:23.217 Could not set queue depth (nvme0n1) 00:23:23.475 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:23.475 fio-3.35 00:23:23.475 Starting 1 thread 00:23:26.756 17:43:03 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:26.756 17:43:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:26.756 17:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:26.756 true 00:23:26.756 17:43:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:26.756 17:43:03 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:26.756 17:43:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:26.756 17:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:26.756 true 00:23:26.756 17:43:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:26.756 17:43:03 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:26.756 17:43:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:26.756 17:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:26.756 true 00:23:26.756 17:43:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:26.756 17:43:03 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:26.756 17:43:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:26.756 17:43:03 -- common/autotest_common.sh@10 -- # set +x 00:23:26.756 true 00:23:26.756 17:43:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:26.756 17:43:03 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:29.282 17:43:06 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:29.282 17:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.282 17:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:29.282 true 00:23:29.282 17:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.282 17:43:06 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:29.282 17:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.282 17:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:29.283 true 00:23:29.283 17:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.283 17:43:06 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:29.283 17:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.283 17:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:29.283 true 00:23:29.283 17:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.283 17:43:06 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:29.283 17:43:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:29.283 17:43:06 -- common/autotest_common.sh@10 -- # set +x 00:23:29.283 true 00:23:29.283 17:43:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:29.283 17:43:06 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:29.283 17:43:06 -- target/initiator_timeout.sh@54 -- # wait 1638857 00:24:25.491 00:24:25.491 job0: (groupid=0, jobs=1): err= 0: pid=1638929: Sat Nov 16 17:44:01 2024 00:24:25.491 read: IOPS=8, BW=33.0KiB/s (33.8kB/s)(1984KiB/60042msec) 00:24:25.491 slat (nsec): min=5978, max=37695, avg=22108.68, stdev=9880.22 00:24:25.491 clat (usec): min=222, max=41117k, avg=120787.62, stdev=1844521.33 00:24:25.491 lat (usec): min=228, max=41117k, avg=120809.73, stdev=1844521.81 00:24:25.491 clat percentiles (usec): 00:24:25.491 | 1.00th=[ 233], 5.00th=[ 260], 10.00th=[ 40633], 00:24:25.491 | 20.00th=[ 41157], 30.00th=[ 41681], 40.00th=[ 41681], 00:24:25.491 | 50.00th=[ 42206], 60.00th=[ 42206], 70.00th=[ 42206], 00:24:25.491 | 80.00th=[ 42206], 90.00th=[ 42206], 95.00th=[ 42206], 00:24:25.491 | 99.00th=[ 44827], 99.50th=[ 45876], 99.90th=[17112761], 00:24:25.491 | 99.95th=[17112761], 99.99th=[17112761] 00:24:25.491 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(2048KiB/60042msec); 0 zone resets 00:24:25.491 slat (nsec): min=6923, max=56800, avg=15401.05, stdev=8016.65 00:24:25.491 clat (usec): min=169, max=386, avg=207.91, stdev=27.77 00:24:25.491 lat (usec): min=176, max=421, avg=223.31, stdev=33.03 00:24:25.491 clat percentiles (usec): 00:24:25.491 | 1.00th=[ 176], 5.00th=[ 180], 10.00th=[ 182], 20.00th=[ 186], 00:24:25.491 | 30.00th=[ 190], 40.00th=[ 198], 50.00th=[ 204], 60.00th=[ 212], 00:24:25.491 | 70.00th=[ 217], 80.00th=[ 223], 90.00th=[ 235], 95.00th=[ 253], 00:24:25.491 | 99.00th=[ 326], 99.50th=[ 338], 99.90th=[ 388], 99.95th=[ 388], 00:24:25.491 | 99.99th=[ 388] 00:24:25.491 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:24:25.491 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:24:25.491 lat (usec) : 250=49.50%, 500=5.85% 00:24:25.491 lat (msec) : 50=44.54%, >=2000=0.10% 00:24:25.491 cpu : usr=0.03%, sys=0.04%, ctx=1008, majf=0, minf=1 00:24:25.491 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:25.491 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:25.491 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:25.491 issued rwts: total=496,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:25.491 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:25.491 00:24:25.491 Run status group 0 (all jobs): 00:24:25.491 READ: bw=33.0KiB/s (33.8kB/s), 33.0KiB/s-33.0KiB/s (33.8kB/s-33.8kB/s), io=1984KiB (2032kB), run=60042-60042msec 00:24:25.491 WRITE: bw=34.1KiB/s (34.9kB/s), 34.1KiB/s-34.1KiB/s (34.9kB/s-34.9kB/s), io=2048KiB (2097kB), run=60042-60042msec 00:24:25.491 00:24:25.491 Disk stats (read/write): 00:24:25.491 nvme0n1: ios=591/512, merge=0/0, ticks=18685/99, in_queue=18784, util=99.66% 00:24:25.491 17:44:01 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:25.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:25.491 17:44:01 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:25.491 17:44:01 -- common/autotest_common.sh@1208 -- # local i=0 00:24:25.491 17:44:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:25.491 17:44:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:25.491 17:44:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:25.491 17:44:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:25.491 17:44:01 -- common/autotest_common.sh@1220 -- # return 0 00:24:25.491 17:44:01 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:25.491 17:44:01 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:25.491 nvmf hotplug test: fio successful as expected 00:24:25.491 17:44:01 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:25.491 17:44:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:25.491 17:44:01 -- common/autotest_common.sh@10 -- # set +x 00:24:25.491 17:44:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:25.491 17:44:01 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:25.492 17:44:01 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:25.492 17:44:01 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:25.492 17:44:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:25.492 17:44:01 -- nvmf/common.sh@116 -- # sync 00:24:25.492 17:44:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:25.492 17:44:01 -- nvmf/common.sh@119 -- # set +e 00:24:25.492 17:44:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:25.492 17:44:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:25.492 rmmod nvme_tcp 00:24:25.492 rmmod nvme_fabrics 00:24:25.492 rmmod nvme_keyring 00:24:25.492 17:44:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:25.492 17:44:01 -- nvmf/common.sh@123 -- # set -e 00:24:25.492 17:44:01 -- nvmf/common.sh@124 -- # return 0 00:24:25.492 17:44:01 -- nvmf/common.sh@477 -- # '[' -n 1638288 ']' 00:24:25.492 17:44:01 -- nvmf/common.sh@478 -- # killprocess 1638288 00:24:25.492 17:44:01 -- common/autotest_common.sh@936 -- # '[' -z 1638288 ']' 00:24:25.492 17:44:01 -- common/autotest_common.sh@940 -- # kill -0 1638288 00:24:25.492 17:44:01 -- common/autotest_common.sh@941 -- # uname 00:24:25.492 17:44:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:25.492 17:44:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1638288 00:24:25.492 17:44:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:25.492 17:44:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:25.492 17:44:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1638288' 00:24:25.492 killing process with pid 1638288 00:24:25.492 17:44:01 -- common/autotest_common.sh@955 -- # kill 1638288 00:24:25.492 17:44:01 -- common/autotest_common.sh@960 -- # wait 1638288 00:24:25.492 17:44:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:25.492 17:44:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:25.492 17:44:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:25.492 17:44:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:25.492 17:44:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:25.492 17:44:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:25.492 17:44:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:25.492 17:44:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:26.060 17:44:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:26.060 00:24:26.060 real 1m8.952s 00:24:26.060 user 4m13.705s 00:24:26.060 sys 0m6.440s 00:24:26.060 17:44:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:26.060 17:44:03 -- common/autotest_common.sh@10 -- # set +x 00:24:26.060 ************************************ 00:24:26.060 END TEST nvmf_initiator_timeout 00:24:26.060 ************************************ 00:24:26.320 17:44:03 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:26.320 17:44:03 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:26.320 17:44:03 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:26.320 17:44:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:26.320 17:44:03 -- common/autotest_common.sh@10 -- # set +x 00:24:28.223 17:44:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:28.223 17:44:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:28.223 17:44:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:28.223 17:44:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:28.223 17:44:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:28.223 17:44:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:28.223 17:44:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:28.223 17:44:05 -- nvmf/common.sh@294 -- # net_devs=() 00:24:28.223 17:44:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:28.223 17:44:05 -- nvmf/common.sh@295 -- # e810=() 00:24:28.223 17:44:05 -- nvmf/common.sh@295 -- # local -ga e810 00:24:28.223 17:44:05 -- nvmf/common.sh@296 -- # x722=() 00:24:28.223 17:44:05 -- nvmf/common.sh@296 -- # local -ga x722 00:24:28.223 17:44:05 -- nvmf/common.sh@297 -- # mlx=() 00:24:28.223 17:44:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:28.223 17:44:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:28.223 17:44:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:28.223 17:44:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:28.223 17:44:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:28.223 17:44:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:28.223 17:44:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:28.223 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:28.223 17:44:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:28.223 17:44:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:28.223 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:28.223 17:44:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:28.223 17:44:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:28.223 17:44:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:28.223 17:44:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:28.223 17:44:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:28.223 17:44:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:28.223 17:44:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:28.223 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:28.223 17:44:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:28.223 17:44:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:28.223 17:44:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:28.223 17:44:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:28.223 17:44:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:28.223 17:44:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:28.223 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:28.223 17:44:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:28.223 17:44:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:28.223 17:44:05 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:28.223 17:44:05 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:28.223 17:44:05 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:28.223 17:44:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:28.223 17:44:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:28.223 17:44:05 -- common/autotest_common.sh@10 -- # set +x 00:24:28.223 ************************************ 00:24:28.223 START TEST nvmf_perf_adq 00:24:28.223 ************************************ 00:24:28.223 17:44:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:28.482 * Looking for test storage... 00:24:28.482 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:28.482 17:44:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:28.482 17:44:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:28.482 17:44:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:28.482 17:44:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:28.482 17:44:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:28.482 17:44:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:28.482 17:44:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:28.482 17:44:05 -- scripts/common.sh@335 -- # IFS=.-: 00:24:28.482 17:44:05 -- scripts/common.sh@335 -- # read -ra ver1 00:24:28.482 17:44:05 -- scripts/common.sh@336 -- # IFS=.-: 00:24:28.482 17:44:05 -- scripts/common.sh@336 -- # read -ra ver2 00:24:28.482 17:44:05 -- scripts/common.sh@337 -- # local 'op=<' 00:24:28.482 17:44:05 -- scripts/common.sh@339 -- # ver1_l=2 00:24:28.482 17:44:05 -- scripts/common.sh@340 -- # ver2_l=1 00:24:28.482 17:44:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:28.482 17:44:05 -- scripts/common.sh@343 -- # case "$op" in 00:24:28.482 17:44:05 -- scripts/common.sh@344 -- # : 1 00:24:28.482 17:44:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:28.482 17:44:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:28.482 17:44:05 -- scripts/common.sh@364 -- # decimal 1 00:24:28.482 17:44:05 -- scripts/common.sh@352 -- # local d=1 00:24:28.482 17:44:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:28.482 17:44:05 -- scripts/common.sh@354 -- # echo 1 00:24:28.482 17:44:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:28.482 17:44:05 -- scripts/common.sh@365 -- # decimal 2 00:24:28.482 17:44:05 -- scripts/common.sh@352 -- # local d=2 00:24:28.482 17:44:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:28.482 17:44:05 -- scripts/common.sh@354 -- # echo 2 00:24:28.482 17:44:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:28.482 17:44:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:28.482 17:44:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:28.482 17:44:05 -- scripts/common.sh@367 -- # return 0 00:24:28.482 17:44:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:28.482 17:44:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:28.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:28.482 --rc genhtml_branch_coverage=1 00:24:28.482 --rc genhtml_function_coverage=1 00:24:28.482 --rc genhtml_legend=1 00:24:28.483 --rc geninfo_all_blocks=1 00:24:28.483 --rc geninfo_unexecuted_blocks=1 00:24:28.483 00:24:28.483 ' 00:24:28.483 17:44:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:28.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:28.483 --rc genhtml_branch_coverage=1 00:24:28.483 --rc genhtml_function_coverage=1 00:24:28.483 --rc genhtml_legend=1 00:24:28.483 --rc geninfo_all_blocks=1 00:24:28.483 --rc geninfo_unexecuted_blocks=1 00:24:28.483 00:24:28.483 ' 00:24:28.483 17:44:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:28.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:28.483 --rc genhtml_branch_coverage=1 00:24:28.483 --rc genhtml_function_coverage=1 00:24:28.483 --rc genhtml_legend=1 00:24:28.483 --rc geninfo_all_blocks=1 00:24:28.483 --rc geninfo_unexecuted_blocks=1 00:24:28.483 00:24:28.483 ' 00:24:28.483 17:44:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:28.483 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:28.483 --rc genhtml_branch_coverage=1 00:24:28.483 --rc genhtml_function_coverage=1 00:24:28.483 --rc genhtml_legend=1 00:24:28.483 --rc geninfo_all_blocks=1 00:24:28.483 --rc geninfo_unexecuted_blocks=1 00:24:28.483 00:24:28.483 ' 00:24:28.483 17:44:05 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:28.483 17:44:05 -- nvmf/common.sh@7 -- # uname -s 00:24:28.483 17:44:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:28.483 17:44:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:28.483 17:44:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:28.483 17:44:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:28.483 17:44:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:28.483 17:44:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:28.483 17:44:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:28.483 17:44:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:28.483 17:44:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:28.483 17:44:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:28.483 17:44:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:28.483 17:44:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:28.483 17:44:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:28.483 17:44:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:28.483 17:44:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:28.483 17:44:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:28.483 17:44:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:28.483 17:44:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:28.483 17:44:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:28.483 17:44:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.483 17:44:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.483 17:44:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.483 17:44:05 -- paths/export.sh@5 -- # export PATH 00:24:28.483 17:44:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:28.483 17:44:05 -- nvmf/common.sh@46 -- # : 0 00:24:28.483 17:44:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:28.483 17:44:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:28.483 17:44:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:28.483 17:44:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:28.483 17:44:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:28.483 17:44:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:28.483 17:44:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:28.483 17:44:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:28.483 17:44:05 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:28.483 17:44:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:28.483 17:44:05 -- common/autotest_common.sh@10 -- # set +x 00:24:31.020 17:44:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:31.020 17:44:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:31.020 17:44:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:31.020 17:44:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:31.020 17:44:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:31.020 17:44:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:31.020 17:44:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:31.020 17:44:07 -- nvmf/common.sh@294 -- # net_devs=() 00:24:31.020 17:44:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:31.020 17:44:07 -- nvmf/common.sh@295 -- # e810=() 00:24:31.020 17:44:07 -- nvmf/common.sh@295 -- # local -ga e810 00:24:31.020 17:44:07 -- nvmf/common.sh@296 -- # x722=() 00:24:31.020 17:44:07 -- nvmf/common.sh@296 -- # local -ga x722 00:24:31.020 17:44:07 -- nvmf/common.sh@297 -- # mlx=() 00:24:31.020 17:44:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:31.020 17:44:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:31.020 17:44:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:31.020 17:44:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:31.020 17:44:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:31.020 17:44:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:31.020 17:44:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:31.020 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:31.020 17:44:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:31.020 17:44:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:31.020 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:31.020 17:44:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:31.020 17:44:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:31.020 17:44:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:31.020 17:44:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:31.020 17:44:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:31.020 17:44:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:31.020 17:44:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:31.020 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:31.020 17:44:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:31.020 17:44:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:31.020 17:44:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:31.020 17:44:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:31.020 17:44:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:31.020 17:44:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:31.020 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:31.020 17:44:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:31.020 17:44:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:31.020 17:44:07 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:31.020 17:44:07 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:31.020 17:44:07 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:31.020 17:44:07 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:31.020 17:44:07 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:31.279 17:44:08 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:33.808 17:44:10 -- target/perf_adq.sh@54 -- # sleep 5 00:24:39.175 17:44:15 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:39.175 17:44:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:39.175 17:44:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:39.175 17:44:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:39.175 17:44:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:39.175 17:44:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:39.175 17:44:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:39.175 17:44:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:39.175 17:44:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:39.176 17:44:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:39.176 17:44:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:39.176 17:44:15 -- common/autotest_common.sh@10 -- # set +x 00:24:39.176 17:44:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:39.176 17:44:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:39.176 17:44:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:39.176 17:44:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:39.176 17:44:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:39.176 17:44:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:39.176 17:44:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:39.176 17:44:15 -- nvmf/common.sh@294 -- # net_devs=() 00:24:39.176 17:44:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:39.176 17:44:15 -- nvmf/common.sh@295 -- # e810=() 00:24:39.176 17:44:15 -- nvmf/common.sh@295 -- # local -ga e810 00:24:39.176 17:44:15 -- nvmf/common.sh@296 -- # x722=() 00:24:39.176 17:44:15 -- nvmf/common.sh@296 -- # local -ga x722 00:24:39.176 17:44:15 -- nvmf/common.sh@297 -- # mlx=() 00:24:39.176 17:44:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:39.176 17:44:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:39.176 17:44:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:39.176 17:44:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:39.176 17:44:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:39.176 17:44:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:39.176 17:44:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:39.176 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:39.176 17:44:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:39.176 17:44:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:39.176 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:39.176 17:44:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:39.176 17:44:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:39.176 17:44:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:39.176 17:44:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:39.176 17:44:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:39.176 17:44:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:39.176 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:39.176 17:44:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:39.176 17:44:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:39.176 17:44:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:39.176 17:44:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:39.176 17:44:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:39.176 17:44:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:39.176 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:39.176 17:44:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:39.176 17:44:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:39.176 17:44:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:39.176 17:44:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:39.176 17:44:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:39.176 17:44:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:39.176 17:44:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:39.176 17:44:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:39.176 17:44:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:39.176 17:44:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:39.176 17:44:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:39.176 17:44:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:39.176 17:44:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:39.176 17:44:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:39.176 17:44:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:39.176 17:44:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:39.176 17:44:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:39.176 17:44:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:39.176 17:44:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:39.176 17:44:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:39.176 17:44:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:39.176 17:44:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:39.176 17:44:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:39.176 17:44:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:39.176 17:44:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:39.176 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:39.176 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:24:39.176 00:24:39.176 --- 10.0.0.2 ping statistics --- 00:24:39.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:39.176 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:24:39.176 17:44:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:39.176 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:39.176 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:24:39.176 00:24:39.176 --- 10.0.0.1 ping statistics --- 00:24:39.176 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:39.176 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:24:39.176 17:44:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:39.176 17:44:16 -- nvmf/common.sh@410 -- # return 0 00:24:39.176 17:44:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:39.176 17:44:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:39.176 17:44:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:39.176 17:44:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:39.176 17:44:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:39.176 17:44:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:39.176 17:44:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:39.176 17:44:16 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:39.176 17:44:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:39.176 17:44:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:39.176 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.176 17:44:16 -- nvmf/common.sh@469 -- # nvmfpid=1650855 00:24:39.176 17:44:16 -- nvmf/common.sh@470 -- # waitforlisten 1650855 00:24:39.176 17:44:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:39.176 17:44:16 -- common/autotest_common.sh@829 -- # '[' -z 1650855 ']' 00:24:39.176 17:44:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:39.176 17:44:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:39.176 17:44:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:39.176 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:39.176 17:44:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:39.176 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.176 [2024-11-16 17:44:16.183081] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:39.176 [2024-11-16 17:44:16.183161] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:39.176 EAL: No free 2048 kB hugepages reported on node 1 00:24:39.176 [2024-11-16 17:44:16.254607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:39.176 [2024-11-16 17:44:16.348200] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:39.176 [2024-11-16 17:44:16.348373] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:39.176 [2024-11-16 17:44:16.348393] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:39.176 [2024-11-16 17:44:16.348408] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:39.176 [2024-11-16 17:44:16.348475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:39.176 [2024-11-16 17:44:16.348542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:39.176 [2024-11-16 17:44:16.348568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:39.176 [2024-11-16 17:44:16.348572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:39.176 17:44:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:39.177 17:44:16 -- common/autotest_common.sh@862 -- # return 0 00:24:39.177 17:44:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:39.177 17:44:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:39.177 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.177 17:44:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:39.177 17:44:16 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:39.177 17:44:16 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:39.177 17:44:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.177 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.177 17:44:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.177 17:44:16 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:39.177 17:44:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.177 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.177 17:44:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.177 17:44:16 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:39.177 17:44:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.177 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.177 [2024-11-16 17:44:16.522079] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:39.177 17:44:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.177 17:44:16 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:39.177 17:44:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.177 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.177 Malloc1 00:24:39.177 17:44:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.177 17:44:16 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:39.177 17:44:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.177 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.177 17:44:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.177 17:44:16 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:39.177 17:44:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.177 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.177 17:44:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.177 17:44:16 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:39.177 17:44:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.177 17:44:16 -- common/autotest_common.sh@10 -- # set +x 00:24:39.177 [2024-11-16 17:44:16.574932] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:39.177 17:44:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.177 17:44:16 -- target/perf_adq.sh@73 -- # perfpid=1650887 00:24:39.177 17:44:16 -- target/perf_adq.sh@74 -- # sleep 2 00:24:39.177 17:44:16 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:39.177 EAL: No free 2048 kB hugepages reported on node 1 00:24:41.709 17:44:18 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:41.709 17:44:18 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:41.709 17:44:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:41.709 17:44:18 -- target/perf_adq.sh@76 -- # wc -l 00:24:41.709 17:44:18 -- common/autotest_common.sh@10 -- # set +x 00:24:41.709 17:44:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:41.709 17:44:18 -- target/perf_adq.sh@76 -- # count=4 00:24:41.709 17:44:18 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:41.709 17:44:18 -- target/perf_adq.sh@81 -- # wait 1650887 00:24:49.820 Initializing NVMe Controllers 00:24:49.820 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:49.820 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:49.820 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:49.820 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:49.820 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:49.820 Initialization complete. Launching workers. 00:24:49.820 ======================================================== 00:24:49.820 Latency(us) 00:24:49.820 Device Information : IOPS MiB/s Average min max 00:24:49.820 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10978.10 42.88 5829.72 1884.10 9993.07 00:24:49.820 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10769.10 42.07 5943.47 1665.71 9886.62 00:24:49.820 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11042.70 43.14 5797.95 1651.07 10013.08 00:24:49.820 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10721.40 41.88 5971.61 1706.49 10116.95 00:24:49.820 ======================================================== 00:24:49.820 Total : 43511.29 169.97 5884.77 1651.07 10116.95 00:24:49.820 00:24:49.820 17:44:26 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:49.820 17:44:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:49.820 17:44:26 -- nvmf/common.sh@116 -- # sync 00:24:49.820 17:44:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:49.820 17:44:26 -- nvmf/common.sh@119 -- # set +e 00:24:49.820 17:44:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:49.820 17:44:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:49.820 rmmod nvme_tcp 00:24:49.820 rmmod nvme_fabrics 00:24:49.820 rmmod nvme_keyring 00:24:49.820 17:44:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:49.820 17:44:26 -- nvmf/common.sh@123 -- # set -e 00:24:49.820 17:44:26 -- nvmf/common.sh@124 -- # return 0 00:24:49.820 17:44:26 -- nvmf/common.sh@477 -- # '[' -n 1650855 ']' 00:24:49.820 17:44:26 -- nvmf/common.sh@478 -- # killprocess 1650855 00:24:49.820 17:44:26 -- common/autotest_common.sh@936 -- # '[' -z 1650855 ']' 00:24:49.820 17:44:26 -- common/autotest_common.sh@940 -- # kill -0 1650855 00:24:49.820 17:44:26 -- common/autotest_common.sh@941 -- # uname 00:24:49.820 17:44:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:49.820 17:44:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1650855 00:24:49.820 17:44:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:49.820 17:44:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:49.820 17:44:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1650855' 00:24:49.820 killing process with pid 1650855 00:24:49.820 17:44:26 -- common/autotest_common.sh@955 -- # kill 1650855 00:24:49.820 17:44:26 -- common/autotest_common.sh@960 -- # wait 1650855 00:24:49.820 17:44:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:49.820 17:44:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:49.820 17:44:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:49.820 17:44:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:49.820 17:44:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:49.820 17:44:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:49.820 17:44:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:49.820 17:44:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:51.723 17:44:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:51.723 17:44:29 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:51.723 17:44:29 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:52.658 17:44:29 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:55.188 17:44:32 -- target/perf_adq.sh@54 -- # sleep 5 00:25:00.464 17:44:37 -- target/perf_adq.sh@87 -- # nvmftestinit 00:25:00.465 17:44:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:00.465 17:44:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:00.465 17:44:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:00.465 17:44:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:00.465 17:44:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:00.465 17:44:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:00.465 17:44:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:00.465 17:44:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:00.465 17:44:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:00.465 17:44:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:00.465 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.465 17:44:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:00.465 17:44:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:00.465 17:44:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:00.465 17:44:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:00.465 17:44:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:00.465 17:44:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:00.465 17:44:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:00.465 17:44:37 -- nvmf/common.sh@294 -- # net_devs=() 00:25:00.465 17:44:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:00.465 17:44:37 -- nvmf/common.sh@295 -- # e810=() 00:25:00.465 17:44:37 -- nvmf/common.sh@295 -- # local -ga e810 00:25:00.465 17:44:37 -- nvmf/common.sh@296 -- # x722=() 00:25:00.465 17:44:37 -- nvmf/common.sh@296 -- # local -ga x722 00:25:00.465 17:44:37 -- nvmf/common.sh@297 -- # mlx=() 00:25:00.465 17:44:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:00.465 17:44:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:00.465 17:44:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:00.465 17:44:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:00.465 17:44:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:00.465 17:44:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:00.465 17:44:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:00.465 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:00.465 17:44:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:00.465 17:44:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:00.465 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:00.465 17:44:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:00.465 17:44:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:00.465 17:44:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:00.465 17:44:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:00.465 17:44:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:00.465 17:44:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:00.465 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:00.465 17:44:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:00.465 17:44:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:00.465 17:44:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:00.465 17:44:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:00.465 17:44:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:00.465 17:44:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:00.465 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:00.465 17:44:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:00.465 17:44:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:00.465 17:44:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:00.465 17:44:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:00.465 17:44:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:00.465 17:44:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:00.465 17:44:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:00.465 17:44:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:00.465 17:44:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:00.465 17:44:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:00.465 17:44:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:00.465 17:44:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:00.465 17:44:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:00.465 17:44:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:00.465 17:44:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:00.465 17:44:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:00.465 17:44:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:00.465 17:44:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:00.465 17:44:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:00.465 17:44:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:00.465 17:44:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:00.465 17:44:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:00.465 17:44:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:00.465 17:44:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:00.465 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:00.465 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:25:00.465 00:25:00.465 --- 10.0.0.2 ping statistics --- 00:25:00.465 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:00.465 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:25:00.465 17:44:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:00.465 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:00.465 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:25:00.465 00:25:00.465 --- 10.0.0.1 ping statistics --- 00:25:00.465 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:00.465 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:25:00.465 17:44:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:00.465 17:44:37 -- nvmf/common.sh@410 -- # return 0 00:25:00.465 17:44:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:00.465 17:44:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:00.465 17:44:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:00.465 17:44:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:00.465 17:44:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:00.465 17:44:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:00.465 17:44:37 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:25:00.465 17:44:37 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:25:00.465 17:44:37 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:25:00.465 17:44:37 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:25:00.465 net.core.busy_poll = 1 00:25:00.465 17:44:37 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:25:00.465 net.core.busy_read = 1 00:25:00.465 17:44:37 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:25:00.465 17:44:37 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:25:00.465 17:44:37 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:25:00.465 17:44:37 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:25:00.465 17:44:37 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:25:00.465 17:44:37 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:25:00.465 17:44:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:00.465 17:44:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:00.465 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.465 17:44:37 -- nvmf/common.sh@469 -- # nvmfpid=1653572 00:25:00.465 17:44:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:25:00.465 17:44:37 -- nvmf/common.sh@470 -- # waitforlisten 1653572 00:25:00.465 17:44:37 -- common/autotest_common.sh@829 -- # '[' -z 1653572 ']' 00:25:00.465 17:44:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:00.466 17:44:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:00.466 17:44:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:00.466 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:00.466 17:44:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 [2024-11-16 17:44:37.457315] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:00.466 [2024-11-16 17:44:37.457406] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:00.466 EAL: No free 2048 kB hugepages reported on node 1 00:25:00.466 [2024-11-16 17:44:37.524307] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:00.466 [2024-11-16 17:44:37.612446] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:00.466 [2024-11-16 17:44:37.612613] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:00.466 [2024-11-16 17:44:37.612638] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:00.466 [2024-11-16 17:44:37.612651] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:00.466 [2024-11-16 17:44:37.612724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:00.466 [2024-11-16 17:44:37.612784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:00.466 [2024-11-16 17:44:37.612864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:00.466 [2024-11-16 17:44:37.612861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:00.466 17:44:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:00.466 17:44:37 -- common/autotest_common.sh@862 -- # return 0 00:25:00.466 17:44:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:00.466 17:44:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 17:44:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:00.466 17:44:37 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:25:00.466 17:44:37 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:25:00.466 17:44:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 17:44:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.466 17:44:37 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:25:00.466 17:44:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 17:44:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.466 17:44:37 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:25:00.466 17:44:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 [2024-11-16 17:44:37.825425] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:00.466 17:44:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.466 17:44:37 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:00.466 17:44:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 Malloc1 00:25:00.466 17:44:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.466 17:44:37 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:00.466 17:44:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 17:44:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.466 17:44:37 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:00.466 17:44:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 17:44:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.466 17:44:37 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:00.466 17:44:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:00.466 17:44:37 -- common/autotest_common.sh@10 -- # set +x 00:25:00.466 [2024-11-16 17:44:37.878716] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:00.466 17:44:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:00.466 17:44:37 -- target/perf_adq.sh@94 -- # perfpid=1653720 00:25:00.466 17:44:37 -- target/perf_adq.sh@95 -- # sleep 2 00:25:00.466 17:44:37 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:25:00.466 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.997 17:44:39 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:02.997 17:44:39 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:02.997 17:44:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:02.997 17:44:39 -- target/perf_adq.sh@97 -- # wc -l 00:25:02.997 17:44:39 -- common/autotest_common.sh@10 -- # set +x 00:25:02.997 17:44:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:02.997 17:44:39 -- target/perf_adq.sh@97 -- # count=2 00:25:02.997 17:44:39 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:25:02.997 17:44:39 -- target/perf_adq.sh@103 -- # wait 1653720 00:25:11.109 Initializing NVMe Controllers 00:25:11.109 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:11.110 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:11.110 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:11.110 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:11.110 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:11.110 Initialization complete. Launching workers. 00:25:11.110 ======================================================== 00:25:11.110 Latency(us) 00:25:11.110 Device Information : IOPS MiB/s Average min max 00:25:11.110 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4846.00 18.93 13215.40 2118.47 60348.84 00:25:11.110 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 15096.30 58.97 4239.52 1969.32 6840.94 00:25:11.110 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5066.90 19.79 12638.40 2164.34 58548.46 00:25:11.110 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4792.80 18.72 13361.78 2166.84 62033.38 00:25:11.110 ======================================================== 00:25:11.110 Total : 29802.00 116.41 8594.08 1969.32 62033.38 00:25:11.110 00:25:11.110 17:44:48 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:11.110 17:44:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:11.110 17:44:48 -- nvmf/common.sh@116 -- # sync 00:25:11.110 17:44:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:11.110 17:44:48 -- nvmf/common.sh@119 -- # set +e 00:25:11.110 17:44:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:11.110 17:44:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:11.110 rmmod nvme_tcp 00:25:11.110 rmmod nvme_fabrics 00:25:11.110 rmmod nvme_keyring 00:25:11.110 17:44:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:11.110 17:44:48 -- nvmf/common.sh@123 -- # set -e 00:25:11.110 17:44:48 -- nvmf/common.sh@124 -- # return 0 00:25:11.110 17:44:48 -- nvmf/common.sh@477 -- # '[' -n 1653572 ']' 00:25:11.110 17:44:48 -- nvmf/common.sh@478 -- # killprocess 1653572 00:25:11.110 17:44:48 -- common/autotest_common.sh@936 -- # '[' -z 1653572 ']' 00:25:11.110 17:44:48 -- common/autotest_common.sh@940 -- # kill -0 1653572 00:25:11.110 17:44:48 -- common/autotest_common.sh@941 -- # uname 00:25:11.110 17:44:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:11.110 17:44:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1653572 00:25:11.110 17:44:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:11.110 17:44:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:11.110 17:44:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1653572' 00:25:11.110 killing process with pid 1653572 00:25:11.110 17:44:48 -- common/autotest_common.sh@955 -- # kill 1653572 00:25:11.110 17:44:48 -- common/autotest_common.sh@960 -- # wait 1653572 00:25:11.110 17:44:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:11.110 17:44:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:11.110 17:44:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:11.110 17:44:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:11.110 17:44:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:11.110 17:44:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:11.110 17:44:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:11.110 17:44:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:13.024 17:44:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:13.024 17:44:50 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:13.024 00:25:13.024 real 0m44.747s 00:25:13.024 user 2m38.370s 00:25:13.024 sys 0m9.927s 00:25:13.024 17:44:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:13.024 17:44:50 -- common/autotest_common.sh@10 -- # set +x 00:25:13.024 ************************************ 00:25:13.024 END TEST nvmf_perf_adq 00:25:13.024 ************************************ 00:25:13.024 17:44:50 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:13.024 17:44:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:13.024 17:44:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:13.024 17:44:50 -- common/autotest_common.sh@10 -- # set +x 00:25:13.024 ************************************ 00:25:13.024 START TEST nvmf_shutdown 00:25:13.024 ************************************ 00:25:13.024 17:44:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:13.024 * Looking for test storage... 00:25:13.024 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:13.024 17:44:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:13.024 17:44:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:13.024 17:44:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:13.285 17:44:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:13.285 17:44:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:13.285 17:44:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:13.285 17:44:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:13.285 17:44:50 -- scripts/common.sh@335 -- # IFS=.-: 00:25:13.285 17:44:50 -- scripts/common.sh@335 -- # read -ra ver1 00:25:13.285 17:44:50 -- scripts/common.sh@336 -- # IFS=.-: 00:25:13.285 17:44:50 -- scripts/common.sh@336 -- # read -ra ver2 00:25:13.285 17:44:50 -- scripts/common.sh@337 -- # local 'op=<' 00:25:13.285 17:44:50 -- scripts/common.sh@339 -- # ver1_l=2 00:25:13.285 17:44:50 -- scripts/common.sh@340 -- # ver2_l=1 00:25:13.285 17:44:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:13.285 17:44:50 -- scripts/common.sh@343 -- # case "$op" in 00:25:13.285 17:44:50 -- scripts/common.sh@344 -- # : 1 00:25:13.285 17:44:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:13.285 17:44:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:13.285 17:44:50 -- scripts/common.sh@364 -- # decimal 1 00:25:13.285 17:44:50 -- scripts/common.sh@352 -- # local d=1 00:25:13.285 17:44:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:13.285 17:44:50 -- scripts/common.sh@354 -- # echo 1 00:25:13.285 17:44:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:13.285 17:44:50 -- scripts/common.sh@365 -- # decimal 2 00:25:13.285 17:44:50 -- scripts/common.sh@352 -- # local d=2 00:25:13.285 17:44:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:13.285 17:44:50 -- scripts/common.sh@354 -- # echo 2 00:25:13.285 17:44:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:13.285 17:44:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:13.285 17:44:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:13.285 17:44:50 -- scripts/common.sh@367 -- # return 0 00:25:13.285 17:44:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:13.285 17:44:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:13.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:13.285 --rc genhtml_branch_coverage=1 00:25:13.285 --rc genhtml_function_coverage=1 00:25:13.285 --rc genhtml_legend=1 00:25:13.285 --rc geninfo_all_blocks=1 00:25:13.285 --rc geninfo_unexecuted_blocks=1 00:25:13.285 00:25:13.285 ' 00:25:13.285 17:44:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:13.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:13.285 --rc genhtml_branch_coverage=1 00:25:13.285 --rc genhtml_function_coverage=1 00:25:13.285 --rc genhtml_legend=1 00:25:13.285 --rc geninfo_all_blocks=1 00:25:13.285 --rc geninfo_unexecuted_blocks=1 00:25:13.285 00:25:13.285 ' 00:25:13.285 17:44:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:13.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:13.285 --rc genhtml_branch_coverage=1 00:25:13.285 --rc genhtml_function_coverage=1 00:25:13.285 --rc genhtml_legend=1 00:25:13.285 --rc geninfo_all_blocks=1 00:25:13.285 --rc geninfo_unexecuted_blocks=1 00:25:13.285 00:25:13.285 ' 00:25:13.285 17:44:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:13.285 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:13.285 --rc genhtml_branch_coverage=1 00:25:13.285 --rc genhtml_function_coverage=1 00:25:13.285 --rc genhtml_legend=1 00:25:13.285 --rc geninfo_all_blocks=1 00:25:13.285 --rc geninfo_unexecuted_blocks=1 00:25:13.285 00:25:13.285 ' 00:25:13.285 17:44:50 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:13.285 17:44:50 -- nvmf/common.sh@7 -- # uname -s 00:25:13.285 17:44:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:13.285 17:44:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:13.285 17:44:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:13.285 17:44:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:13.285 17:44:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:13.285 17:44:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:13.285 17:44:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:13.285 17:44:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:13.285 17:44:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:13.285 17:44:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:13.285 17:44:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:13.285 17:44:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:13.285 17:44:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:13.285 17:44:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:13.285 17:44:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:13.285 17:44:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:13.285 17:44:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:13.285 17:44:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:13.285 17:44:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:13.285 17:44:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:13.285 17:44:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:13.285 17:44:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:13.285 17:44:50 -- paths/export.sh@5 -- # export PATH 00:25:13.285 17:44:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:13.285 17:44:50 -- nvmf/common.sh@46 -- # : 0 00:25:13.285 17:44:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:13.285 17:44:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:13.285 17:44:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:13.285 17:44:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:13.285 17:44:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:13.285 17:44:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:13.285 17:44:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:13.285 17:44:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:13.285 17:44:50 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:13.285 17:44:50 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:13.285 17:44:50 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:13.285 17:44:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:13.285 17:44:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:13.285 17:44:50 -- common/autotest_common.sh@10 -- # set +x 00:25:13.285 ************************************ 00:25:13.285 START TEST nvmf_shutdown_tc1 00:25:13.285 ************************************ 00:25:13.285 17:44:50 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:13.285 17:44:50 -- target/shutdown.sh@74 -- # starttarget 00:25:13.285 17:44:50 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:13.285 17:44:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:13.285 17:44:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:13.285 17:44:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:13.285 17:44:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:13.285 17:44:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:13.285 17:44:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:13.285 17:44:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:13.285 17:44:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:13.285 17:44:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:13.285 17:44:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:13.285 17:44:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:13.285 17:44:50 -- common/autotest_common.sh@10 -- # set +x 00:25:15.187 17:44:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:15.187 17:44:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:15.187 17:44:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:15.187 17:44:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:15.187 17:44:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:15.187 17:44:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:15.187 17:44:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:15.187 17:44:52 -- nvmf/common.sh@294 -- # net_devs=() 00:25:15.187 17:44:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:15.187 17:44:52 -- nvmf/common.sh@295 -- # e810=() 00:25:15.187 17:44:52 -- nvmf/common.sh@295 -- # local -ga e810 00:25:15.187 17:44:52 -- nvmf/common.sh@296 -- # x722=() 00:25:15.187 17:44:52 -- nvmf/common.sh@296 -- # local -ga x722 00:25:15.187 17:44:52 -- nvmf/common.sh@297 -- # mlx=() 00:25:15.187 17:44:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:15.187 17:44:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:15.187 17:44:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:15.187 17:44:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:15.187 17:44:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:15.187 17:44:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:15.187 17:44:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:15.187 17:44:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:15.188 17:44:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:15.188 17:44:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:15.188 17:44:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:15.188 17:44:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:15.188 17:44:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:15.188 17:44:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:15.188 17:44:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:15.188 17:44:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:15.188 17:44:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:15.188 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:15.188 17:44:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:15.188 17:44:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:15.188 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:15.188 17:44:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:15.188 17:44:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:15.188 17:44:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:15.188 17:44:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:15.188 17:44:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:15.188 17:44:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:15.188 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:15.188 17:44:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:15.188 17:44:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:15.188 17:44:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:15.188 17:44:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:15.188 17:44:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:15.188 17:44:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:15.188 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:15.188 17:44:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:15.188 17:44:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:15.188 17:44:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:15.188 17:44:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:15.188 17:44:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:15.188 17:44:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:15.188 17:44:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:15.188 17:44:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:15.188 17:44:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:15.188 17:44:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:15.188 17:44:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:15.188 17:44:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:15.188 17:44:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:15.188 17:44:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:15.188 17:44:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:15.188 17:44:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:15.188 17:44:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:15.188 17:44:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:15.446 17:44:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:15.446 17:44:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:15.446 17:44:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:15.446 17:44:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:15.446 17:44:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:15.446 17:44:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:15.446 17:44:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:15.446 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:15.446 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:25:15.446 00:25:15.446 --- 10.0.0.2 ping statistics --- 00:25:15.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:15.446 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:25:15.446 17:44:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:15.446 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:15.446 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:25:15.446 00:25:15.446 --- 10.0.0.1 ping statistics --- 00:25:15.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:15.446 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:25:15.446 17:44:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:15.446 17:44:52 -- nvmf/common.sh@410 -- # return 0 00:25:15.446 17:44:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:15.446 17:44:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:15.446 17:44:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:15.446 17:44:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:15.446 17:44:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:15.446 17:44:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:15.446 17:44:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:15.446 17:44:52 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:15.446 17:44:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:15.446 17:44:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:15.446 17:44:52 -- common/autotest_common.sh@10 -- # set +x 00:25:15.446 17:44:52 -- nvmf/common.sh@469 -- # nvmfpid=1656933 00:25:15.446 17:44:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:15.446 17:44:52 -- nvmf/common.sh@470 -- # waitforlisten 1656933 00:25:15.446 17:44:52 -- common/autotest_common.sh@829 -- # '[' -z 1656933 ']' 00:25:15.446 17:44:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:15.446 17:44:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:15.446 17:44:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:15.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:15.446 17:44:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:15.446 17:44:52 -- common/autotest_common.sh@10 -- # set +x 00:25:15.446 [2024-11-16 17:44:52.930360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:15.446 [2024-11-16 17:44:52.930448] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:15.704 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.704 [2024-11-16 17:44:53.006875] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:15.704 [2024-11-16 17:44:53.096740] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:15.704 [2024-11-16 17:44:53.096909] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:15.704 [2024-11-16 17:44:53.096931] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:15.704 [2024-11-16 17:44:53.096946] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:15.704 [2024-11-16 17:44:53.097028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:15.704 [2024-11-16 17:44:53.097141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:15.704 [2024-11-16 17:44:53.097186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:15.704 [2024-11-16 17:44:53.097188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:16.638 17:44:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:16.638 17:44:53 -- common/autotest_common.sh@862 -- # return 0 00:25:16.638 17:44:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:16.638 17:44:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:16.638 17:44:53 -- common/autotest_common.sh@10 -- # set +x 00:25:16.638 17:44:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:16.638 17:44:53 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:16.638 17:44:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:16.638 17:44:53 -- common/autotest_common.sh@10 -- # set +x 00:25:16.638 [2024-11-16 17:44:53.963366] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:16.638 17:44:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:16.638 17:44:53 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:16.638 17:44:53 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:16.638 17:44:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:16.638 17:44:53 -- common/autotest_common.sh@10 -- # set +x 00:25:16.638 17:44:53 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:16.638 17:44:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:53 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:53 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:53 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:53 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:53 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:53 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:53 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:53 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:53 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:54 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:54 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:16.638 17:44:54 -- target/shutdown.sh@28 -- # cat 00:25:16.638 17:44:54 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:16.638 17:44:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:16.638 17:44:54 -- common/autotest_common.sh@10 -- # set +x 00:25:16.638 Malloc1 00:25:16.638 [2024-11-16 17:44:54.050915] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:16.638 Malloc2 00:25:16.638 Malloc3 00:25:16.896 Malloc4 00:25:16.896 Malloc5 00:25:16.896 Malloc6 00:25:16.896 Malloc7 00:25:16.896 Malloc8 00:25:17.155 Malloc9 00:25:17.155 Malloc10 00:25:17.155 17:44:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:17.155 17:44:54 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:17.155 17:44:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:17.155 17:44:54 -- common/autotest_common.sh@10 -- # set +x 00:25:17.155 17:44:54 -- target/shutdown.sh@78 -- # perfpid=1657125 00:25:17.155 17:44:54 -- target/shutdown.sh@79 -- # waitforlisten 1657125 /var/tmp/bdevperf.sock 00:25:17.155 17:44:54 -- common/autotest_common.sh@829 -- # '[' -z 1657125 ']' 00:25:17.155 17:44:54 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:17.155 17:44:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:17.155 17:44:54 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:17.155 17:44:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:17.155 17:44:54 -- nvmf/common.sh@520 -- # config=() 00:25:17.155 17:44:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:17.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:17.155 17:44:54 -- nvmf/common.sh@520 -- # local subsystem config 00:25:17.155 17:44:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:17.155 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.155 17:44:54 -- common/autotest_common.sh@10 -- # set +x 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.155 { 00:25:17.155 "params": { 00:25:17.155 "name": "Nvme$subsystem", 00:25:17.155 "trtype": "$TEST_TRANSPORT", 00:25:17.155 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.155 "adrfam": "ipv4", 00:25:17.155 "trsvcid": "$NVMF_PORT", 00:25:17.155 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.155 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.155 "hdgst": ${hdgst:-false}, 00:25:17.155 "ddgst": ${ddgst:-false} 00:25:17.155 }, 00:25:17.155 "method": "bdev_nvme_attach_controller" 00:25:17.155 } 00:25:17.155 EOF 00:25:17.155 )") 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.155 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.155 { 00:25:17.155 "params": { 00:25:17.155 "name": "Nvme$subsystem", 00:25:17.155 "trtype": "$TEST_TRANSPORT", 00:25:17.155 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.155 "adrfam": "ipv4", 00:25:17.155 "trsvcid": "$NVMF_PORT", 00:25:17.155 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.155 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.155 "hdgst": ${hdgst:-false}, 00:25:17.155 "ddgst": ${ddgst:-false} 00:25:17.155 }, 00:25:17.155 "method": "bdev_nvme_attach_controller" 00:25:17.155 } 00:25:17.155 EOF 00:25:17.155 )") 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.155 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.155 { 00:25:17.155 "params": { 00:25:17.155 "name": "Nvme$subsystem", 00:25:17.155 "trtype": "$TEST_TRANSPORT", 00:25:17.155 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.155 "adrfam": "ipv4", 00:25:17.155 "trsvcid": "$NVMF_PORT", 00:25:17.155 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.155 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.155 "hdgst": ${hdgst:-false}, 00:25:17.155 "ddgst": ${ddgst:-false} 00:25:17.155 }, 00:25:17.155 "method": "bdev_nvme_attach_controller" 00:25:17.155 } 00:25:17.155 EOF 00:25:17.155 )") 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.155 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.155 { 00:25:17.155 "params": { 00:25:17.155 "name": "Nvme$subsystem", 00:25:17.155 "trtype": "$TEST_TRANSPORT", 00:25:17.155 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.155 "adrfam": "ipv4", 00:25:17.155 "trsvcid": "$NVMF_PORT", 00:25:17.155 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.155 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.155 "hdgst": ${hdgst:-false}, 00:25:17.155 "ddgst": ${ddgst:-false} 00:25:17.155 }, 00:25:17.155 "method": "bdev_nvme_attach_controller" 00:25:17.155 } 00:25:17.155 EOF 00:25:17.155 )") 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.155 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.155 { 00:25:17.155 "params": { 00:25:17.155 "name": "Nvme$subsystem", 00:25:17.155 "trtype": "$TEST_TRANSPORT", 00:25:17.155 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.155 "adrfam": "ipv4", 00:25:17.155 "trsvcid": "$NVMF_PORT", 00:25:17.155 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.155 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.155 "hdgst": ${hdgst:-false}, 00:25:17.155 "ddgst": ${ddgst:-false} 00:25:17.155 }, 00:25:17.155 "method": "bdev_nvme_attach_controller" 00:25:17.155 } 00:25:17.155 EOF 00:25:17.155 )") 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.155 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.155 { 00:25:17.155 "params": { 00:25:17.155 "name": "Nvme$subsystem", 00:25:17.155 "trtype": "$TEST_TRANSPORT", 00:25:17.155 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.155 "adrfam": "ipv4", 00:25:17.155 "trsvcid": "$NVMF_PORT", 00:25:17.155 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.155 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.155 "hdgst": ${hdgst:-false}, 00:25:17.155 "ddgst": ${ddgst:-false} 00:25:17.155 }, 00:25:17.155 "method": "bdev_nvme_attach_controller" 00:25:17.155 } 00:25:17.155 EOF 00:25:17.155 )") 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.155 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.155 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.155 { 00:25:17.155 "params": { 00:25:17.155 "name": "Nvme$subsystem", 00:25:17.155 "trtype": "$TEST_TRANSPORT", 00:25:17.156 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "$NVMF_PORT", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.156 "hdgst": ${hdgst:-false}, 00:25:17.156 "ddgst": ${ddgst:-false} 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 } 00:25:17.156 EOF 00:25:17.156 )") 00:25:17.156 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.156 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.156 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.156 { 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme$subsystem", 00:25:17.156 "trtype": "$TEST_TRANSPORT", 00:25:17.156 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "$NVMF_PORT", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.156 "hdgst": ${hdgst:-false}, 00:25:17.156 "ddgst": ${ddgst:-false} 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 } 00:25:17.156 EOF 00:25:17.156 )") 00:25:17.156 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.156 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.156 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.156 { 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme$subsystem", 00:25:17.156 "trtype": "$TEST_TRANSPORT", 00:25:17.156 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "$NVMF_PORT", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.156 "hdgst": ${hdgst:-false}, 00:25:17.156 "ddgst": ${ddgst:-false} 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 } 00:25:17.156 EOF 00:25:17.156 )") 00:25:17.156 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.156 17:44:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:17.156 17:44:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:17.156 { 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme$subsystem", 00:25:17.156 "trtype": "$TEST_TRANSPORT", 00:25:17.156 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "$NVMF_PORT", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:17.156 "hdgst": ${hdgst:-false}, 00:25:17.156 "ddgst": ${ddgst:-false} 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 } 00:25:17.156 EOF 00:25:17.156 )") 00:25:17.156 17:44:54 -- nvmf/common.sh@542 -- # cat 00:25:17.156 17:44:54 -- nvmf/common.sh@544 -- # jq . 00:25:17.156 17:44:54 -- nvmf/common.sh@545 -- # IFS=, 00:25:17.156 17:44:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme1", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme2", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme3", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme4", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme5", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme6", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme7", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme8", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme9", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 },{ 00:25:17.156 "params": { 00:25:17.156 "name": "Nvme10", 00:25:17.156 "trtype": "tcp", 00:25:17.156 "traddr": "10.0.0.2", 00:25:17.156 "adrfam": "ipv4", 00:25:17.156 "trsvcid": "4420", 00:25:17.156 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:17.156 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:17.156 "hdgst": false, 00:25:17.156 "ddgst": false 00:25:17.156 }, 00:25:17.156 "method": "bdev_nvme_attach_controller" 00:25:17.156 }' 00:25:17.156 [2024-11-16 17:44:54.559888] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:17.156 [2024-11-16 17:44:54.560001] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:17.156 EAL: No free 2048 kB hugepages reported on node 1 00:25:17.156 [2024-11-16 17:44:54.625228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:17.414 [2024-11-16 17:44:54.712800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:19.313 17:44:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:19.313 17:44:56 -- common/autotest_common.sh@862 -- # return 0 00:25:19.313 17:44:56 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:19.313 17:44:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:19.313 17:44:56 -- common/autotest_common.sh@10 -- # set +x 00:25:19.313 17:44:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:19.313 17:44:56 -- target/shutdown.sh@83 -- # kill -9 1657125 00:25:19.313 17:44:56 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:19.313 17:44:56 -- target/shutdown.sh@87 -- # sleep 1 00:25:19.879 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1657125 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:19.879 17:44:57 -- target/shutdown.sh@88 -- # kill -0 1656933 00:25:19.879 17:44:57 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:19.879 17:44:57 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:19.879 17:44:57 -- nvmf/common.sh@520 -- # config=() 00:25:19.879 17:44:57 -- nvmf/common.sh@520 -- # local subsystem config 00:25:19.879 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.879 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.879 { 00:25:19.879 "params": { 00:25:19.879 "name": "Nvme$subsystem", 00:25:19.879 "trtype": "$TEST_TRANSPORT", 00:25:19.879 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.879 "adrfam": "ipv4", 00:25:19.879 "trsvcid": "$NVMF_PORT", 00:25:19.879 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.879 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.879 "hdgst": ${hdgst:-false}, 00:25:19.879 "ddgst": ${ddgst:-false} 00:25:19.879 }, 00:25:19.879 "method": "bdev_nvme_attach_controller" 00:25:19.879 } 00:25:19.879 EOF 00:25:19.879 )") 00:25:19.879 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.879 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.879 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.879 { 00:25:19.879 "params": { 00:25:19.879 "name": "Nvme$subsystem", 00:25:19.879 "trtype": "$TEST_TRANSPORT", 00:25:19.879 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.879 "adrfam": "ipv4", 00:25:19.879 "trsvcid": "$NVMF_PORT", 00:25:19.879 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.879 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.879 "hdgst": ${hdgst:-false}, 00:25:19.879 "ddgst": ${ddgst:-false} 00:25:19.879 }, 00:25:19.879 "method": "bdev_nvme_attach_controller" 00:25:19.879 } 00:25:19.879 EOF 00:25:19.879 )") 00:25:19.879 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.879 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.879 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.879 { 00:25:19.879 "params": { 00:25:19.879 "name": "Nvme$subsystem", 00:25:19.879 "trtype": "$TEST_TRANSPORT", 00:25:19.879 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.879 "adrfam": "ipv4", 00:25:19.879 "trsvcid": "$NVMF_PORT", 00:25:19.879 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.879 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.879 "hdgst": ${hdgst:-false}, 00:25:19.879 "ddgst": ${ddgst:-false} 00:25:19.879 }, 00:25:19.879 "method": "bdev_nvme_attach_controller" 00:25:19.879 } 00:25:19.879 EOF 00:25:19.879 )") 00:25:19.879 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.879 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.879 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.879 { 00:25:19.879 "params": { 00:25:19.879 "name": "Nvme$subsystem", 00:25:19.879 "trtype": "$TEST_TRANSPORT", 00:25:19.879 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.879 "adrfam": "ipv4", 00:25:19.879 "trsvcid": "$NVMF_PORT", 00:25:19.879 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.879 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.879 "hdgst": ${hdgst:-false}, 00:25:19.879 "ddgst": ${ddgst:-false} 00:25:19.879 }, 00:25:19.879 "method": "bdev_nvme_attach_controller" 00:25:19.879 } 00:25:19.879 EOF 00:25:19.880 )") 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.880 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.880 { 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme$subsystem", 00:25:19.880 "trtype": "$TEST_TRANSPORT", 00:25:19.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "$NVMF_PORT", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.880 "hdgst": ${hdgst:-false}, 00:25:19.880 "ddgst": ${ddgst:-false} 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 } 00:25:19.880 EOF 00:25:19.880 )") 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.880 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.880 { 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme$subsystem", 00:25:19.880 "trtype": "$TEST_TRANSPORT", 00:25:19.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "$NVMF_PORT", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.880 "hdgst": ${hdgst:-false}, 00:25:19.880 "ddgst": ${ddgst:-false} 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 } 00:25:19.880 EOF 00:25:19.880 )") 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.880 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.880 { 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme$subsystem", 00:25:19.880 "trtype": "$TEST_TRANSPORT", 00:25:19.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "$NVMF_PORT", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.880 "hdgst": ${hdgst:-false}, 00:25:19.880 "ddgst": ${ddgst:-false} 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 } 00:25:19.880 EOF 00:25:19.880 )") 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.880 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.880 { 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme$subsystem", 00:25:19.880 "trtype": "$TEST_TRANSPORT", 00:25:19.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "$NVMF_PORT", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.880 "hdgst": ${hdgst:-false}, 00:25:19.880 "ddgst": ${ddgst:-false} 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 } 00:25:19.880 EOF 00:25:19.880 )") 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.880 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.880 { 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme$subsystem", 00:25:19.880 "trtype": "$TEST_TRANSPORT", 00:25:19.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "$NVMF_PORT", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.880 "hdgst": ${hdgst:-false}, 00:25:19.880 "ddgst": ${ddgst:-false} 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 } 00:25:19.880 EOF 00:25:19.880 )") 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.880 17:44:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:19.880 { 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme$subsystem", 00:25:19.880 "trtype": "$TEST_TRANSPORT", 00:25:19.880 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "$NVMF_PORT", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:19.880 "hdgst": ${hdgst:-false}, 00:25:19.880 "ddgst": ${ddgst:-false} 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 } 00:25:19.880 EOF 00:25:19.880 )") 00:25:19.880 17:44:57 -- nvmf/common.sh@542 -- # cat 00:25:19.880 17:44:57 -- nvmf/common.sh@544 -- # jq . 00:25:19.880 17:44:57 -- nvmf/common.sh@545 -- # IFS=, 00:25:19.880 17:44:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme1", 00:25:19.880 "trtype": "tcp", 00:25:19.880 "traddr": "10.0.0.2", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "4420", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:19.880 "hdgst": false, 00:25:19.880 "ddgst": false 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 },{ 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme2", 00:25:19.880 "trtype": "tcp", 00:25:19.880 "traddr": "10.0.0.2", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "4420", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:19.880 "hdgst": false, 00:25:19.880 "ddgst": false 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 },{ 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme3", 00:25:19.880 "trtype": "tcp", 00:25:19.880 "traddr": "10.0.0.2", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "4420", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:19.880 "hdgst": false, 00:25:19.880 "ddgst": false 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 },{ 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme4", 00:25:19.880 "trtype": "tcp", 00:25:19.880 "traddr": "10.0.0.2", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "4420", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:19.880 "hdgst": false, 00:25:19.880 "ddgst": false 00:25:19.880 }, 00:25:19.880 "method": "bdev_nvme_attach_controller" 00:25:19.880 },{ 00:25:19.880 "params": { 00:25:19.880 "name": "Nvme5", 00:25:19.880 "trtype": "tcp", 00:25:19.880 "traddr": "10.0.0.2", 00:25:19.880 "adrfam": "ipv4", 00:25:19.880 "trsvcid": "4420", 00:25:19.880 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:19.880 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:19.880 "hdgst": false, 00:25:19.881 "ddgst": false 00:25:19.881 }, 00:25:19.881 "method": "bdev_nvme_attach_controller" 00:25:19.881 },{ 00:25:19.881 "params": { 00:25:19.881 "name": "Nvme6", 00:25:19.881 "trtype": "tcp", 00:25:19.881 "traddr": "10.0.0.2", 00:25:19.881 "adrfam": "ipv4", 00:25:19.881 "trsvcid": "4420", 00:25:19.881 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:19.881 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:19.881 "hdgst": false, 00:25:19.881 "ddgst": false 00:25:19.881 }, 00:25:19.881 "method": "bdev_nvme_attach_controller" 00:25:19.881 },{ 00:25:19.881 "params": { 00:25:19.881 "name": "Nvme7", 00:25:19.881 "trtype": "tcp", 00:25:19.881 "traddr": "10.0.0.2", 00:25:19.881 "adrfam": "ipv4", 00:25:19.881 "trsvcid": "4420", 00:25:19.881 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:19.881 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:19.881 "hdgst": false, 00:25:19.881 "ddgst": false 00:25:19.881 }, 00:25:19.881 "method": "bdev_nvme_attach_controller" 00:25:19.881 },{ 00:25:19.881 "params": { 00:25:19.881 "name": "Nvme8", 00:25:19.881 "trtype": "tcp", 00:25:19.881 "traddr": "10.0.0.2", 00:25:19.881 "adrfam": "ipv4", 00:25:19.881 "trsvcid": "4420", 00:25:19.881 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:19.881 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:19.881 "hdgst": false, 00:25:19.881 "ddgst": false 00:25:19.881 }, 00:25:19.881 "method": "bdev_nvme_attach_controller" 00:25:19.881 },{ 00:25:19.881 "params": { 00:25:19.881 "name": "Nvme9", 00:25:19.881 "trtype": "tcp", 00:25:19.881 "traddr": "10.0.0.2", 00:25:19.881 "adrfam": "ipv4", 00:25:19.881 "trsvcid": "4420", 00:25:19.881 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:19.881 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:19.881 "hdgst": false, 00:25:19.881 "ddgst": false 00:25:19.881 }, 00:25:19.881 "method": "bdev_nvme_attach_controller" 00:25:19.881 },{ 00:25:19.881 "params": { 00:25:19.881 "name": "Nvme10", 00:25:19.881 "trtype": "tcp", 00:25:19.881 "traddr": "10.0.0.2", 00:25:19.881 "adrfam": "ipv4", 00:25:19.881 "trsvcid": "4420", 00:25:19.881 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:19.881 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:19.881 "hdgst": false, 00:25:19.881 "ddgst": false 00:25:19.881 }, 00:25:19.881 "method": "bdev_nvme_attach_controller" 00:25:19.881 }' 00:25:19.881 [2024-11-16 17:44:57.346858] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:19.881 [2024-11-16 17:44:57.346957] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1657552 ] 00:25:20.138 EAL: No free 2048 kB hugepages reported on node 1 00:25:20.138 [2024-11-16 17:44:57.410983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:20.139 [2024-11-16 17:44:57.497656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:21.511 Running I/O for 1 seconds... 00:25:22.888 00:25:22.888 Latency(us) 00:25:22.888 [2024-11-16T16:45:00.380Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme1n1 : 1.10 394.86 24.68 0.00 0.00 159291.18 18252.99 124275.67 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme2n1 : 1.10 393.44 24.59 0.00 0.00 158750.03 18350.08 121168.78 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme3n1 : 1.11 391.81 24.49 0.00 0.00 158059.66 20680.25 117285.17 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme4n1 : 1.11 390.26 24.39 0.00 0.00 157533.04 21262.79 118061.89 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme5n1 : 1.12 388.53 24.28 0.00 0.00 157102.85 21651.15 120392.06 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme6n1 : 1.12 387.13 24.20 0.00 0.00 156785.62 19029.71 125829.12 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme7n1 : 1.12 386.22 24.14 0.00 0.00 156671.76 14466.47 126605.84 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme8n1 : 1.12 389.33 24.33 0.00 0.00 153959.50 19223.89 125052.40 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme9n1 : 1.13 384.88 24.06 0.00 0.00 155280.72 12524.66 128159.29 00:25:22.888 [2024-11-16T16:45:00.380Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:22.888 Verification LBA range: start 0x0 length 0x400 00:25:22.888 Nvme10n1 : 1.13 389.45 24.34 0.00 0.00 152679.38 5485.61 126605.84 00:25:22.888 [2024-11-16T16:45:00.380Z] =================================================================================================================== 00:25:22.888 [2024-11-16T16:45:00.380Z] Total : 3895.90 243.49 0.00 0.00 156603.51 5485.61 128159.29 00:25:22.888 17:45:00 -- target/shutdown.sh@93 -- # stoptarget 00:25:22.888 17:45:00 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:22.889 17:45:00 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:22.889 17:45:00 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:22.889 17:45:00 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:22.889 17:45:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:22.889 17:45:00 -- nvmf/common.sh@116 -- # sync 00:25:22.889 17:45:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:22.889 17:45:00 -- nvmf/common.sh@119 -- # set +e 00:25:22.889 17:45:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:22.889 17:45:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:22.889 rmmod nvme_tcp 00:25:22.889 rmmod nvme_fabrics 00:25:22.889 rmmod nvme_keyring 00:25:23.147 17:45:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:23.147 17:45:00 -- nvmf/common.sh@123 -- # set -e 00:25:23.147 17:45:00 -- nvmf/common.sh@124 -- # return 0 00:25:23.147 17:45:00 -- nvmf/common.sh@477 -- # '[' -n 1656933 ']' 00:25:23.147 17:45:00 -- nvmf/common.sh@478 -- # killprocess 1656933 00:25:23.147 17:45:00 -- common/autotest_common.sh@936 -- # '[' -z 1656933 ']' 00:25:23.147 17:45:00 -- common/autotest_common.sh@940 -- # kill -0 1656933 00:25:23.147 17:45:00 -- common/autotest_common.sh@941 -- # uname 00:25:23.147 17:45:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:23.147 17:45:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1656933 00:25:23.147 17:45:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:23.147 17:45:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:23.147 17:45:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1656933' 00:25:23.147 killing process with pid 1656933 00:25:23.147 17:45:00 -- common/autotest_common.sh@955 -- # kill 1656933 00:25:23.147 17:45:00 -- common/autotest_common.sh@960 -- # wait 1656933 00:25:23.714 17:45:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:23.714 17:45:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:23.715 17:45:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:23.715 17:45:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:23.715 17:45:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:23.715 17:45:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:23.715 17:45:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:23.715 17:45:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:25.617 17:45:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:25.617 00:25:25.617 real 0m12.335s 00:25:25.617 user 0m36.133s 00:25:25.617 sys 0m3.209s 00:25:25.617 17:45:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:25.617 17:45:02 -- common/autotest_common.sh@10 -- # set +x 00:25:25.617 ************************************ 00:25:25.617 END TEST nvmf_shutdown_tc1 00:25:25.617 ************************************ 00:25:25.617 17:45:02 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:25.617 17:45:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:25.617 17:45:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:25.617 17:45:02 -- common/autotest_common.sh@10 -- # set +x 00:25:25.617 ************************************ 00:25:25.617 START TEST nvmf_shutdown_tc2 00:25:25.617 ************************************ 00:25:25.617 17:45:02 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:25.617 17:45:02 -- target/shutdown.sh@98 -- # starttarget 00:25:25.617 17:45:02 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:25.617 17:45:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:25.617 17:45:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:25.617 17:45:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:25.617 17:45:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:25.617 17:45:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:25.617 17:45:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:25.617 17:45:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:25.617 17:45:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:25.618 17:45:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:25.618 17:45:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:25.618 17:45:03 -- common/autotest_common.sh@10 -- # set +x 00:25:25.618 17:45:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:25.618 17:45:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:25.618 17:45:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:25.618 17:45:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:25.618 17:45:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:25.618 17:45:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:25.618 17:45:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:25.618 17:45:03 -- nvmf/common.sh@294 -- # net_devs=() 00:25:25.618 17:45:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:25.618 17:45:03 -- nvmf/common.sh@295 -- # e810=() 00:25:25.618 17:45:03 -- nvmf/common.sh@295 -- # local -ga e810 00:25:25.618 17:45:03 -- nvmf/common.sh@296 -- # x722=() 00:25:25.618 17:45:03 -- nvmf/common.sh@296 -- # local -ga x722 00:25:25.618 17:45:03 -- nvmf/common.sh@297 -- # mlx=() 00:25:25.618 17:45:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:25.618 17:45:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:25.618 17:45:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:25.618 17:45:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:25.618 17:45:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:25.618 17:45:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.618 17:45:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:25.618 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:25.618 17:45:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:25.618 17:45:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:25.618 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:25.618 17:45:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:25.618 17:45:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.618 17:45:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.618 17:45:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.618 17:45:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.618 17:45:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:25.618 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:25.618 17:45:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.618 17:45:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:25.618 17:45:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:25.618 17:45:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:25.618 17:45:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:25.618 17:45:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:25.618 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:25.618 17:45:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:25.618 17:45:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:25.618 17:45:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:25.618 17:45:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:25.618 17:45:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:25.618 17:45:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:25.618 17:45:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:25.618 17:45:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:25.618 17:45:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:25.618 17:45:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:25.618 17:45:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:25.618 17:45:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:25.618 17:45:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:25.618 17:45:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:25.618 17:45:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:25.618 17:45:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:25.618 17:45:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:25.618 17:45:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:25.618 17:45:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:25.618 17:45:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:25.618 17:45:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:25.618 17:45:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:25.936 17:45:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:25.936 17:45:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:25.936 17:45:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:25.936 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:25.936 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:25:25.936 00:25:25.936 --- 10.0.0.2 ping statistics --- 00:25:25.936 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.936 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:25:25.936 17:45:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:25.936 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:25.936 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.189 ms 00:25:25.936 00:25:25.936 --- 10.0.0.1 ping statistics --- 00:25:25.936 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:25.936 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:25:25.936 17:45:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:25.936 17:45:03 -- nvmf/common.sh@410 -- # return 0 00:25:25.936 17:45:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:25.936 17:45:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:25.936 17:45:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:25.936 17:45:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:25.937 17:45:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:25.937 17:45:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:25.937 17:45:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:25.937 17:45:03 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:25.937 17:45:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:25.937 17:45:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:25.937 17:45:03 -- common/autotest_common.sh@10 -- # set +x 00:25:25.937 17:45:03 -- nvmf/common.sh@469 -- # nvmfpid=1658446 00:25:25.937 17:45:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:25.937 17:45:03 -- nvmf/common.sh@470 -- # waitforlisten 1658446 00:25:25.937 17:45:03 -- common/autotest_common.sh@829 -- # '[' -z 1658446 ']' 00:25:25.937 17:45:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:25.937 17:45:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:25.937 17:45:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:25.937 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:25.937 17:45:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:25.937 17:45:03 -- common/autotest_common.sh@10 -- # set +x 00:25:25.937 [2024-11-16 17:45:03.213930] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:25.937 [2024-11-16 17:45:03.214045] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:25.937 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.937 [2024-11-16 17:45:03.280436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:25.937 [2024-11-16 17:45:03.364931] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:25.937 [2024-11-16 17:45:03.365100] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:25.937 [2024-11-16 17:45:03.365118] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:25.937 [2024-11-16 17:45:03.365130] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:25.937 [2024-11-16 17:45:03.365214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:25.937 [2024-11-16 17:45:03.365266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:25.937 [2024-11-16 17:45:03.365317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:25.937 [2024-11-16 17:45:03.365320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:26.921 17:45:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:26.921 17:45:04 -- common/autotest_common.sh@862 -- # return 0 00:25:26.921 17:45:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:26.921 17:45:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:26.921 17:45:04 -- common/autotest_common.sh@10 -- # set +x 00:25:26.921 17:45:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:26.921 17:45:04 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:26.921 17:45:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.921 17:45:04 -- common/autotest_common.sh@10 -- # set +x 00:25:26.921 [2024-11-16 17:45:04.222402] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:26.921 17:45:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.921 17:45:04 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:26.921 17:45:04 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:26.921 17:45:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:26.921 17:45:04 -- common/autotest_common.sh@10 -- # set +x 00:25:26.921 17:45:04 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:26.921 17:45:04 -- target/shutdown.sh@28 -- # cat 00:25:26.921 17:45:04 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:26.921 17:45:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.921 17:45:04 -- common/autotest_common.sh@10 -- # set +x 00:25:26.921 Malloc1 00:25:26.921 [2024-11-16 17:45:04.315876] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:26.921 Malloc2 00:25:26.921 Malloc3 00:25:27.182 Malloc4 00:25:27.182 Malloc5 00:25:27.182 Malloc6 00:25:27.182 Malloc7 00:25:27.182 Malloc8 00:25:27.444 Malloc9 00:25:27.444 Malloc10 00:25:27.444 17:45:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:27.444 17:45:04 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:27.444 17:45:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:27.444 17:45:04 -- common/autotest_common.sh@10 -- # set +x 00:25:27.444 17:45:04 -- target/shutdown.sh@102 -- # perfpid=1658665 00:25:27.444 17:45:04 -- target/shutdown.sh@103 -- # waitforlisten 1658665 /var/tmp/bdevperf.sock 00:25:27.444 17:45:04 -- common/autotest_common.sh@829 -- # '[' -z 1658665 ']' 00:25:27.444 17:45:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:27.445 17:45:04 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:27.445 17:45:04 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:27.445 17:45:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:27.445 17:45:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:27.445 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:27.445 17:45:04 -- nvmf/common.sh@520 -- # config=() 00:25:27.445 17:45:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:27.445 17:45:04 -- nvmf/common.sh@520 -- # local subsystem config 00:25:27.445 17:45:04 -- common/autotest_common.sh@10 -- # set +x 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:27.445 { 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme$subsystem", 00:25:27.445 "trtype": "$TEST_TRANSPORT", 00:25:27.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "$NVMF_PORT", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:27.445 "hdgst": ${hdgst:-false}, 00:25:27.445 "ddgst": ${ddgst:-false} 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 } 00:25:27.445 EOF 00:25:27.445 )") 00:25:27.445 17:45:04 -- nvmf/common.sh@542 -- # cat 00:25:27.445 17:45:04 -- nvmf/common.sh@544 -- # jq . 00:25:27.445 17:45:04 -- nvmf/common.sh@545 -- # IFS=, 00:25:27.445 17:45:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme1", 00:25:27.445 "trtype": "tcp", 00:25:27.445 "traddr": "10.0.0.2", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "4420", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:27.445 "hdgst": false, 00:25:27.445 "ddgst": false 00:25:27.445 }, 00:25:27.445 "method": "bdev_nvme_attach_controller" 00:25:27.445 },{ 00:25:27.445 "params": { 00:25:27.445 "name": "Nvme2", 00:25:27.445 "trtype": "tcp", 00:25:27.445 "traddr": "10.0.0.2", 00:25:27.445 "adrfam": "ipv4", 00:25:27.445 "trsvcid": "4420", 00:25:27.445 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:27.445 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:27.445 "hdgst": false, 00:25:27.445 "ddgst": false 00:25:27.445 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 },{ 00:25:27.446 "params": { 00:25:27.446 "name": "Nvme3", 00:25:27.446 "trtype": "tcp", 00:25:27.446 "traddr": "10.0.0.2", 00:25:27.446 "adrfam": "ipv4", 00:25:27.446 "trsvcid": "4420", 00:25:27.446 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:27.446 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:27.446 "hdgst": false, 00:25:27.446 "ddgst": false 00:25:27.446 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 },{ 00:25:27.446 "params": { 00:25:27.446 "name": "Nvme4", 00:25:27.446 "trtype": "tcp", 00:25:27.446 "traddr": "10.0.0.2", 00:25:27.446 "adrfam": "ipv4", 00:25:27.446 "trsvcid": "4420", 00:25:27.446 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:27.446 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:27.446 "hdgst": false, 00:25:27.446 "ddgst": false 00:25:27.446 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 },{ 00:25:27.446 "params": { 00:25:27.446 "name": "Nvme5", 00:25:27.446 "trtype": "tcp", 00:25:27.446 "traddr": "10.0.0.2", 00:25:27.446 "adrfam": "ipv4", 00:25:27.446 "trsvcid": "4420", 00:25:27.446 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:27.446 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:27.446 "hdgst": false, 00:25:27.446 "ddgst": false 00:25:27.446 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 },{ 00:25:27.446 "params": { 00:25:27.446 "name": "Nvme6", 00:25:27.446 "trtype": "tcp", 00:25:27.446 "traddr": "10.0.0.2", 00:25:27.446 "adrfam": "ipv4", 00:25:27.446 "trsvcid": "4420", 00:25:27.446 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:27.446 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:27.446 "hdgst": false, 00:25:27.446 "ddgst": false 00:25:27.446 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 },{ 00:25:27.446 "params": { 00:25:27.446 "name": "Nvme7", 00:25:27.446 "trtype": "tcp", 00:25:27.446 "traddr": "10.0.0.2", 00:25:27.446 "adrfam": "ipv4", 00:25:27.446 "trsvcid": "4420", 00:25:27.446 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:27.446 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:27.446 "hdgst": false, 00:25:27.446 "ddgst": false 00:25:27.446 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 },{ 00:25:27.446 "params": { 00:25:27.446 "name": "Nvme8", 00:25:27.446 "trtype": "tcp", 00:25:27.446 "traddr": "10.0.0.2", 00:25:27.446 "adrfam": "ipv4", 00:25:27.446 "trsvcid": "4420", 00:25:27.446 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:27.446 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:27.446 "hdgst": false, 00:25:27.446 "ddgst": false 00:25:27.446 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 },{ 00:25:27.446 "params": { 00:25:27.446 "name": "Nvme9", 00:25:27.446 "trtype": "tcp", 00:25:27.446 "traddr": "10.0.0.2", 00:25:27.446 "adrfam": "ipv4", 00:25:27.446 "trsvcid": "4420", 00:25:27.446 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:27.446 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:27.446 "hdgst": false, 00:25:27.446 "ddgst": false 00:25:27.446 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 },{ 00:25:27.446 "params": { 00:25:27.446 "name": "Nvme10", 00:25:27.446 "trtype": "tcp", 00:25:27.446 "traddr": "10.0.0.2", 00:25:27.446 "adrfam": "ipv4", 00:25:27.446 "trsvcid": "4420", 00:25:27.446 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:27.446 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:27.446 "hdgst": false, 00:25:27.446 "ddgst": false 00:25:27.446 }, 00:25:27.446 "method": "bdev_nvme_attach_controller" 00:25:27.446 }' 00:25:27.446 [2024-11-16 17:45:04.832158] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:27.446 [2024-11-16 17:45:04.832243] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1658665 ] 00:25:27.446 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.446 [2024-11-16 17:45:04.899247] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:27.705 [2024-11-16 17:45:04.989199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:29.611 Running I/O for 10 seconds... 00:25:29.611 17:45:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:29.611 17:45:06 -- common/autotest_common.sh@862 -- # return 0 00:25:29.611 17:45:06 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:29.611 17:45:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.611 17:45:06 -- common/autotest_common.sh@10 -- # set +x 00:25:29.612 17:45:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.612 17:45:06 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:29.612 17:45:06 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:29.612 17:45:06 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:29.612 17:45:06 -- target/shutdown.sh@57 -- # local ret=1 00:25:29.612 17:45:06 -- target/shutdown.sh@58 -- # local i 00:25:29.612 17:45:06 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:29.612 17:45:06 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:29.612 17:45:06 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:29.612 17:45:06 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:29.612 17:45:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.612 17:45:06 -- common/autotest_common.sh@10 -- # set +x 00:25:29.612 17:45:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.612 17:45:06 -- target/shutdown.sh@60 -- # read_io_count=3 00:25:29.612 17:45:06 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:25:29.612 17:45:06 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:29.612 17:45:06 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:29.612 17:45:06 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:29.612 17:45:06 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:29.612 17:45:06 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:29.612 17:45:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:29.612 17:45:06 -- common/autotest_common.sh@10 -- # set +x 00:25:29.612 17:45:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:29.612 17:45:07 -- target/shutdown.sh@60 -- # read_io_count=129 00:25:29.612 17:45:07 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:25:29.612 17:45:07 -- target/shutdown.sh@64 -- # ret=0 00:25:29.612 17:45:07 -- target/shutdown.sh@65 -- # break 00:25:29.612 17:45:07 -- target/shutdown.sh@69 -- # return 0 00:25:29.612 17:45:07 -- target/shutdown.sh@109 -- # killprocess 1658665 00:25:29.612 17:45:07 -- common/autotest_common.sh@936 -- # '[' -z 1658665 ']' 00:25:29.612 17:45:07 -- common/autotest_common.sh@940 -- # kill -0 1658665 00:25:29.612 17:45:07 -- common/autotest_common.sh@941 -- # uname 00:25:29.612 17:45:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:29.612 17:45:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1658665 00:25:29.612 17:45:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:29.612 17:45:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:29.612 17:45:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1658665' 00:25:29.612 killing process with pid 1658665 00:25:29.612 17:45:07 -- common/autotest_common.sh@955 -- # kill 1658665 00:25:29.612 17:45:07 -- common/autotest_common.sh@960 -- # wait 1658665 00:25:29.871 Received shutdown signal, test time was about 0.520040 seconds 00:25:29.871 00:25:29.871 Latency(us) 00:25:29.871 [2024-11-16T16:45:07.363Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme1n1 : 0.51 443.86 27.74 0.00 0.00 140309.64 13107.20 118838.61 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme2n1 : 0.49 384.31 24.02 0.00 0.00 157012.50 26408.58 151460.98 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme3n1 : 0.51 442.73 27.67 0.00 0.00 136490.32 12427.57 118061.89 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme4n1 : 0.52 441.58 27.60 0.00 0.00 134824.88 13010.11 115731.72 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme5n1 : 0.52 439.13 27.45 0.00 0.00 133418.35 13592.65 114178.28 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme6n1 : 0.49 390.89 24.43 0.00 0.00 145222.15 21942.42 135149.80 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme7n1 : 0.49 388.08 24.25 0.00 0.00 142483.18 20388.98 113401.55 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme8n1 : 0.49 389.64 24.35 0.00 0.00 140024.75 26020.22 109517.94 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme9n1 : 0.50 381.15 23.82 0.00 0.00 141282.84 25437.68 125052.40 00:25:29.871 [2024-11-16T16:45:07.363Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:29.871 Verification LBA range: start 0x0 length 0x400 00:25:29.871 Nvme10n1 : 0.51 373.89 23.37 0.00 0.00 141582.29 27573.67 123498.95 00:25:29.871 [2024-11-16T16:45:07.363Z] =================================================================================================================== 00:25:29.871 [2024-11-16T16:45:07.363Z] Total : 4075.26 254.70 0.00 0.00 140894.40 12427.57 151460.98 00:25:30.130 17:45:07 -- target/shutdown.sh@112 -- # sleep 1 00:25:31.069 17:45:08 -- target/shutdown.sh@113 -- # kill -0 1658446 00:25:31.069 17:45:08 -- target/shutdown.sh@115 -- # stoptarget 00:25:31.069 17:45:08 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:31.069 17:45:08 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:31.069 17:45:08 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:31.069 17:45:08 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:31.069 17:45:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:31.069 17:45:08 -- nvmf/common.sh@116 -- # sync 00:25:31.069 17:45:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:31.069 17:45:08 -- nvmf/common.sh@119 -- # set +e 00:25:31.069 17:45:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:31.069 17:45:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:31.069 rmmod nvme_tcp 00:25:31.069 rmmod nvme_fabrics 00:25:31.069 rmmod nvme_keyring 00:25:31.069 17:45:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:31.069 17:45:08 -- nvmf/common.sh@123 -- # set -e 00:25:31.069 17:45:08 -- nvmf/common.sh@124 -- # return 0 00:25:31.069 17:45:08 -- nvmf/common.sh@477 -- # '[' -n 1658446 ']' 00:25:31.069 17:45:08 -- nvmf/common.sh@478 -- # killprocess 1658446 00:25:31.069 17:45:08 -- common/autotest_common.sh@936 -- # '[' -z 1658446 ']' 00:25:31.069 17:45:08 -- common/autotest_common.sh@940 -- # kill -0 1658446 00:25:31.069 17:45:08 -- common/autotest_common.sh@941 -- # uname 00:25:31.069 17:45:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:31.069 17:45:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1658446 00:25:31.069 17:45:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:31.069 17:45:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:31.069 17:45:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1658446' 00:25:31.069 killing process with pid 1658446 00:25:31.069 17:45:08 -- common/autotest_common.sh@955 -- # kill 1658446 00:25:31.069 17:45:08 -- common/autotest_common.sh@960 -- # wait 1658446 00:25:31.637 17:45:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:31.637 17:45:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:31.637 17:45:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:31.637 17:45:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:31.637 17:45:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:31.637 17:45:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:31.637 17:45:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:31.637 17:45:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:33.544 17:45:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:33.544 00:25:33.544 real 0m7.981s 00:25:33.544 user 0m24.940s 00:25:33.544 sys 0m1.383s 00:25:33.544 17:45:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:33.544 17:45:10 -- common/autotest_common.sh@10 -- # set +x 00:25:33.544 ************************************ 00:25:33.544 END TEST nvmf_shutdown_tc2 00:25:33.544 ************************************ 00:25:33.544 17:45:10 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:33.544 17:45:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:33.544 17:45:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:33.544 17:45:10 -- common/autotest_common.sh@10 -- # set +x 00:25:33.544 ************************************ 00:25:33.544 START TEST nvmf_shutdown_tc3 00:25:33.544 ************************************ 00:25:33.544 17:45:11 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:33.544 17:45:11 -- target/shutdown.sh@120 -- # starttarget 00:25:33.544 17:45:11 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:33.544 17:45:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:33.544 17:45:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:33.544 17:45:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:33.544 17:45:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:33.544 17:45:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:33.544 17:45:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:33.544 17:45:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:33.544 17:45:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:33.544 17:45:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:33.544 17:45:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:33.544 17:45:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:33.544 17:45:11 -- common/autotest_common.sh@10 -- # set +x 00:25:33.544 17:45:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:33.544 17:45:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:33.544 17:45:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:33.544 17:45:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:33.544 17:45:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:33.544 17:45:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:33.544 17:45:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:33.544 17:45:11 -- nvmf/common.sh@294 -- # net_devs=() 00:25:33.544 17:45:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:33.544 17:45:11 -- nvmf/common.sh@295 -- # e810=() 00:25:33.544 17:45:11 -- nvmf/common.sh@295 -- # local -ga e810 00:25:33.544 17:45:11 -- nvmf/common.sh@296 -- # x722=() 00:25:33.544 17:45:11 -- nvmf/common.sh@296 -- # local -ga x722 00:25:33.544 17:45:11 -- nvmf/common.sh@297 -- # mlx=() 00:25:33.544 17:45:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:33.544 17:45:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:33.544 17:45:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:33.544 17:45:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:33.545 17:45:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:33.545 17:45:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:33.545 17:45:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:33.545 17:45:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.545 17:45:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:33.545 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:33.545 17:45:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:33.545 17:45:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:33.545 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:33.545 17:45:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:33.545 17:45:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.545 17:45:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.545 17:45:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.545 17:45:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.545 17:45:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:33.545 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:33.545 17:45:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.545 17:45:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:33.545 17:45:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:33.545 17:45:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:33.545 17:45:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:33.545 17:45:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:33.545 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:33.545 17:45:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:33.545 17:45:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:33.545 17:45:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:33.545 17:45:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:33.545 17:45:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:33.545 17:45:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:33.545 17:45:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:33.545 17:45:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:33.545 17:45:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:33.545 17:45:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:33.545 17:45:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:33.545 17:45:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:33.545 17:45:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:33.545 17:45:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:33.545 17:45:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:33.545 17:45:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:33.545 17:45:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:33.545 17:45:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:33.804 17:45:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:33.805 17:45:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:33.805 17:45:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:33.805 17:45:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:33.805 17:45:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:33.805 17:45:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:33.805 17:45:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:33.805 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:33.805 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:25:33.805 00:25:33.805 --- 10.0.0.2 ping statistics --- 00:25:33.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.805 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:25:33.805 17:45:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:33.805 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:33.805 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:25:33.805 00:25:33.805 --- 10.0.0.1 ping statistics --- 00:25:33.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:33.805 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:25:33.805 17:45:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:33.805 17:45:11 -- nvmf/common.sh@410 -- # return 0 00:25:33.805 17:45:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:33.805 17:45:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:33.805 17:45:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:33.805 17:45:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:33.805 17:45:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:33.805 17:45:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:33.805 17:45:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:33.805 17:45:11 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:33.805 17:45:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:33.805 17:45:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:33.805 17:45:11 -- common/autotest_common.sh@10 -- # set +x 00:25:33.805 17:45:11 -- nvmf/common.sh@469 -- # nvmfpid=1660078 00:25:33.805 17:45:11 -- nvmf/common.sh@470 -- # waitforlisten 1660078 00:25:33.805 17:45:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:33.805 17:45:11 -- common/autotest_common.sh@829 -- # '[' -z 1660078 ']' 00:25:33.805 17:45:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:33.805 17:45:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:33.805 17:45:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:33.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:33.805 17:45:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:33.805 17:45:11 -- common/autotest_common.sh@10 -- # set +x 00:25:33.805 [2024-11-16 17:45:11.211042] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:33.805 [2024-11-16 17:45:11.211132] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:33.805 EAL: No free 2048 kB hugepages reported on node 1 00:25:33.805 [2024-11-16 17:45:11.280518] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:34.063 [2024-11-16 17:45:11.370168] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:34.063 [2024-11-16 17:45:11.370336] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:34.063 [2024-11-16 17:45:11.370367] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:34.063 [2024-11-16 17:45:11.370383] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:34.063 [2024-11-16 17:45:11.370475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:34.063 [2024-11-16 17:45:11.370595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:34.063 [2024-11-16 17:45:11.370660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:34.063 [2024-11-16 17:45:11.370663] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:35.002 17:45:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:35.002 17:45:12 -- common/autotest_common.sh@862 -- # return 0 00:25:35.002 17:45:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:35.002 17:45:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:35.002 17:45:12 -- common/autotest_common.sh@10 -- # set +x 00:25:35.002 17:45:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:35.002 17:45:12 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:35.002 17:45:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.002 17:45:12 -- common/autotest_common.sh@10 -- # set +x 00:25:35.002 [2024-11-16 17:45:12.197315] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:35.002 17:45:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.002 17:45:12 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:35.002 17:45:12 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:35.002 17:45:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:35.002 17:45:12 -- common/autotest_common.sh@10 -- # set +x 00:25:35.002 17:45:12 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:35.002 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.002 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.002 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.002 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.002 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.003 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.003 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.003 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.003 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.003 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.003 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.003 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.003 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.003 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.003 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.003 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.003 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.003 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.003 17:45:12 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:35.003 17:45:12 -- target/shutdown.sh@28 -- # cat 00:25:35.003 17:45:12 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:35.003 17:45:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:35.003 17:45:12 -- common/autotest_common.sh@10 -- # set +x 00:25:35.003 Malloc1 00:25:35.003 [2024-11-16 17:45:12.272509] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:35.003 Malloc2 00:25:35.003 Malloc3 00:25:35.003 Malloc4 00:25:35.003 Malloc5 00:25:35.003 Malloc6 00:25:35.261 Malloc7 00:25:35.261 Malloc8 00:25:35.261 Malloc9 00:25:35.261 Malloc10 00:25:35.261 17:45:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:35.261 17:45:12 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:35.261 17:45:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:35.261 17:45:12 -- common/autotest_common.sh@10 -- # set +x 00:25:35.261 17:45:12 -- target/shutdown.sh@124 -- # perfpid=1660307 00:25:35.261 17:45:12 -- target/shutdown.sh@125 -- # waitforlisten 1660307 /var/tmp/bdevperf.sock 00:25:35.261 17:45:12 -- common/autotest_common.sh@829 -- # '[' -z 1660307 ']' 00:25:35.261 17:45:12 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:35.261 17:45:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:35.261 17:45:12 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:35.261 17:45:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:35.261 17:45:12 -- nvmf/common.sh@520 -- # config=() 00:25:35.261 17:45:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:35.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:35.261 17:45:12 -- nvmf/common.sh@520 -- # local subsystem config 00:25:35.261 17:45:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:35.261 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.261 17:45:12 -- common/autotest_common.sh@10 -- # set +x 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.262 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.262 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.262 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.262 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.262 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.262 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.262 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.262 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.262 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.262 { 00:25:35.262 "params": { 00:25:35.262 "name": "Nvme$subsystem", 00:25:35.262 "trtype": "$TEST_TRANSPORT", 00:25:35.262 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.262 "adrfam": "ipv4", 00:25:35.262 "trsvcid": "$NVMF_PORT", 00:25:35.262 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.262 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.262 "hdgst": ${hdgst:-false}, 00:25:35.262 "ddgst": ${ddgst:-false} 00:25:35.262 }, 00:25:35.262 "method": "bdev_nvme_attach_controller" 00:25:35.262 } 00:25:35.262 EOF 00:25:35.262 )") 00:25:35.522 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.522 17:45:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:35.522 17:45:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:35.522 { 00:25:35.522 "params": { 00:25:35.522 "name": "Nvme$subsystem", 00:25:35.522 "trtype": "$TEST_TRANSPORT", 00:25:35.522 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:35.522 "adrfam": "ipv4", 00:25:35.522 "trsvcid": "$NVMF_PORT", 00:25:35.522 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:35.522 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:35.522 "hdgst": ${hdgst:-false}, 00:25:35.522 "ddgst": ${ddgst:-false} 00:25:35.522 }, 00:25:35.522 "method": "bdev_nvme_attach_controller" 00:25:35.522 } 00:25:35.522 EOF 00:25:35.522 )") 00:25:35.522 17:45:12 -- nvmf/common.sh@542 -- # cat 00:25:35.522 17:45:12 -- nvmf/common.sh@544 -- # jq . 00:25:35.522 17:45:12 -- nvmf/common.sh@545 -- # IFS=, 00:25:35.522 17:45:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:35.522 "params": { 00:25:35.522 "name": "Nvme1", 00:25:35.522 "trtype": "tcp", 00:25:35.522 "traddr": "10.0.0.2", 00:25:35.522 "adrfam": "ipv4", 00:25:35.522 "trsvcid": "4420", 00:25:35.522 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:35.522 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:35.522 "hdgst": false, 00:25:35.522 "ddgst": false 00:25:35.522 }, 00:25:35.522 "method": "bdev_nvme_attach_controller" 00:25:35.522 },{ 00:25:35.522 "params": { 00:25:35.522 "name": "Nvme2", 00:25:35.522 "trtype": "tcp", 00:25:35.522 "traddr": "10.0.0.2", 00:25:35.522 "adrfam": "ipv4", 00:25:35.522 "trsvcid": "4420", 00:25:35.522 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:35.522 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:35.522 "hdgst": false, 00:25:35.522 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 },{ 00:25:35.523 "params": { 00:25:35.523 "name": "Nvme3", 00:25:35.523 "trtype": "tcp", 00:25:35.523 "traddr": "10.0.0.2", 00:25:35.523 "adrfam": "ipv4", 00:25:35.523 "trsvcid": "4420", 00:25:35.523 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:35.523 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:35.523 "hdgst": false, 00:25:35.523 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 },{ 00:25:35.523 "params": { 00:25:35.523 "name": "Nvme4", 00:25:35.523 "trtype": "tcp", 00:25:35.523 "traddr": "10.0.0.2", 00:25:35.523 "adrfam": "ipv4", 00:25:35.523 "trsvcid": "4420", 00:25:35.523 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:35.523 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:35.523 "hdgst": false, 00:25:35.523 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 },{ 00:25:35.523 "params": { 00:25:35.523 "name": "Nvme5", 00:25:35.523 "trtype": "tcp", 00:25:35.523 "traddr": "10.0.0.2", 00:25:35.523 "adrfam": "ipv4", 00:25:35.523 "trsvcid": "4420", 00:25:35.523 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:35.523 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:35.523 "hdgst": false, 00:25:35.523 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 },{ 00:25:35.523 "params": { 00:25:35.523 "name": "Nvme6", 00:25:35.523 "trtype": "tcp", 00:25:35.523 "traddr": "10.0.0.2", 00:25:35.523 "adrfam": "ipv4", 00:25:35.523 "trsvcid": "4420", 00:25:35.523 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:35.523 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:35.523 "hdgst": false, 00:25:35.523 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 },{ 00:25:35.523 "params": { 00:25:35.523 "name": "Nvme7", 00:25:35.523 "trtype": "tcp", 00:25:35.523 "traddr": "10.0.0.2", 00:25:35.523 "adrfam": "ipv4", 00:25:35.523 "trsvcid": "4420", 00:25:35.523 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:35.523 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:35.523 "hdgst": false, 00:25:35.523 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 },{ 00:25:35.523 "params": { 00:25:35.523 "name": "Nvme8", 00:25:35.523 "trtype": "tcp", 00:25:35.523 "traddr": "10.0.0.2", 00:25:35.523 "adrfam": "ipv4", 00:25:35.523 "trsvcid": "4420", 00:25:35.523 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:35.523 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:35.523 "hdgst": false, 00:25:35.523 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 },{ 00:25:35.523 "params": { 00:25:35.523 "name": "Nvme9", 00:25:35.523 "trtype": "tcp", 00:25:35.523 "traddr": "10.0.0.2", 00:25:35.523 "adrfam": "ipv4", 00:25:35.523 "trsvcid": "4420", 00:25:35.523 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:35.523 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:35.523 "hdgst": false, 00:25:35.523 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 },{ 00:25:35.523 "params": { 00:25:35.523 "name": "Nvme10", 00:25:35.523 "trtype": "tcp", 00:25:35.523 "traddr": "10.0.0.2", 00:25:35.523 "adrfam": "ipv4", 00:25:35.523 "trsvcid": "4420", 00:25:35.523 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:35.523 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:35.523 "hdgst": false, 00:25:35.523 "ddgst": false 00:25:35.523 }, 00:25:35.523 "method": "bdev_nvme_attach_controller" 00:25:35.523 }' 00:25:35.523 [2024-11-16 17:45:12.767036] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:35.523 [2024-11-16 17:45:12.767106] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1660307 ] 00:25:35.523 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.523 [2024-11-16 17:45:12.832291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:35.523 [2024-11-16 17:45:12.919704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:37.426 Running I/O for 10 seconds... 00:25:38.011 17:45:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:38.011 17:45:15 -- common/autotest_common.sh@862 -- # return 0 00:25:38.011 17:45:15 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:38.011 17:45:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.011 17:45:15 -- common/autotest_common.sh@10 -- # set +x 00:25:38.011 17:45:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.011 17:45:15 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:38.011 17:45:15 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:38.011 17:45:15 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:38.011 17:45:15 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:38.011 17:45:15 -- target/shutdown.sh@57 -- # local ret=1 00:25:38.011 17:45:15 -- target/shutdown.sh@58 -- # local i 00:25:38.011 17:45:15 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:38.011 17:45:15 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:38.011 17:45:15 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:38.011 17:45:15 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:38.011 17:45:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.011 17:45:15 -- common/autotest_common.sh@10 -- # set +x 00:25:38.011 17:45:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.011 17:45:15 -- target/shutdown.sh@60 -- # read_io_count=254 00:25:38.011 17:45:15 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:25:38.011 17:45:15 -- target/shutdown.sh@64 -- # ret=0 00:25:38.011 17:45:15 -- target/shutdown.sh@65 -- # break 00:25:38.011 17:45:15 -- target/shutdown.sh@69 -- # return 0 00:25:38.011 17:45:15 -- target/shutdown.sh@134 -- # killprocess 1660078 00:25:38.011 17:45:15 -- common/autotest_common.sh@936 -- # '[' -z 1660078 ']' 00:25:38.011 17:45:15 -- common/autotest_common.sh@940 -- # kill -0 1660078 00:25:38.011 17:45:15 -- common/autotest_common.sh@941 -- # uname 00:25:38.011 17:45:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:38.011 17:45:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1660078 00:25:38.011 17:45:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:38.011 17:45:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:38.011 17:45:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1660078' 00:25:38.011 killing process with pid 1660078 00:25:38.011 17:45:15 -- common/autotest_common.sh@955 -- # kill 1660078 00:25:38.011 17:45:15 -- common/autotest_common.sh@960 -- # wait 1660078 00:25:38.011 [2024-11-16 17:45:15.401083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.401993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.402005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.402016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.402028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.402040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.402052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.402064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x731e90 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403677] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.403992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.404004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.404016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.404028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.404040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.404051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.404063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.011 [2024-11-16 17:45:15.404076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.404289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x734750 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.405980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732340 is same with the state(5) to be set 00:25:38.012 [2024-11-16 17:45:15.406525] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.013 [2024-11-16 17:45:15.406564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.013 [2024-11-16 17:45:15.406582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.013 [2024-11-16 17:45:15.406596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.013 [2024-11-16 17:45:15.406610] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.013 [2024-11-16 17:45:15.406634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.013 [2024-11-16 17:45:15.406649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.013 [2024-11-16 17:45:15.406664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.013 [2024-11-16 17:45:15.406677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22c0c50 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.406741] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.013 [2024-11-16 17:45:15.406762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.013 [2024-11-16 17:45:15.406777] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.013 [2024-11-16 17:45:15.406791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.013 [2024-11-16 17:45:15.406804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.013 [2024-11-16 17:45:15.406817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.013 [2024-11-16 17:45:15.406832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.013 [2024-11-16 17:45:15.406850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.013 [2024-11-16 17:45:15.406864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20fb6b0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413965] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.413990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414263] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.414367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7327f0 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.415913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.415949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.415964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.013 [2024-11-16 17:45:15.415978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.415990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416079] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416589] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.416751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x732c80 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.014 [2024-11-16 17:45:15.417931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.417943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.417955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.417976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.417989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.418376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733130 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.015 [2024-11-16 17:45:15.419842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419866] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.419988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.420189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7335e0 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.016 [2024-11-16 17:45:15.425409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.016 [2024-11-16 17:45:15.425435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425442] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.016 [2024-11-16 17:45:15.425449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.016 [2024-11-16 17:45:15.425462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425469] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.016 [2024-11-16 17:45:15.425475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.016 [2024-11-16 17:45:15.425488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425495] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.016 [2024-11-16 17:45:15.425501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.016 [2024-11-16 17:45:15.425514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22ac660 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425573] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.016 [2024-11-16 17:45:15.425583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.016 [2024-11-16 17:45:15.425613] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-11-16 17:45:15.425611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:38.016 he state(5) to be set 00:25:38.016 [2024-11-16 17:45:15.425641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-16 17:45:15.425642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 he state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with t[2024-11-16 17:45:15.425658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nshe state(5) to be set 00:25:38.017 id:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.425671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with t[2024-11-16 17:45:15.425672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:38.017 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.425685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.425699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.425711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22b1700 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with t[2024-11-16 17:45:15.425748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22c0c50 (9): he state(5) to be set 00:25:38.017 Bad file descriptor 00:25:38.017 [2024-11-16 17:45:15.425765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733940 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.425826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.425847] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.425861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.425874] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.425888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.425901] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.425924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.425936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x229cc80 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.425965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20fb6b0 (9): Bad file descriptor 00:25:38.017 [2024-11-16 17:45:15.426013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426050] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426077] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426104] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22c2100 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426210] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426264] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2108d30 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426338] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426372] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426398] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426424] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.017 [2024-11-16 17:45:15.426437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.017 [2024-11-16 17:45:15.426449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x211da30 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426952] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.426989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.017 [2024-11-16 17:45:15.427236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x733df0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.427691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.427980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.427993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.428397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.428411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.428427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.428441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.018 [2024-11-16 17:45:15.428456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.428456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:37248 len:12he state(5) to be set 00:25:38.018 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.018 [2024-11-16 17:45:15.428471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.428472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:38.018 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.018 [2024-11-16 17:45:15.428485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42496 len:12[2024-11-16 17:45:15.428520] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 he state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.428534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:38.019 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.428564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:38.019 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38016 len:12[2024-11-16 17:45:15.428672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 he state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.428688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:38.019 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.428767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38656 len:12he state(5) to be set 00:25:38.019 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.428783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:38.019 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.428920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:38.019 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.428984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.428987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.428996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.429001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.429009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.429022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.429021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39680 len:12he state(5) to be set 00:25:38.019 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.429036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.429038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.019 [2024-11-16 17:45:15.429049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.019 [2024-11-16 17:45:15.429054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.019 [2024-11-16 17:45:15.429061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39936 len:12[2024-11-16 17:45:15.429086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 he state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.429099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:38.020 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with t[2024-11-16 17:45:15.429176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43392 len:12he state(5) to be set 00:25:38.020 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-16 17:45:15.429259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 he state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7342a0 is same with the state(5) to be set 00:25:38.020 [2024-11-16 17:45:15.429289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.429705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.429719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430260] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2172f70 was disconnected and freed. reset controller. 00:25:38.020 [2024-11-16 17:45:15.430377] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:38.020 [2024-11-16 17:45:15.430708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.430979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.430993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.020 [2024-11-16 17:45:15.431009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.020 [2024-11-16 17:45:15.431023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.431972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.431986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.021 [2024-11-16 17:45:15.432249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.021 [2024-11-16 17:45:15.432264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432826] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x216edd0 was disconnected and freed. reset controller. 00:25:38.022 [2024-11-16 17:45:15.432871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.432965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.432985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.022 [2024-11-16 17:45:15.433612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.022 [2024-11-16 17:45:15.433641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.433975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.433990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.023 [2024-11-16 17:45:15.434847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.023 [2024-11-16 17:45:15.434861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.434966] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x21703b0 was disconnected and freed. reset controller. 00:25:38.024 [2024-11-16 17:45:15.436390] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.024 [2024-11-16 17:45:15.436416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.436438] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.024 [2024-11-16 17:45:15.436452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.436466] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.024 [2024-11-16 17:45:15.436479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.436493] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.024 [2024-11-16 17:45:15.436506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.436519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2152650 is same with the state(5) to be set 00:25:38.024 [2024-11-16 17:45:15.436569] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.024 [2024-11-16 17:45:15.436590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.436609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.024 [2024-11-16 17:45:15.436633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.436647] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.024 [2024-11-16 17:45:15.436661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.436674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.024 [2024-11-16 17:45:15.436687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.436699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2150070 is same with the state(5) to be set 00:25:38.024 [2024-11-16 17:45:15.436724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ac660 (9): Bad file descriptor 00:25:38.024 [2024-11-16 17:45:15.436755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22b1700 (9): Bad file descriptor 00:25:38.024 [2024-11-16 17:45:15.436780] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.024 [2024-11-16 17:45:15.436801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x229cc80 (9): Bad file descriptor 00:25:38.024 [2024-11-16 17:45:15.436835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22c2100 (9): Bad file descriptor 00:25:38.024 [2024-11-16 17:45:15.436866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2108d30 (9): Bad file descriptor 00:25:38.024 [2024-11-16 17:45:15.436897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x211da30 (9): Bad file descriptor 00:25:38.024 [2024-11-16 17:45:15.437009] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:38.024 [2024-11-16 17:45:15.439484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.024 [2024-11-16 17:45:15.439510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.024 [2024-11-16 17:45:15.439537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.439976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.439992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.025 [2024-11-16 17:45:15.440786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.025 [2024-11-16 17:45:15.440800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.440815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.440828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.440844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.440858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.440874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.440888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.440904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.440918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.440933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.440947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.440968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.440982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.440998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441611] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2171990 was disconnected and freed. reset controller. 00:25:38.026 [2024-11-16 17:45:15.441702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:38.026 [2024-11-16 17:45:15.441806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.441980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.441994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.026 [2024-11-16 17:45:15.442269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.026 [2024-11-16 17:45:15.442285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.442972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.442986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.027 [2024-11-16 17:45:15.443479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.027 [2024-11-16 17:45:15.443493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.443777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.443791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x216d010 is same with the state(5) to be set 00:25:38.028 [2024-11-16 17:45:15.446734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:38.028 [2024-11-16 17:45:15.446781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:38.028 [2024-11-16 17:45:15.446804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:38.028 [2024-11-16 17:45:15.446849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2150070 (9): Bad file descriptor 00:25:38.028 [2024-11-16 17:45:15.447041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.028 [2024-11-16 17:45:15.447138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.028 [2024-11-16 17:45:15.447163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22b1700 with addr=10.0.0.2, port=4420 00:25:38.028 [2024-11-16 17:45:15.447181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22b1700 is same with the state(5) to be set 00:25:38.028 [2024-11-16 17:45:15.447228] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2152650 (9): Bad file descriptor 00:25:38.028 [2024-11-16 17:45:15.447423] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:38.028 [2024-11-16 17:45:15.448088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:38.028 [2024-11-16 17:45:15.448200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.028 [2024-11-16 17:45:15.448286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.028 [2024-11-16 17:45:15.448310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22c0c50 with addr=10.0.0.2, port=4420 00:25:38.028 [2024-11-16 17:45:15.448327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22c0c50 is same with the state(5) to be set 00:25:38.028 [2024-11-16 17:45:15.448415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.028 [2024-11-16 17:45:15.448508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.028 [2024-11-16 17:45:15.448532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20fb6b0 with addr=10.0.0.2, port=4420 00:25:38.028 [2024-11-16 17:45:15.448549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20fb6b0 is same with the state(5) to be set 00:25:38.028 [2024-11-16 17:45:15.448579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22b1700 (9): Bad file descriptor 00:25:38.028 [2024-11-16 17:45:15.448923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.448948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.448982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.028 [2024-11-16 17:45:15.449609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.028 [2024-11-16 17:45:15.449638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.449977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.449993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.029 [2024-11-16 17:45:15.450680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.029 [2024-11-16 17:45:15.450696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.450709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.450725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.450739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.450754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.450768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.450783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.450797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.450812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.450826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.450841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.450855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.450871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.450885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.450906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.450919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.450933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2278950 is same with the state(5) to be set 00:25:38.030 [2024-11-16 17:45:15.452175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.452981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.452996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.453012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.453025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.453041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.453054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.453070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.453084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.453100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.453114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.453130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.030 [2024-11-16 17:45:15.453143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.030 [2024-11-16 17:45:15.453159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.453973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.453990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.454004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.454019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.454033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.454048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.454062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.454079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.454093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.454109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.454126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.454142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.454157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.455382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.455406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.455427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.455442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.455458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.455472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.455488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.455502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.455518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.455532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.455547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.455562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.031 [2024-11-16 17:45:15.455578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.031 [2024-11-16 17:45:15.455592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.455978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.455992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.032 [2024-11-16 17:45:15.456786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.032 [2024-11-16 17:45:15.456802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.456816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.456831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.456845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.456861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.456878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.456895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.456920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.456936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.456949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.456965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.456979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.456994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.457337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.457351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x227ad30 is same with the state(5) to be set 00:25:38.033 [2024-11-16 17:45:15.458547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.458972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.458986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.459002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.459015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.459031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.033 [2024-11-16 17:45:15.459045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.033 [2024-11-16 17:45:15.459061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.459980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.459997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.460026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.460056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.460084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.460114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.460143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.460171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.460201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.034 [2024-11-16 17:45:15.460230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.034 [2024-11-16 17:45:15.460243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.460258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.460272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.460287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.460301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.460316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.460329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.460353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.460368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.460384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.460398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.460415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.460429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.460446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.460460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.460475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.460489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.461973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.461989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.035 [2024-11-16 17:45:15.462638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.035 [2024-11-16 17:45:15.462655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.462984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.462997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.463612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:38.036 [2024-11-16 17:45:15.463633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.036 [2024-11-16 17:45:15.465500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:38.036 [2024-11-16 17:45:15.465535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:38.036 [2024-11-16 17:45:15.465554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:38.036 [2024-11-16 17:45:15.465572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:38.036 [2024-11-16 17:45:15.465798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.036 [2024-11-16 17:45:15.465922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.036 [2024-11-16 17:45:15.465951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2150070 with addr=10.0.0.2, port=4420 00:25:38.036 [2024-11-16 17:45:15.465968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2150070 is same with the state(5) to be set 00:25:38.036 [2024-11-16 17:45:15.466055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.036 [2024-11-16 17:45:15.466148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.036 [2024-11-16 17:45:15.466174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2152650 with addr=10.0.0.2, port=4420 00:25:38.036 [2024-11-16 17:45:15.466190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2152650 is same with the state(5) to be set 00:25:38.036 [2024-11-16 17:45:15.466215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22c0c50 (9): Bad file descriptor 00:25:38.036 [2024-11-16 17:45:15.466235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20fb6b0 (9): Bad file descriptor 00:25:38.036 [2024-11-16 17:45:15.466252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:38.036 [2024-11-16 17:45:15.466265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:38.036 [2024-11-16 17:45:15.466288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:38.037 [2024-11-16 17:45:15.466352] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.037 [2024-11-16 17:45:15.466380] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.037 [2024-11-16 17:45:15.466406] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.037 [2024-11-16 17:45:15.466427] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.037 [2024-11-16 17:45:15.466448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2152650 (9): Bad file descriptor 00:25:38.037 [2024-11-16 17:45:15.466473] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2150070 (9): Bad file descriptor 00:25:38.037 task offset: 34944 on job bdev=Nvme10n1 fails 00:25:38.037 00:25:38.037 Latency(us) 00:25:38.037 [2024-11-16T16:45:15.529Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme1n1 ended in about 0.86 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme1n1 : 0.86 340.17 21.26 74.81 0.00 153314.72 95536.92 118838.61 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme2n1 ended in about 0.86 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme2n1 : 0.86 337.37 21.09 74.20 0.00 153238.14 95148.56 116508.44 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme3n1 ended in about 0.87 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme3n1 : 0.87 336.12 21.01 73.92 0.00 152450.48 90876.59 115731.72 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme4n1 ended in about 0.87 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme4n1 : 0.87 334.88 20.93 73.65 0.00 151690.71 85827.89 116508.44 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme5n1 ended in about 0.87 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme5n1 : 0.87 333.68 20.86 73.39 0.00 150885.55 71070.15 121945.51 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme6n1 ended in about 0.88 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme6n1 : 0.88 332.49 20.78 73.12 0.00 150115.39 75342.13 117285.17 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme7n1 ended in about 0.85 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme7n1 : 0.85 342.79 21.42 75.39 0.00 144087.03 39612.87 119615.34 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme8n1 ended in about 0.85 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme8n1 : 0.85 342.35 21.40 75.29 0.00 142943.28 32234.00 121168.78 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme9n1 ended in about 0.86 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme9n1 : 0.86 339.56 21.22 74.68 0.00 142828.96 25826.04 121168.78 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:38.037 [2024-11-16T16:45:15.529Z] Job: Nvme10n1 ended in about 0.85 seconds with error 00:25:38.037 Verification LBA range: start 0x0 length 0x400 00:25:38.037 Nvme10n1 : 0.85 344.81 21.55 75.57 0.00 139312.68 10145.94 121945.51 00:25:38.037 [2024-11-16T16:45:15.529Z] =================================================================================================================== 00:25:38.037 [2024-11-16T16:45:15.529Z] Total : 3384.22 211.51 744.04 0.00 148084.22 10145.94 121945.51 00:25:38.296 [2024-11-16 17:45:15.491973] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:38.296 [2024-11-16 17:45:15.492062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:38.296 [2024-11-16 17:45:15.492096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.296 [2024-11-16 17:45:15.492313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.492423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.492450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2108d30 with addr=10.0.0.2, port=4420 00:25:38.296 [2024-11-16 17:45:15.492470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2108d30 is same with the state(5) to be set 00:25:38.296 [2024-11-16 17:45:15.492576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.492689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.492716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22c2100 with addr=10.0.0.2, port=4420 00:25:38.296 [2024-11-16 17:45:15.492733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22c2100 is same with the state(5) to be set 00:25:38.296 [2024-11-16 17:45:15.492812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.492913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.492940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x211da30 with addr=10.0.0.2, port=4420 00:25:38.296 [2024-11-16 17:45:15.492957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x211da30 is same with the state(5) to be set 00:25:38.296 [2024-11-16 17:45:15.493044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.493126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.493151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x229cc80 with addr=10.0.0.2, port=4420 00:25:38.296 [2024-11-16 17:45:15.493168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x229cc80 is same with the state(5) to be set 00:25:38.296 [2024-11-16 17:45:15.493189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:38.296 [2024-11-16 17:45:15.493203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:38.296 [2024-11-16 17:45:15.493220] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:38.296 [2024-11-16 17:45:15.493248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:38.296 [2024-11-16 17:45:15.493264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:38.296 [2024-11-16 17:45:15.493277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:38.296 [2024-11-16 17:45:15.494666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.296 [2024-11-16 17:45:15.494691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.296 [2024-11-16 17:45:15.494808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.494894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.296 [2024-11-16 17:45:15.494921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22ac660 with addr=10.0.0.2, port=4420 00:25:38.296 [2024-11-16 17:45:15.494947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22ac660 is same with the state(5) to be set 00:25:38.296 [2024-11-16 17:45:15.494973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2108d30 (9): Bad file descriptor 00:25:38.296 [2024-11-16 17:45:15.494995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22c2100 (9): Bad file descriptor 00:25:38.296 [2024-11-16 17:45:15.495014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x211da30 (9): Bad file descriptor 00:25:38.296 [2024-11-16 17:45:15.495032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x229cc80 (9): Bad file descriptor 00:25:38.296 [2024-11-16 17:45:15.495048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.495061] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.495075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:38.297 [2024-11-16 17:45:15.495094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.495109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.495122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:38.297 [2024-11-16 17:45:15.495194] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.297 [2024-11-16 17:45:15.495219] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.297 [2024-11-16 17:45:15.495239] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.297 [2024-11-16 17:45:15.495257] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.297 [2024-11-16 17:45:15.495276] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.297 [2024-11-16 17:45:15.495294] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:38.297 [2024-11-16 17:45:15.495389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.495412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.495441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22ac660 (9): Bad file descriptor 00:25:38.297 [2024-11-16 17:45:15.495460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.495473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.495487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:38.297 [2024-11-16 17:45:15.495503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.495517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.495530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:38.297 [2024-11-16 17:45:15.495545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.495559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.495573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:38.297 [2024-11-16 17:45:15.495598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.495614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.495638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:38.297 [2024-11-16 17:45:15.495718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:38.297 [2024-11-16 17:45:15.495743] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:38.297 [2024-11-16 17:45:15.495760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:38.297 [2024-11-16 17:45:15.495776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.495788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.495800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.495811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.495844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.495859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.495872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:38.297 [2024-11-16 17:45:15.495913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.496001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.297 [2024-11-16 17:45:15.496096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.297 [2024-11-16 17:45:15.496121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22b1700 with addr=10.0.0.2, port=4420 00:25:38.297 [2024-11-16 17:45:15.496137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22b1700 is same with the state(5) to be set 00:25:38.297 [2024-11-16 17:45:15.496210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.297 [2024-11-16 17:45:15.496292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.297 [2024-11-16 17:45:15.496317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x20fb6b0 with addr=10.0.0.2, port=4420 00:25:38.297 [2024-11-16 17:45:15.496333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20fb6b0 is same with the state(5) to be set 00:25:38.297 [2024-11-16 17:45:15.496415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.297 [2024-11-16 17:45:15.496498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.297 [2024-11-16 17:45:15.496524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x22c0c50 with addr=10.0.0.2, port=4420 00:25:38.297 [2024-11-16 17:45:15.496540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22c0c50 is same with the state(5) to be set 00:25:38.297 [2024-11-16 17:45:15.496586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22b1700 (9): Bad file descriptor 00:25:38.297 [2024-11-16 17:45:15.496612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20fb6b0 (9): Bad file descriptor 00:25:38.297 [2024-11-16 17:45:15.496643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x22c0c50 (9): Bad file descriptor 00:25:38.297 [2024-11-16 17:45:15.496681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.496700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.496719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:38.297 [2024-11-16 17:45:15.496736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.496751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.496764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:38.297 [2024-11-16 17:45:15.496778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:38.297 [2024-11-16 17:45:15.496792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:38.297 [2024-11-16 17:45:15.496805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:38.297 [2024-11-16 17:45:15.496842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.496859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.297 [2024-11-16 17:45:15.496871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.555 17:45:15 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:38.555 17:45:15 -- target/shutdown.sh@138 -- # sleep 1 00:25:39.495 17:45:16 -- target/shutdown.sh@141 -- # kill -9 1660307 00:25:39.495 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1660307) - No such process 00:25:39.496 17:45:16 -- target/shutdown.sh@141 -- # true 00:25:39.496 17:45:16 -- target/shutdown.sh@143 -- # stoptarget 00:25:39.496 17:45:16 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:39.496 17:45:16 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:39.496 17:45:16 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:39.496 17:45:16 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:39.496 17:45:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:39.496 17:45:16 -- nvmf/common.sh@116 -- # sync 00:25:39.496 17:45:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:39.496 17:45:16 -- nvmf/common.sh@119 -- # set +e 00:25:39.496 17:45:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:39.496 17:45:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:39.496 rmmod nvme_tcp 00:25:39.496 rmmod nvme_fabrics 00:25:39.496 rmmod nvme_keyring 00:25:39.496 17:45:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:39.496 17:45:16 -- nvmf/common.sh@123 -- # set -e 00:25:39.496 17:45:16 -- nvmf/common.sh@124 -- # return 0 00:25:39.496 17:45:16 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:39.496 17:45:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:39.496 17:45:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:39.496 17:45:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:39.496 17:45:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:39.496 17:45:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:39.496 17:45:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.496 17:45:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.496 17:45:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:42.029 17:45:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:42.029 00:25:42.029 real 0m8.026s 00:25:42.029 user 0m21.045s 00:25:42.029 sys 0m1.601s 00:25:42.029 17:45:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:42.029 17:45:19 -- common/autotest_common.sh@10 -- # set +x 00:25:42.029 ************************************ 00:25:42.029 END TEST nvmf_shutdown_tc3 00:25:42.029 ************************************ 00:25:42.029 17:45:19 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:42.029 00:25:42.029 real 0m28.594s 00:25:42.029 user 1m22.268s 00:25:42.029 sys 0m6.317s 00:25:42.029 17:45:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:42.029 17:45:19 -- common/autotest_common.sh@10 -- # set +x 00:25:42.029 ************************************ 00:25:42.029 END TEST nvmf_shutdown 00:25:42.029 ************************************ 00:25:42.029 17:45:19 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:42.029 17:45:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:42.029 17:45:19 -- common/autotest_common.sh@10 -- # set +x 00:25:42.029 17:45:19 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:42.029 17:45:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:42.029 17:45:19 -- common/autotest_common.sh@10 -- # set +x 00:25:42.029 17:45:19 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:42.029 17:45:19 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:42.029 17:45:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:42.029 17:45:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:42.029 17:45:19 -- common/autotest_common.sh@10 -- # set +x 00:25:42.029 ************************************ 00:25:42.029 START TEST nvmf_multicontroller 00:25:42.029 ************************************ 00:25:42.029 17:45:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:42.029 * Looking for test storage... 00:25:42.029 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:42.029 17:45:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:42.029 17:45:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:42.029 17:45:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:42.029 17:45:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:42.029 17:45:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:42.029 17:45:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:42.029 17:45:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:42.029 17:45:19 -- scripts/common.sh@335 -- # IFS=.-: 00:25:42.029 17:45:19 -- scripts/common.sh@335 -- # read -ra ver1 00:25:42.029 17:45:19 -- scripts/common.sh@336 -- # IFS=.-: 00:25:42.029 17:45:19 -- scripts/common.sh@336 -- # read -ra ver2 00:25:42.029 17:45:19 -- scripts/common.sh@337 -- # local 'op=<' 00:25:42.029 17:45:19 -- scripts/common.sh@339 -- # ver1_l=2 00:25:42.029 17:45:19 -- scripts/common.sh@340 -- # ver2_l=1 00:25:42.029 17:45:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:42.029 17:45:19 -- scripts/common.sh@343 -- # case "$op" in 00:25:42.029 17:45:19 -- scripts/common.sh@344 -- # : 1 00:25:42.029 17:45:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:42.029 17:45:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:42.029 17:45:19 -- scripts/common.sh@364 -- # decimal 1 00:25:42.029 17:45:19 -- scripts/common.sh@352 -- # local d=1 00:25:42.030 17:45:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:42.030 17:45:19 -- scripts/common.sh@354 -- # echo 1 00:25:42.030 17:45:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:42.030 17:45:19 -- scripts/common.sh@365 -- # decimal 2 00:25:42.030 17:45:19 -- scripts/common.sh@352 -- # local d=2 00:25:42.030 17:45:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:42.030 17:45:19 -- scripts/common.sh@354 -- # echo 2 00:25:42.030 17:45:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:42.030 17:45:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:42.030 17:45:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:42.030 17:45:19 -- scripts/common.sh@367 -- # return 0 00:25:42.030 17:45:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:42.030 17:45:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:42.030 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:42.030 --rc genhtml_branch_coverage=1 00:25:42.030 --rc genhtml_function_coverage=1 00:25:42.030 --rc genhtml_legend=1 00:25:42.030 --rc geninfo_all_blocks=1 00:25:42.030 --rc geninfo_unexecuted_blocks=1 00:25:42.030 00:25:42.030 ' 00:25:42.030 17:45:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:42.030 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:42.030 --rc genhtml_branch_coverage=1 00:25:42.030 --rc genhtml_function_coverage=1 00:25:42.030 --rc genhtml_legend=1 00:25:42.030 --rc geninfo_all_blocks=1 00:25:42.030 --rc geninfo_unexecuted_blocks=1 00:25:42.030 00:25:42.030 ' 00:25:42.030 17:45:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:42.030 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:42.030 --rc genhtml_branch_coverage=1 00:25:42.030 --rc genhtml_function_coverage=1 00:25:42.030 --rc genhtml_legend=1 00:25:42.030 --rc geninfo_all_blocks=1 00:25:42.030 --rc geninfo_unexecuted_blocks=1 00:25:42.030 00:25:42.030 ' 00:25:42.030 17:45:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:42.030 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:42.030 --rc genhtml_branch_coverage=1 00:25:42.030 --rc genhtml_function_coverage=1 00:25:42.030 --rc genhtml_legend=1 00:25:42.030 --rc geninfo_all_blocks=1 00:25:42.030 --rc geninfo_unexecuted_blocks=1 00:25:42.030 00:25:42.030 ' 00:25:42.030 17:45:19 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:42.030 17:45:19 -- nvmf/common.sh@7 -- # uname -s 00:25:42.030 17:45:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:42.030 17:45:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:42.030 17:45:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:42.030 17:45:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:42.030 17:45:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:42.030 17:45:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:42.030 17:45:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:42.030 17:45:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:42.030 17:45:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:42.030 17:45:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:42.030 17:45:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:42.030 17:45:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:42.030 17:45:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:42.030 17:45:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:42.030 17:45:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:42.030 17:45:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:42.030 17:45:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:42.030 17:45:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:42.030 17:45:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:42.030 17:45:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.030 17:45:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.030 17:45:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.030 17:45:19 -- paths/export.sh@5 -- # export PATH 00:25:42.030 17:45:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:42.030 17:45:19 -- nvmf/common.sh@46 -- # : 0 00:25:42.030 17:45:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:42.030 17:45:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:42.030 17:45:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:42.030 17:45:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:42.030 17:45:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:42.030 17:45:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:42.030 17:45:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:42.030 17:45:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:42.030 17:45:19 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:42.030 17:45:19 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:42.030 17:45:19 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:42.030 17:45:19 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:42.030 17:45:19 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:42.030 17:45:19 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:42.030 17:45:19 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:42.030 17:45:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:42.030 17:45:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:42.030 17:45:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:42.030 17:45:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:42.030 17:45:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:42.030 17:45:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:42.030 17:45:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:42.030 17:45:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:42.030 17:45:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:42.030 17:45:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:42.030 17:45:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:42.030 17:45:19 -- common/autotest_common.sh@10 -- # set +x 00:25:43.937 17:45:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:43.937 17:45:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:43.937 17:45:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:43.937 17:45:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:43.937 17:45:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:43.937 17:45:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:43.937 17:45:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:43.937 17:45:21 -- nvmf/common.sh@294 -- # net_devs=() 00:25:43.937 17:45:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:43.937 17:45:21 -- nvmf/common.sh@295 -- # e810=() 00:25:43.937 17:45:21 -- nvmf/common.sh@295 -- # local -ga e810 00:25:43.937 17:45:21 -- nvmf/common.sh@296 -- # x722=() 00:25:43.937 17:45:21 -- nvmf/common.sh@296 -- # local -ga x722 00:25:43.937 17:45:21 -- nvmf/common.sh@297 -- # mlx=() 00:25:43.937 17:45:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:43.937 17:45:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:43.937 17:45:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:43.937 17:45:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:43.937 17:45:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:43.937 17:45:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.937 17:45:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:43.937 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:43.937 17:45:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.937 17:45:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:43.937 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:43.937 17:45:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:43.937 17:45:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.937 17:45:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.937 17:45:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.937 17:45:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.937 17:45:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:43.937 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:43.937 17:45:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.937 17:45:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.937 17:45:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.937 17:45:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.937 17:45:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.937 17:45:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:43.937 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:43.937 17:45:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.937 17:45:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:43.937 17:45:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:43.937 17:45:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:43.937 17:45:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:43.937 17:45:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:43.937 17:45:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:43.937 17:45:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:43.937 17:45:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:43.937 17:45:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:43.937 17:45:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:43.937 17:45:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:43.937 17:45:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:43.937 17:45:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:43.937 17:45:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:43.937 17:45:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:43.937 17:45:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:43.938 17:45:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:43.938 17:45:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:43.938 17:45:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:43.938 17:45:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:43.938 17:45:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.938 17:45:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.938 17:45:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.938 17:45:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.938 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.938 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.170 ms 00:25:43.938 00:25:43.938 --- 10.0.0.2 ping statistics --- 00:25:43.938 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.938 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:25:43.938 17:45:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.938 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.938 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:25:43.938 00:25:43.938 --- 10.0.0.1 ping statistics --- 00:25:43.938 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.938 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:25:43.938 17:45:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.938 17:45:21 -- nvmf/common.sh@410 -- # return 0 00:25:43.938 17:45:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.938 17:45:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.938 17:45:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.938 17:45:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.938 17:45:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.938 17:45:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.938 17:45:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.938 17:45:21 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:43.938 17:45:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:43.938 17:45:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:43.938 17:45:21 -- common/autotest_common.sh@10 -- # set +x 00:25:43.938 17:45:21 -- nvmf/common.sh@469 -- # nvmfpid=1662818 00:25:43.938 17:45:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:43.938 17:45:21 -- nvmf/common.sh@470 -- # waitforlisten 1662818 00:25:43.938 17:45:21 -- common/autotest_common.sh@829 -- # '[' -z 1662818 ']' 00:25:43.938 17:45:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.938 17:45:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.938 17:45:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.938 17:45:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.938 17:45:21 -- common/autotest_common.sh@10 -- # set +x 00:25:43.938 [2024-11-16 17:45:21.380406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:43.938 [2024-11-16 17:45:21.380491] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.938 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.198 [2024-11-16 17:45:21.444491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:44.198 [2024-11-16 17:45:21.531146] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:44.198 [2024-11-16 17:45:21.531309] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:44.198 [2024-11-16 17:45:21.531325] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:44.198 [2024-11-16 17:45:21.531337] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:44.198 [2024-11-16 17:45:21.531424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:44.198 [2024-11-16 17:45:21.531499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:44.198 [2024-11-16 17:45:21.531502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:45.136 17:45:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:45.136 17:45:22 -- common/autotest_common.sh@862 -- # return 0 00:25:45.136 17:45:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:45.136 17:45:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:45.136 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.136 17:45:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:45.136 17:45:22 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:45.136 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.136 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.136 [2024-11-16 17:45:22.455033] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:45.136 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.136 17:45:22 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:45.136 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.136 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.136 Malloc0 00:25:45.136 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.136 17:45:22 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:45.136 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:45.137 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:45.137 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 [2024-11-16 17:45:22.513541] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:45.137 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 [2024-11-16 17:45:22.521432] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:45.137 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 Malloc1 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:45.137 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:45.137 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:45.137 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:45.137 17:45:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:45.137 17:45:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:45.137 17:45:22 -- host/multicontroller.sh@44 -- # bdevperf_pid=1662979 00:25:45.137 17:45:22 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:45.137 17:45:22 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:45.137 17:45:22 -- host/multicontroller.sh@47 -- # waitforlisten 1662979 /var/tmp/bdevperf.sock 00:25:45.137 17:45:22 -- common/autotest_common.sh@829 -- # '[' -z 1662979 ']' 00:25:45.137 17:45:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:45.137 17:45:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:45.137 17:45:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:45.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:45.137 17:45:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:45.137 17:45:22 -- common/autotest_common.sh@10 -- # set +x 00:25:46.520 17:45:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:46.520 17:45:23 -- common/autotest_common.sh@862 -- # return 0 00:25:46.520 17:45:23 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:46.520 17:45:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.520 17:45:23 -- common/autotest_common.sh@10 -- # set +x 00:25:46.520 NVMe0n1 00:25:46.520 17:45:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.520 17:45:23 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:46.520 17:45:23 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:46.520 17:45:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.520 17:45:23 -- common/autotest_common.sh@10 -- # set +x 00:25:46.520 17:45:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.520 1 00:25:46.520 17:45:23 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:46.520 17:45:23 -- common/autotest_common.sh@650 -- # local es=0 00:25:46.520 17:45:23 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:46.520 17:45:23 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:46.520 17:45:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.520 17:45:23 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:46.520 17:45:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.520 17:45:23 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:46.520 17:45:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.520 17:45:23 -- common/autotest_common.sh@10 -- # set +x 00:25:46.520 request: 00:25:46.520 { 00:25:46.520 "name": "NVMe0", 00:25:46.520 "trtype": "tcp", 00:25:46.520 "traddr": "10.0.0.2", 00:25:46.520 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:46.520 "hostaddr": "10.0.0.2", 00:25:46.520 "hostsvcid": "60000", 00:25:46.520 "adrfam": "ipv4", 00:25:46.520 "trsvcid": "4420", 00:25:46.520 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:46.520 "method": "bdev_nvme_attach_controller", 00:25:46.520 "req_id": 1 00:25:46.520 } 00:25:46.520 Got JSON-RPC error response 00:25:46.520 response: 00:25:46.520 { 00:25:46.520 "code": -114, 00:25:46.520 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:46.520 } 00:25:46.520 17:45:23 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:46.520 17:45:23 -- common/autotest_common.sh@653 -- # es=1 00:25:46.520 17:45:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:46.520 17:45:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:46.520 17:45:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:46.520 17:45:23 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:46.520 17:45:23 -- common/autotest_common.sh@650 -- # local es=0 00:25:46.520 17:45:23 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:46.520 17:45:23 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:46.520 17:45:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.520 17:45:23 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:46.520 17:45:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.520 17:45:23 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:46.520 17:45:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.520 17:45:23 -- common/autotest_common.sh@10 -- # set +x 00:25:46.520 request: 00:25:46.520 { 00:25:46.520 "name": "NVMe0", 00:25:46.520 "trtype": "tcp", 00:25:46.520 "traddr": "10.0.0.2", 00:25:46.520 "hostaddr": "10.0.0.2", 00:25:46.520 "hostsvcid": "60000", 00:25:46.520 "adrfam": "ipv4", 00:25:46.520 "trsvcid": "4420", 00:25:46.520 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:46.520 "method": "bdev_nvme_attach_controller", 00:25:46.520 "req_id": 1 00:25:46.520 } 00:25:46.520 Got JSON-RPC error response 00:25:46.520 response: 00:25:46.520 { 00:25:46.520 "code": -114, 00:25:46.520 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:46.520 } 00:25:46.520 17:45:23 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:46.520 17:45:23 -- common/autotest_common.sh@653 -- # es=1 00:25:46.520 17:45:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:46.520 17:45:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:46.520 17:45:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:46.520 17:45:23 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:46.520 17:45:23 -- common/autotest_common.sh@650 -- # local es=0 00:25:46.520 17:45:23 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:46.520 17:45:23 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:46.520 17:45:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.520 17:45:23 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:46.521 17:45:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.521 17:45:23 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:46.521 17:45:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.521 17:45:23 -- common/autotest_common.sh@10 -- # set +x 00:25:46.521 request: 00:25:46.521 { 00:25:46.521 "name": "NVMe0", 00:25:46.521 "trtype": "tcp", 00:25:46.521 "traddr": "10.0.0.2", 00:25:46.521 "hostaddr": "10.0.0.2", 00:25:46.521 "hostsvcid": "60000", 00:25:46.521 "adrfam": "ipv4", 00:25:46.521 "trsvcid": "4420", 00:25:46.521 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:46.521 "multipath": "disable", 00:25:46.521 "method": "bdev_nvme_attach_controller", 00:25:46.521 "req_id": 1 00:25:46.521 } 00:25:46.521 Got JSON-RPC error response 00:25:46.521 response: 00:25:46.521 { 00:25:46.521 "code": -114, 00:25:46.521 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:46.521 } 00:25:46.521 17:45:23 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:46.521 17:45:23 -- common/autotest_common.sh@653 -- # es=1 00:25:46.521 17:45:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:46.521 17:45:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:46.521 17:45:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:46.521 17:45:23 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:46.521 17:45:23 -- common/autotest_common.sh@650 -- # local es=0 00:25:46.521 17:45:23 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:46.521 17:45:23 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:46.521 17:45:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.521 17:45:23 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:46.521 17:45:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:46.521 17:45:23 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:46.521 17:45:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.521 17:45:23 -- common/autotest_common.sh@10 -- # set +x 00:25:46.521 request: 00:25:46.521 { 00:25:46.521 "name": "NVMe0", 00:25:46.521 "trtype": "tcp", 00:25:46.521 "traddr": "10.0.0.2", 00:25:46.521 "hostaddr": "10.0.0.2", 00:25:46.521 "hostsvcid": "60000", 00:25:46.521 "adrfam": "ipv4", 00:25:46.521 "trsvcid": "4420", 00:25:46.521 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:46.521 "multipath": "failover", 00:25:46.521 "method": "bdev_nvme_attach_controller", 00:25:46.521 "req_id": 1 00:25:46.521 } 00:25:46.521 Got JSON-RPC error response 00:25:46.521 response: 00:25:46.521 { 00:25:46.521 "code": -114, 00:25:46.521 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:46.521 } 00:25:46.521 17:45:23 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:46.521 17:45:23 -- common/autotest_common.sh@653 -- # es=1 00:25:46.521 17:45:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:46.521 17:45:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:46.521 17:45:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:46.521 17:45:23 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:46.521 17:45:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.521 17:45:23 -- common/autotest_common.sh@10 -- # set +x 00:25:46.781 00:25:46.781 17:45:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.781 17:45:24 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:46.781 17:45:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.781 17:45:24 -- common/autotest_common.sh@10 -- # set +x 00:25:46.781 17:45:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.781 17:45:24 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:46.781 17:45:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.781 17:45:24 -- common/autotest_common.sh@10 -- # set +x 00:25:46.781 00:25:46.781 17:45:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.781 17:45:24 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:46.781 17:45:24 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:46.781 17:45:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.781 17:45:24 -- common/autotest_common.sh@10 -- # set +x 00:25:46.781 17:45:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.781 17:45:24 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:46.781 17:45:24 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:48.159 0 00:25:48.159 17:45:25 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:48.159 17:45:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.159 17:45:25 -- common/autotest_common.sh@10 -- # set +x 00:25:48.159 17:45:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.159 17:45:25 -- host/multicontroller.sh@100 -- # killprocess 1662979 00:25:48.159 17:45:25 -- common/autotest_common.sh@936 -- # '[' -z 1662979 ']' 00:25:48.159 17:45:25 -- common/autotest_common.sh@940 -- # kill -0 1662979 00:25:48.159 17:45:25 -- common/autotest_common.sh@941 -- # uname 00:25:48.159 17:45:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:48.159 17:45:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1662979 00:25:48.159 17:45:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:48.159 17:45:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:48.159 17:45:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1662979' 00:25:48.159 killing process with pid 1662979 00:25:48.159 17:45:25 -- common/autotest_common.sh@955 -- # kill 1662979 00:25:48.159 17:45:25 -- common/autotest_common.sh@960 -- # wait 1662979 00:25:48.159 17:45:25 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:48.159 17:45:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.159 17:45:25 -- common/autotest_common.sh@10 -- # set +x 00:25:48.159 17:45:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.159 17:45:25 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:48.159 17:45:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:48.159 17:45:25 -- common/autotest_common.sh@10 -- # set +x 00:25:48.159 17:45:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:48.159 17:45:25 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:48.159 17:45:25 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:48.159 17:45:25 -- common/autotest_common.sh@1607 -- # read -r file 00:25:48.159 17:45:25 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:48.159 17:45:25 -- common/autotest_common.sh@1606 -- # sort -u 00:25:48.159 17:45:25 -- common/autotest_common.sh@1608 -- # cat 00:25:48.159 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:48.159 [2024-11-16 17:45:22.621386] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:48.159 [2024-11-16 17:45:22.621487] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1662979 ] 00:25:48.159 EAL: No free 2048 kB hugepages reported on node 1 00:25:48.159 [2024-11-16 17:45:22.682542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:48.159 [2024-11-16 17:45:22.765761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:48.159 [2024-11-16 17:45:24.093818] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name f330a128-093b-4f3b-b307-7c8a36a527c1 already exists 00:25:48.159 [2024-11-16 17:45:24.093860] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:f330a128-093b-4f3b-b307-7c8a36a527c1 alias for bdev NVMe1n1 00:25:48.159 [2024-11-16 17:45:24.093887] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:48.159 Running I/O for 1 seconds... 00:25:48.159 00:25:48.159 Latency(us) 00:25:48.159 [2024-11-16T16:45:25.651Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:48.159 [2024-11-16T16:45:25.651Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:48.159 NVMe0n1 : 1.01 19740.14 77.11 0.00 0.00 6465.76 3810.80 15146.10 00:25:48.159 [2024-11-16T16:45:25.651Z] =================================================================================================================== 00:25:48.159 [2024-11-16T16:45:25.651Z] Total : 19740.14 77.11 0.00 0.00 6465.76 3810.80 15146.10 00:25:48.159 Received shutdown signal, test time was about 1.000000 seconds 00:25:48.159 00:25:48.159 Latency(us) 00:25:48.159 [2024-11-16T16:45:25.651Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:48.159 [2024-11-16T16:45:25.651Z] =================================================================================================================== 00:25:48.159 [2024-11-16T16:45:25.651Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:48.159 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:48.159 17:45:25 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:48.159 17:45:25 -- common/autotest_common.sh@1607 -- # read -r file 00:25:48.159 17:45:25 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:48.159 17:45:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:48.160 17:45:25 -- nvmf/common.sh@116 -- # sync 00:25:48.160 17:45:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:48.160 17:45:25 -- nvmf/common.sh@119 -- # set +e 00:25:48.160 17:45:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:48.160 17:45:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:48.160 rmmod nvme_tcp 00:25:48.160 rmmod nvme_fabrics 00:25:48.160 rmmod nvme_keyring 00:25:48.160 17:45:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:48.160 17:45:25 -- nvmf/common.sh@123 -- # set -e 00:25:48.160 17:45:25 -- nvmf/common.sh@124 -- # return 0 00:25:48.160 17:45:25 -- nvmf/common.sh@477 -- # '[' -n 1662818 ']' 00:25:48.160 17:45:25 -- nvmf/common.sh@478 -- # killprocess 1662818 00:25:48.160 17:45:25 -- common/autotest_common.sh@936 -- # '[' -z 1662818 ']' 00:25:48.160 17:45:25 -- common/autotest_common.sh@940 -- # kill -0 1662818 00:25:48.160 17:45:25 -- common/autotest_common.sh@941 -- # uname 00:25:48.160 17:45:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:48.160 17:45:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1662818 00:25:48.160 17:45:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:48.160 17:45:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:48.160 17:45:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1662818' 00:25:48.160 killing process with pid 1662818 00:25:48.160 17:45:25 -- common/autotest_common.sh@955 -- # kill 1662818 00:25:48.160 17:45:25 -- common/autotest_common.sh@960 -- # wait 1662818 00:25:48.726 17:45:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:48.726 17:45:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:48.726 17:45:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:48.726 17:45:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:48.726 17:45:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:48.726 17:45:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:48.726 17:45:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:48.726 17:45:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:50.635 17:45:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:50.635 00:25:50.635 real 0m8.864s 00:25:50.635 user 0m17.274s 00:25:50.635 sys 0m2.325s 00:25:50.635 17:45:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:50.635 17:45:27 -- common/autotest_common.sh@10 -- # set +x 00:25:50.635 ************************************ 00:25:50.635 END TEST nvmf_multicontroller 00:25:50.635 ************************************ 00:25:50.635 17:45:27 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:50.635 17:45:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:50.635 17:45:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:50.635 17:45:27 -- common/autotest_common.sh@10 -- # set +x 00:25:50.635 ************************************ 00:25:50.635 START TEST nvmf_aer 00:25:50.635 ************************************ 00:25:50.635 17:45:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:50.635 * Looking for test storage... 00:25:50.635 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:50.635 17:45:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:50.635 17:45:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:50.635 17:45:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:50.894 17:45:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:50.894 17:45:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:50.894 17:45:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:50.894 17:45:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:50.894 17:45:28 -- scripts/common.sh@335 -- # IFS=.-: 00:25:50.894 17:45:28 -- scripts/common.sh@335 -- # read -ra ver1 00:25:50.894 17:45:28 -- scripts/common.sh@336 -- # IFS=.-: 00:25:50.894 17:45:28 -- scripts/common.sh@336 -- # read -ra ver2 00:25:50.894 17:45:28 -- scripts/common.sh@337 -- # local 'op=<' 00:25:50.894 17:45:28 -- scripts/common.sh@339 -- # ver1_l=2 00:25:50.894 17:45:28 -- scripts/common.sh@340 -- # ver2_l=1 00:25:50.894 17:45:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:50.894 17:45:28 -- scripts/common.sh@343 -- # case "$op" in 00:25:50.894 17:45:28 -- scripts/common.sh@344 -- # : 1 00:25:50.894 17:45:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:50.894 17:45:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:50.894 17:45:28 -- scripts/common.sh@364 -- # decimal 1 00:25:50.894 17:45:28 -- scripts/common.sh@352 -- # local d=1 00:25:50.894 17:45:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:50.894 17:45:28 -- scripts/common.sh@354 -- # echo 1 00:25:50.894 17:45:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:50.894 17:45:28 -- scripts/common.sh@365 -- # decimal 2 00:25:50.894 17:45:28 -- scripts/common.sh@352 -- # local d=2 00:25:50.894 17:45:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:50.894 17:45:28 -- scripts/common.sh@354 -- # echo 2 00:25:50.894 17:45:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:50.894 17:45:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:50.894 17:45:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:50.894 17:45:28 -- scripts/common.sh@367 -- # return 0 00:25:50.894 17:45:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:50.894 17:45:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:50.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.894 --rc genhtml_branch_coverage=1 00:25:50.894 --rc genhtml_function_coverage=1 00:25:50.894 --rc genhtml_legend=1 00:25:50.894 --rc geninfo_all_blocks=1 00:25:50.894 --rc geninfo_unexecuted_blocks=1 00:25:50.894 00:25:50.894 ' 00:25:50.894 17:45:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:50.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.894 --rc genhtml_branch_coverage=1 00:25:50.894 --rc genhtml_function_coverage=1 00:25:50.894 --rc genhtml_legend=1 00:25:50.894 --rc geninfo_all_blocks=1 00:25:50.894 --rc geninfo_unexecuted_blocks=1 00:25:50.894 00:25:50.894 ' 00:25:50.894 17:45:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:50.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.894 --rc genhtml_branch_coverage=1 00:25:50.894 --rc genhtml_function_coverage=1 00:25:50.894 --rc genhtml_legend=1 00:25:50.894 --rc geninfo_all_blocks=1 00:25:50.894 --rc geninfo_unexecuted_blocks=1 00:25:50.894 00:25:50.894 ' 00:25:50.894 17:45:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:50.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:50.894 --rc genhtml_branch_coverage=1 00:25:50.894 --rc genhtml_function_coverage=1 00:25:50.894 --rc genhtml_legend=1 00:25:50.894 --rc geninfo_all_blocks=1 00:25:50.894 --rc geninfo_unexecuted_blocks=1 00:25:50.894 00:25:50.894 ' 00:25:50.894 17:45:28 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:50.894 17:45:28 -- nvmf/common.sh@7 -- # uname -s 00:25:50.894 17:45:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:50.894 17:45:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:50.894 17:45:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:50.894 17:45:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:50.894 17:45:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:50.894 17:45:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:50.894 17:45:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:50.894 17:45:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:50.894 17:45:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:50.894 17:45:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:50.894 17:45:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:50.894 17:45:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:50.894 17:45:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:50.894 17:45:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:50.894 17:45:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:50.894 17:45:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:50.894 17:45:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:50.894 17:45:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:50.894 17:45:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:50.894 17:45:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.895 17:45:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.895 17:45:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.895 17:45:28 -- paths/export.sh@5 -- # export PATH 00:25:50.895 17:45:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:50.895 17:45:28 -- nvmf/common.sh@46 -- # : 0 00:25:50.895 17:45:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:50.895 17:45:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:50.895 17:45:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:50.895 17:45:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:50.895 17:45:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:50.895 17:45:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:50.895 17:45:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:50.895 17:45:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:50.895 17:45:28 -- host/aer.sh@11 -- # nvmftestinit 00:25:50.895 17:45:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:50.895 17:45:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:50.895 17:45:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:50.895 17:45:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:50.895 17:45:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:50.895 17:45:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:50.895 17:45:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:50.895 17:45:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:50.895 17:45:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:50.895 17:45:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:50.895 17:45:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:50.895 17:45:28 -- common/autotest_common.sh@10 -- # set +x 00:25:52.804 17:45:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:52.804 17:45:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:52.804 17:45:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:52.804 17:45:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:52.804 17:45:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:52.804 17:45:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:52.804 17:45:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:52.804 17:45:30 -- nvmf/common.sh@294 -- # net_devs=() 00:25:52.804 17:45:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:52.804 17:45:30 -- nvmf/common.sh@295 -- # e810=() 00:25:52.804 17:45:30 -- nvmf/common.sh@295 -- # local -ga e810 00:25:52.804 17:45:30 -- nvmf/common.sh@296 -- # x722=() 00:25:52.804 17:45:30 -- nvmf/common.sh@296 -- # local -ga x722 00:25:52.804 17:45:30 -- nvmf/common.sh@297 -- # mlx=() 00:25:52.804 17:45:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:52.804 17:45:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:52.804 17:45:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:52.804 17:45:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:52.804 17:45:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:52.804 17:45:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:52.804 17:45:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:52.804 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:52.804 17:45:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:52.804 17:45:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:52.804 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:52.804 17:45:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:52.804 17:45:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:52.804 17:45:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:52.804 17:45:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:52.804 17:45:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:52.804 17:45:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:52.804 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:52.804 17:45:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:52.804 17:45:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:52.804 17:45:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:52.804 17:45:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:52.804 17:45:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:52.804 17:45:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:52.804 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:52.804 17:45:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:52.804 17:45:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:52.804 17:45:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:52.804 17:45:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:52.804 17:45:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:52.804 17:45:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:52.804 17:45:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:52.804 17:45:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:52.804 17:45:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:52.804 17:45:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:52.804 17:45:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:52.804 17:45:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:52.804 17:45:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:52.804 17:45:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:52.804 17:45:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:52.804 17:45:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:52.804 17:45:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:52.804 17:45:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:52.804 17:45:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:52.804 17:45:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:52.804 17:45:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:52.804 17:45:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:53.063 17:45:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:53.063 17:45:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:53.063 17:45:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:53.063 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:53.063 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.192 ms 00:25:53.063 00:25:53.063 --- 10.0.0.2 ping statistics --- 00:25:53.063 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:53.064 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:25:53.064 17:45:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:53.064 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:53.064 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:25:53.064 00:25:53.064 --- 10.0.0.1 ping statistics --- 00:25:53.064 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:53.064 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:25:53.064 17:45:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:53.064 17:45:30 -- nvmf/common.sh@410 -- # return 0 00:25:53.064 17:45:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:53.064 17:45:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:53.064 17:45:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:53.064 17:45:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:53.064 17:45:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:53.064 17:45:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:53.064 17:45:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:53.064 17:45:30 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:53.064 17:45:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:53.064 17:45:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:53.064 17:45:30 -- common/autotest_common.sh@10 -- # set +x 00:25:53.064 17:45:30 -- nvmf/common.sh@469 -- # nvmfpid=1665351 00:25:53.064 17:45:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:53.064 17:45:30 -- nvmf/common.sh@470 -- # waitforlisten 1665351 00:25:53.064 17:45:30 -- common/autotest_common.sh@829 -- # '[' -z 1665351 ']' 00:25:53.064 17:45:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:53.064 17:45:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:53.064 17:45:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:53.064 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:53.064 17:45:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:53.064 17:45:30 -- common/autotest_common.sh@10 -- # set +x 00:25:53.064 [2024-11-16 17:45:30.389399] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:53.064 [2024-11-16 17:45:30.389475] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:53.064 EAL: No free 2048 kB hugepages reported on node 1 00:25:53.064 [2024-11-16 17:45:30.458137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:53.064 [2024-11-16 17:45:30.547241] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:53.064 [2024-11-16 17:45:30.547398] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:53.064 [2024-11-16 17:45:30.547430] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:53.064 [2024-11-16 17:45:30.547444] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:53.064 [2024-11-16 17:45:30.547519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:53.064 [2024-11-16 17:45:30.547587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:53.064 [2024-11-16 17:45:30.547648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:53.064 [2024-11-16 17:45:30.547652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:54.002 17:45:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:54.002 17:45:31 -- common/autotest_common.sh@862 -- # return 0 00:25:54.002 17:45:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:54.002 17:45:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:54.002 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.002 17:45:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:54.002 17:45:31 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:54.002 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.002 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.002 [2024-11-16 17:45:31.368209] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:54.002 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.002 17:45:31 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:54.002 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.002 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.002 Malloc0 00:25:54.002 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.002 17:45:31 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:54.002 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.002 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.002 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.002 17:45:31 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:54.002 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.002 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.002 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.002 17:45:31 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:54.002 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.002 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.002 [2024-11-16 17:45:31.419121] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:54.002 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.003 17:45:31 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:54.003 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.003 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.003 [2024-11-16 17:45:31.426863] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:54.003 [ 00:25:54.003 { 00:25:54.003 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:54.003 "subtype": "Discovery", 00:25:54.003 "listen_addresses": [], 00:25:54.003 "allow_any_host": true, 00:25:54.003 "hosts": [] 00:25:54.003 }, 00:25:54.003 { 00:25:54.003 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:54.003 "subtype": "NVMe", 00:25:54.003 "listen_addresses": [ 00:25:54.003 { 00:25:54.003 "transport": "TCP", 00:25:54.003 "trtype": "TCP", 00:25:54.003 "adrfam": "IPv4", 00:25:54.003 "traddr": "10.0.0.2", 00:25:54.003 "trsvcid": "4420" 00:25:54.003 } 00:25:54.003 ], 00:25:54.003 "allow_any_host": true, 00:25:54.003 "hosts": [], 00:25:54.003 "serial_number": "SPDK00000000000001", 00:25:54.003 "model_number": "SPDK bdev Controller", 00:25:54.003 "max_namespaces": 2, 00:25:54.003 "min_cntlid": 1, 00:25:54.003 "max_cntlid": 65519, 00:25:54.003 "namespaces": [ 00:25:54.003 { 00:25:54.003 "nsid": 1, 00:25:54.003 "bdev_name": "Malloc0", 00:25:54.003 "name": "Malloc0", 00:25:54.003 "nguid": "CD5D645E0EBD4848B8C281A2EA492D42", 00:25:54.003 "uuid": "cd5d645e-0ebd-4848-b8c2-81a2ea492d42" 00:25:54.003 } 00:25:54.003 ] 00:25:54.003 } 00:25:54.003 ] 00:25:54.003 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.003 17:45:31 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:54.003 17:45:31 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:54.003 17:45:31 -- host/aer.sh@33 -- # aerpid=1665514 00:25:54.003 17:45:31 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:54.003 17:45:31 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:54.003 17:45:31 -- common/autotest_common.sh@1254 -- # local i=0 00:25:54.003 17:45:31 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.003 17:45:31 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:54.003 17:45:31 -- common/autotest_common.sh@1257 -- # i=1 00:25:54.003 17:45:31 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:54.003 EAL: No free 2048 kB hugepages reported on node 1 00:25:54.261 17:45:31 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.261 17:45:31 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:54.261 17:45:31 -- common/autotest_common.sh@1257 -- # i=2 00:25:54.261 17:45:31 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:54.261 17:45:31 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.261 17:45:31 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:25:54.261 17:45:31 -- common/autotest_common.sh@1257 -- # i=3 00:25:54.261 17:45:31 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:54.261 17:45:31 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.261 17:45:31 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:54.261 17:45:31 -- common/autotest_common.sh@1265 -- # return 0 00:25:54.261 17:45:31 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:54.261 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.261 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.520 Malloc1 00:25:54.520 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.520 17:45:31 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:54.520 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.520 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.520 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.520 17:45:31 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:54.520 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.520 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.520 Asynchronous Event Request test 00:25:54.520 Attaching to 10.0.0.2 00:25:54.521 Attached to 10.0.0.2 00:25:54.521 Registering asynchronous event callbacks... 00:25:54.521 Starting namespace attribute notice tests for all controllers... 00:25:54.521 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:54.521 aer_cb - Changed Namespace 00:25:54.521 Cleaning up... 00:25:54.521 [ 00:25:54.521 { 00:25:54.521 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:54.521 "subtype": "Discovery", 00:25:54.521 "listen_addresses": [], 00:25:54.521 "allow_any_host": true, 00:25:54.521 "hosts": [] 00:25:54.521 }, 00:25:54.521 { 00:25:54.521 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:54.521 "subtype": "NVMe", 00:25:54.521 "listen_addresses": [ 00:25:54.521 { 00:25:54.521 "transport": "TCP", 00:25:54.521 "trtype": "TCP", 00:25:54.521 "adrfam": "IPv4", 00:25:54.521 "traddr": "10.0.0.2", 00:25:54.521 "trsvcid": "4420" 00:25:54.521 } 00:25:54.521 ], 00:25:54.521 "allow_any_host": true, 00:25:54.521 "hosts": [], 00:25:54.521 "serial_number": "SPDK00000000000001", 00:25:54.521 "model_number": "SPDK bdev Controller", 00:25:54.521 "max_namespaces": 2, 00:25:54.521 "min_cntlid": 1, 00:25:54.521 "max_cntlid": 65519, 00:25:54.521 "namespaces": [ 00:25:54.521 { 00:25:54.521 "nsid": 1, 00:25:54.521 "bdev_name": "Malloc0", 00:25:54.521 "name": "Malloc0", 00:25:54.521 "nguid": "CD5D645E0EBD4848B8C281A2EA492D42", 00:25:54.521 "uuid": "cd5d645e-0ebd-4848-b8c2-81a2ea492d42" 00:25:54.521 }, 00:25:54.521 { 00:25:54.521 "nsid": 2, 00:25:54.521 "bdev_name": "Malloc1", 00:25:54.521 "name": "Malloc1", 00:25:54.521 "nguid": "79D6BAE3661742EBAE659266BE08F5E1", 00:25:54.521 "uuid": "79d6bae3-6617-42eb-ae65-9266be08f5e1" 00:25:54.521 } 00:25:54.521 ] 00:25:54.521 } 00:25:54.521 ] 00:25:54.521 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.521 17:45:31 -- host/aer.sh@43 -- # wait 1665514 00:25:54.521 17:45:31 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:54.521 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.521 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.521 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.521 17:45:31 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:54.521 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.521 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.521 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.521 17:45:31 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:54.521 17:45:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:54.521 17:45:31 -- common/autotest_common.sh@10 -- # set +x 00:25:54.521 17:45:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:54.521 17:45:31 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:54.521 17:45:31 -- host/aer.sh@51 -- # nvmftestfini 00:25:54.521 17:45:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:54.521 17:45:31 -- nvmf/common.sh@116 -- # sync 00:25:54.521 17:45:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:54.521 17:45:31 -- nvmf/common.sh@119 -- # set +e 00:25:54.521 17:45:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:54.521 17:45:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:54.521 rmmod nvme_tcp 00:25:54.521 rmmod nvme_fabrics 00:25:54.521 rmmod nvme_keyring 00:25:54.521 17:45:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:54.521 17:45:31 -- nvmf/common.sh@123 -- # set -e 00:25:54.521 17:45:31 -- nvmf/common.sh@124 -- # return 0 00:25:54.521 17:45:31 -- nvmf/common.sh@477 -- # '[' -n 1665351 ']' 00:25:54.521 17:45:31 -- nvmf/common.sh@478 -- # killprocess 1665351 00:25:54.521 17:45:31 -- common/autotest_common.sh@936 -- # '[' -z 1665351 ']' 00:25:54.521 17:45:31 -- common/autotest_common.sh@940 -- # kill -0 1665351 00:25:54.521 17:45:31 -- common/autotest_common.sh@941 -- # uname 00:25:54.521 17:45:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:54.521 17:45:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1665351 00:25:54.521 17:45:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:54.521 17:45:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:54.521 17:45:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1665351' 00:25:54.521 killing process with pid 1665351 00:25:54.521 17:45:31 -- common/autotest_common.sh@955 -- # kill 1665351 00:25:54.521 [2024-11-16 17:45:31.966059] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:54.521 17:45:31 -- common/autotest_common.sh@960 -- # wait 1665351 00:25:54.780 17:45:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:54.780 17:45:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:54.780 17:45:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:54.780 17:45:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:54.780 17:45:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:54.780 17:45:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:54.780 17:45:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:54.780 17:45:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.316 17:45:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:57.316 00:25:57.316 real 0m6.235s 00:25:57.316 user 0m7.419s 00:25:57.316 sys 0m2.013s 00:25:57.316 17:45:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:57.316 17:45:34 -- common/autotest_common.sh@10 -- # set +x 00:25:57.316 ************************************ 00:25:57.316 END TEST nvmf_aer 00:25:57.316 ************************************ 00:25:57.316 17:45:34 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:57.316 17:45:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:57.316 17:45:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:57.316 17:45:34 -- common/autotest_common.sh@10 -- # set +x 00:25:57.316 ************************************ 00:25:57.316 START TEST nvmf_async_init 00:25:57.316 ************************************ 00:25:57.316 17:45:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:57.316 * Looking for test storage... 00:25:57.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:57.316 17:45:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:57.316 17:45:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:57.316 17:45:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:57.316 17:45:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:57.316 17:45:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:57.316 17:45:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:57.316 17:45:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:57.316 17:45:34 -- scripts/common.sh@335 -- # IFS=.-: 00:25:57.316 17:45:34 -- scripts/common.sh@335 -- # read -ra ver1 00:25:57.316 17:45:34 -- scripts/common.sh@336 -- # IFS=.-: 00:25:57.316 17:45:34 -- scripts/common.sh@336 -- # read -ra ver2 00:25:57.316 17:45:34 -- scripts/common.sh@337 -- # local 'op=<' 00:25:57.316 17:45:34 -- scripts/common.sh@339 -- # ver1_l=2 00:25:57.316 17:45:34 -- scripts/common.sh@340 -- # ver2_l=1 00:25:57.316 17:45:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:57.316 17:45:34 -- scripts/common.sh@343 -- # case "$op" in 00:25:57.316 17:45:34 -- scripts/common.sh@344 -- # : 1 00:25:57.316 17:45:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:57.316 17:45:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:57.316 17:45:34 -- scripts/common.sh@364 -- # decimal 1 00:25:57.316 17:45:34 -- scripts/common.sh@352 -- # local d=1 00:25:57.317 17:45:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:57.317 17:45:34 -- scripts/common.sh@354 -- # echo 1 00:25:57.317 17:45:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:57.317 17:45:34 -- scripts/common.sh@365 -- # decimal 2 00:25:57.317 17:45:34 -- scripts/common.sh@352 -- # local d=2 00:25:57.317 17:45:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:57.317 17:45:34 -- scripts/common.sh@354 -- # echo 2 00:25:57.317 17:45:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:57.317 17:45:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:57.317 17:45:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:57.317 17:45:34 -- scripts/common.sh@367 -- # return 0 00:25:57.317 17:45:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:57.317 17:45:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:57.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.317 --rc genhtml_branch_coverage=1 00:25:57.317 --rc genhtml_function_coverage=1 00:25:57.317 --rc genhtml_legend=1 00:25:57.317 --rc geninfo_all_blocks=1 00:25:57.317 --rc geninfo_unexecuted_blocks=1 00:25:57.317 00:25:57.317 ' 00:25:57.317 17:45:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:57.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.317 --rc genhtml_branch_coverage=1 00:25:57.317 --rc genhtml_function_coverage=1 00:25:57.317 --rc genhtml_legend=1 00:25:57.317 --rc geninfo_all_blocks=1 00:25:57.317 --rc geninfo_unexecuted_blocks=1 00:25:57.317 00:25:57.317 ' 00:25:57.317 17:45:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:57.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.317 --rc genhtml_branch_coverage=1 00:25:57.317 --rc genhtml_function_coverage=1 00:25:57.317 --rc genhtml_legend=1 00:25:57.317 --rc geninfo_all_blocks=1 00:25:57.317 --rc geninfo_unexecuted_blocks=1 00:25:57.317 00:25:57.317 ' 00:25:57.317 17:45:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:57.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:57.317 --rc genhtml_branch_coverage=1 00:25:57.317 --rc genhtml_function_coverage=1 00:25:57.317 --rc genhtml_legend=1 00:25:57.317 --rc geninfo_all_blocks=1 00:25:57.317 --rc geninfo_unexecuted_blocks=1 00:25:57.317 00:25:57.317 ' 00:25:57.317 17:45:34 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:57.317 17:45:34 -- nvmf/common.sh@7 -- # uname -s 00:25:57.317 17:45:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:57.317 17:45:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:57.317 17:45:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:57.317 17:45:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:57.317 17:45:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:57.317 17:45:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:57.317 17:45:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:57.317 17:45:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:57.317 17:45:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:57.317 17:45:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:57.317 17:45:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.317 17:45:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:57.317 17:45:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:57.317 17:45:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:57.317 17:45:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:57.317 17:45:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:57.317 17:45:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:57.317 17:45:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:57.317 17:45:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:57.317 17:45:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.317 17:45:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.317 17:45:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.317 17:45:34 -- paths/export.sh@5 -- # export PATH 00:25:57.317 17:45:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:57.317 17:45:34 -- nvmf/common.sh@46 -- # : 0 00:25:57.317 17:45:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:57.317 17:45:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:57.317 17:45:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:57.317 17:45:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:57.317 17:45:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:57.317 17:45:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:57.317 17:45:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:57.317 17:45:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:57.317 17:45:34 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:57.317 17:45:34 -- host/async_init.sh@14 -- # null_block_size=512 00:25:57.317 17:45:34 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:57.317 17:45:34 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:57.317 17:45:34 -- host/async_init.sh@20 -- # uuidgen 00:25:57.317 17:45:34 -- host/async_init.sh@20 -- # tr -d - 00:25:57.317 17:45:34 -- host/async_init.sh@20 -- # nguid=c49eee873de4433d8c570a5447c44db3 00:25:57.317 17:45:34 -- host/async_init.sh@22 -- # nvmftestinit 00:25:57.317 17:45:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:57.317 17:45:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:57.317 17:45:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:57.317 17:45:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:57.317 17:45:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:57.317 17:45:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:57.317 17:45:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:57.317 17:45:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:57.317 17:45:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:57.317 17:45:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:57.317 17:45:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:57.317 17:45:34 -- common/autotest_common.sh@10 -- # set +x 00:25:59.222 17:45:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:59.222 17:45:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:59.222 17:45:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:59.222 17:45:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:59.222 17:45:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:59.222 17:45:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:59.222 17:45:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:59.222 17:45:36 -- nvmf/common.sh@294 -- # net_devs=() 00:25:59.222 17:45:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:59.222 17:45:36 -- nvmf/common.sh@295 -- # e810=() 00:25:59.222 17:45:36 -- nvmf/common.sh@295 -- # local -ga e810 00:25:59.222 17:45:36 -- nvmf/common.sh@296 -- # x722=() 00:25:59.222 17:45:36 -- nvmf/common.sh@296 -- # local -ga x722 00:25:59.222 17:45:36 -- nvmf/common.sh@297 -- # mlx=() 00:25:59.222 17:45:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:59.222 17:45:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:59.222 17:45:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:59.222 17:45:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:59.222 17:45:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:59.222 17:45:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.222 17:45:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:59.222 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:59.222 17:45:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:59.222 17:45:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:59.222 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:59.222 17:45:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:59.222 17:45:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.222 17:45:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.222 17:45:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.222 17:45:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.222 17:45:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:59.222 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:59.222 17:45:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.222 17:45:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:59.222 17:45:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:59.222 17:45:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:59.222 17:45:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:59.222 17:45:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:59.222 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:59.222 17:45:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:59.222 17:45:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:59.222 17:45:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:59.222 17:45:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:59.222 17:45:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:59.222 17:45:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:59.222 17:45:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:59.222 17:45:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:59.222 17:45:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:59.222 17:45:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:59.222 17:45:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:59.222 17:45:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:59.222 17:45:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:59.222 17:45:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:59.222 17:45:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:59.222 17:45:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:59.222 17:45:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:59.222 17:45:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:59.222 17:45:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:59.222 17:45:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:59.222 17:45:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:59.222 17:45:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:59.222 17:45:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:59.222 17:45:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:59.222 17:45:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:59.222 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:59.222 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.162 ms 00:25:59.222 00:25:59.222 --- 10.0.0.2 ping statistics --- 00:25:59.222 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:59.222 rtt min/avg/max/mdev = 0.162/0.162/0.162/0.000 ms 00:25:59.222 17:45:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:59.222 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:59.222 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:25:59.222 00:25:59.222 --- 10.0.0.1 ping statistics --- 00:25:59.222 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:59.222 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:25:59.222 17:45:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:59.222 17:45:36 -- nvmf/common.sh@410 -- # return 0 00:25:59.222 17:45:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:59.222 17:45:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:59.222 17:45:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:59.223 17:45:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:59.223 17:45:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:59.223 17:45:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:59.223 17:45:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:59.223 17:45:36 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:59.223 17:45:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:59.223 17:45:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:59.223 17:45:36 -- common/autotest_common.sh@10 -- # set +x 00:25:59.223 17:45:36 -- nvmf/common.sh@469 -- # nvmfpid=1667521 00:25:59.223 17:45:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:59.223 17:45:36 -- nvmf/common.sh@470 -- # waitforlisten 1667521 00:25:59.223 17:45:36 -- common/autotest_common.sh@829 -- # '[' -z 1667521 ']' 00:25:59.223 17:45:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:59.223 17:45:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:59.223 17:45:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:59.223 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:59.223 17:45:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:59.223 17:45:36 -- common/autotest_common.sh@10 -- # set +x 00:25:59.223 [2024-11-16 17:45:36.654640] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:59.223 [2024-11-16 17:45:36.654726] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:59.223 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.481 [2024-11-16 17:45:36.724994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:59.481 [2024-11-16 17:45:36.813407] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:59.481 [2024-11-16 17:45:36.813579] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:59.481 [2024-11-16 17:45:36.813599] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:59.481 [2024-11-16 17:45:36.813632] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:59.481 [2024-11-16 17:45:36.813665] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:00.508 17:45:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:00.508 17:45:37 -- common/autotest_common.sh@862 -- # return 0 00:26:00.508 17:45:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:00.508 17:45:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 17:45:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:00.508 17:45:37 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 [2024-11-16 17:45:37.663055] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:00.508 17:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.508 17:45:37 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 null0 00:26:00.508 17:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.508 17:45:37 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 17:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.508 17:45:37 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 17:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.508 17:45:37 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g c49eee873de4433d8c570a5447c44db3 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 17:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.508 17:45:37 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 [2024-11-16 17:45:37.703318] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:00.508 17:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.508 17:45:37 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 nvme0n1 00:26:00.508 17:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.508 17:45:37 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 [ 00:26:00.508 { 00:26:00.508 "name": "nvme0n1", 00:26:00.508 "aliases": [ 00:26:00.508 "c49eee87-3de4-433d-8c57-0a5447c44db3" 00:26:00.508 ], 00:26:00.508 "product_name": "NVMe disk", 00:26:00.508 "block_size": 512, 00:26:00.508 "num_blocks": 2097152, 00:26:00.508 "uuid": "c49eee87-3de4-433d-8c57-0a5447c44db3", 00:26:00.508 "assigned_rate_limits": { 00:26:00.508 "rw_ios_per_sec": 0, 00:26:00.508 "rw_mbytes_per_sec": 0, 00:26:00.508 "r_mbytes_per_sec": 0, 00:26:00.508 "w_mbytes_per_sec": 0 00:26:00.508 }, 00:26:00.508 "claimed": false, 00:26:00.508 "zoned": false, 00:26:00.508 "supported_io_types": { 00:26:00.508 "read": true, 00:26:00.508 "write": true, 00:26:00.508 "unmap": false, 00:26:00.508 "write_zeroes": true, 00:26:00.508 "flush": true, 00:26:00.508 "reset": true, 00:26:00.508 "compare": true, 00:26:00.508 "compare_and_write": true, 00:26:00.508 "abort": true, 00:26:00.508 "nvme_admin": true, 00:26:00.508 "nvme_io": true 00:26:00.508 }, 00:26:00.508 "driver_specific": { 00:26:00.508 "nvme": [ 00:26:00.508 { 00:26:00.508 "trid": { 00:26:00.508 "trtype": "TCP", 00:26:00.508 "adrfam": "IPv4", 00:26:00.508 "traddr": "10.0.0.2", 00:26:00.508 "trsvcid": "4420", 00:26:00.508 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:00.508 }, 00:26:00.508 "ctrlr_data": { 00:26:00.508 "cntlid": 1, 00:26:00.508 "vendor_id": "0x8086", 00:26:00.508 "model_number": "SPDK bdev Controller", 00:26:00.508 "serial_number": "00000000000000000000", 00:26:00.508 "firmware_revision": "24.01.1", 00:26:00.508 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:00.508 "oacs": { 00:26:00.508 "security": 0, 00:26:00.508 "format": 0, 00:26:00.508 "firmware": 0, 00:26:00.508 "ns_manage": 0 00:26:00.508 }, 00:26:00.508 "multi_ctrlr": true, 00:26:00.508 "ana_reporting": false 00:26:00.508 }, 00:26:00.508 "vs": { 00:26:00.508 "nvme_version": "1.3" 00:26:00.508 }, 00:26:00.508 "ns_data": { 00:26:00.508 "id": 1, 00:26:00.508 "can_share": true 00:26:00.508 } 00:26:00.508 } 00:26:00.508 ], 00:26:00.508 "mp_policy": "active_passive" 00:26:00.508 } 00:26:00.508 } 00:26:00.508 ] 00:26:00.508 17:45:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.508 17:45:37 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:26:00.508 17:45:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.508 17:45:37 -- common/autotest_common.sh@10 -- # set +x 00:26:00.508 [2024-11-16 17:45:37.952043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:00.508 [2024-11-16 17:45:37.952134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d073f0 (9): Bad file descriptor 00:26:00.784 [2024-11-16 17:45:38.084788] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:00.784 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.784 17:45:38 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:00.784 17:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.784 17:45:38 -- common/autotest_common.sh@10 -- # set +x 00:26:00.784 [ 00:26:00.784 { 00:26:00.784 "name": "nvme0n1", 00:26:00.784 "aliases": [ 00:26:00.784 "c49eee87-3de4-433d-8c57-0a5447c44db3" 00:26:00.784 ], 00:26:00.784 "product_name": "NVMe disk", 00:26:00.784 "block_size": 512, 00:26:00.784 "num_blocks": 2097152, 00:26:00.784 "uuid": "c49eee87-3de4-433d-8c57-0a5447c44db3", 00:26:00.784 "assigned_rate_limits": { 00:26:00.784 "rw_ios_per_sec": 0, 00:26:00.784 "rw_mbytes_per_sec": 0, 00:26:00.784 "r_mbytes_per_sec": 0, 00:26:00.784 "w_mbytes_per_sec": 0 00:26:00.784 }, 00:26:00.784 "claimed": false, 00:26:00.784 "zoned": false, 00:26:00.784 "supported_io_types": { 00:26:00.784 "read": true, 00:26:00.784 "write": true, 00:26:00.784 "unmap": false, 00:26:00.784 "write_zeroes": true, 00:26:00.784 "flush": true, 00:26:00.784 "reset": true, 00:26:00.784 "compare": true, 00:26:00.784 "compare_and_write": true, 00:26:00.784 "abort": true, 00:26:00.784 "nvme_admin": true, 00:26:00.784 "nvme_io": true 00:26:00.784 }, 00:26:00.784 "driver_specific": { 00:26:00.784 "nvme": [ 00:26:00.784 { 00:26:00.784 "trid": { 00:26:00.784 "trtype": "TCP", 00:26:00.784 "adrfam": "IPv4", 00:26:00.784 "traddr": "10.0.0.2", 00:26:00.784 "trsvcid": "4420", 00:26:00.784 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:00.784 }, 00:26:00.784 "ctrlr_data": { 00:26:00.784 "cntlid": 2, 00:26:00.784 "vendor_id": "0x8086", 00:26:00.784 "model_number": "SPDK bdev Controller", 00:26:00.784 "serial_number": "00000000000000000000", 00:26:00.784 "firmware_revision": "24.01.1", 00:26:00.784 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:00.784 "oacs": { 00:26:00.784 "security": 0, 00:26:00.784 "format": 0, 00:26:00.785 "firmware": 0, 00:26:00.785 "ns_manage": 0 00:26:00.785 }, 00:26:00.785 "multi_ctrlr": true, 00:26:00.785 "ana_reporting": false 00:26:00.785 }, 00:26:00.785 "vs": { 00:26:00.785 "nvme_version": "1.3" 00:26:00.785 }, 00:26:00.785 "ns_data": { 00:26:00.785 "id": 1, 00:26:00.785 "can_share": true 00:26:00.785 } 00:26:00.785 } 00:26:00.785 ], 00:26:00.785 "mp_policy": "active_passive" 00:26:00.785 } 00:26:00.785 } 00:26:00.785 ] 00:26:00.785 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.785 17:45:38 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:00.785 17:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.785 17:45:38 -- common/autotest_common.sh@10 -- # set +x 00:26:00.785 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.785 17:45:38 -- host/async_init.sh@53 -- # mktemp 00:26:00.785 17:45:38 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.bqb4qxjWeA 00:26:00.785 17:45:38 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:26:00.785 17:45:38 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.bqb4qxjWeA 00:26:00.785 17:45:38 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:26:00.785 17:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.785 17:45:38 -- common/autotest_common.sh@10 -- # set +x 00:26:00.785 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.785 17:45:38 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:26:00.785 17:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.785 17:45:38 -- common/autotest_common.sh@10 -- # set +x 00:26:00.785 [2024-11-16 17:45:38.132636] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:26:00.785 [2024-11-16 17:45:38.132818] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:00.785 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.785 17:45:38 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.bqb4qxjWeA 00:26:00.785 17:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.785 17:45:38 -- common/autotest_common.sh@10 -- # set +x 00:26:00.785 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.785 17:45:38 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.bqb4qxjWeA 00:26:00.785 17:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.785 17:45:38 -- common/autotest_common.sh@10 -- # set +x 00:26:00.785 [2024-11-16 17:45:38.148681] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:26:00.785 nvme0n1 00:26:00.785 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.785 17:45:38 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:26:00.785 17:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.785 17:45:38 -- common/autotest_common.sh@10 -- # set +x 00:26:00.785 [ 00:26:00.785 { 00:26:00.785 "name": "nvme0n1", 00:26:00.785 "aliases": [ 00:26:00.785 "c49eee87-3de4-433d-8c57-0a5447c44db3" 00:26:00.785 ], 00:26:00.785 "product_name": "NVMe disk", 00:26:00.785 "block_size": 512, 00:26:00.785 "num_blocks": 2097152, 00:26:00.785 "uuid": "c49eee87-3de4-433d-8c57-0a5447c44db3", 00:26:00.785 "assigned_rate_limits": { 00:26:00.785 "rw_ios_per_sec": 0, 00:26:00.785 "rw_mbytes_per_sec": 0, 00:26:00.785 "r_mbytes_per_sec": 0, 00:26:00.785 "w_mbytes_per_sec": 0 00:26:00.785 }, 00:26:00.785 "claimed": false, 00:26:00.785 "zoned": false, 00:26:00.785 "supported_io_types": { 00:26:00.785 "read": true, 00:26:00.785 "write": true, 00:26:00.785 "unmap": false, 00:26:00.785 "write_zeroes": true, 00:26:00.785 "flush": true, 00:26:00.785 "reset": true, 00:26:00.785 "compare": true, 00:26:00.785 "compare_and_write": true, 00:26:00.785 "abort": true, 00:26:00.785 "nvme_admin": true, 00:26:00.785 "nvme_io": true 00:26:00.785 }, 00:26:00.785 "driver_specific": { 00:26:00.785 "nvme": [ 00:26:00.785 { 00:26:00.785 "trid": { 00:26:00.785 "trtype": "TCP", 00:26:00.785 "adrfam": "IPv4", 00:26:00.785 "traddr": "10.0.0.2", 00:26:00.785 "trsvcid": "4421", 00:26:00.785 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:26:00.785 }, 00:26:00.785 "ctrlr_data": { 00:26:00.785 "cntlid": 3, 00:26:00.785 "vendor_id": "0x8086", 00:26:00.785 "model_number": "SPDK bdev Controller", 00:26:00.785 "serial_number": "00000000000000000000", 00:26:00.785 "firmware_revision": "24.01.1", 00:26:00.785 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:26:00.785 "oacs": { 00:26:00.785 "security": 0, 00:26:00.785 "format": 0, 00:26:00.785 "firmware": 0, 00:26:00.785 "ns_manage": 0 00:26:00.785 }, 00:26:00.785 "multi_ctrlr": true, 00:26:00.785 "ana_reporting": false 00:26:00.785 }, 00:26:00.785 "vs": { 00:26:00.785 "nvme_version": "1.3" 00:26:00.785 }, 00:26:00.785 "ns_data": { 00:26:00.785 "id": 1, 00:26:00.785 "can_share": true 00:26:00.785 } 00:26:00.785 } 00:26:00.785 ], 00:26:00.785 "mp_policy": "active_passive" 00:26:00.785 } 00:26:00.785 } 00:26:00.785 ] 00:26:00.785 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.785 17:45:38 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:26:00.785 17:45:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:00.785 17:45:38 -- common/autotest_common.sh@10 -- # set +x 00:26:00.785 17:45:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:00.785 17:45:38 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.bqb4qxjWeA 00:26:00.785 17:45:38 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:26:00.785 17:45:38 -- host/async_init.sh@78 -- # nvmftestfini 00:26:00.785 17:45:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:00.785 17:45:38 -- nvmf/common.sh@116 -- # sync 00:26:00.785 17:45:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:00.785 17:45:38 -- nvmf/common.sh@119 -- # set +e 00:26:00.785 17:45:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:00.785 17:45:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:00.785 rmmod nvme_tcp 00:26:00.785 rmmod nvme_fabrics 00:26:01.043 rmmod nvme_keyring 00:26:01.043 17:45:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:01.043 17:45:38 -- nvmf/common.sh@123 -- # set -e 00:26:01.043 17:45:38 -- nvmf/common.sh@124 -- # return 0 00:26:01.043 17:45:38 -- nvmf/common.sh@477 -- # '[' -n 1667521 ']' 00:26:01.043 17:45:38 -- nvmf/common.sh@478 -- # killprocess 1667521 00:26:01.043 17:45:38 -- common/autotest_common.sh@936 -- # '[' -z 1667521 ']' 00:26:01.043 17:45:38 -- common/autotest_common.sh@940 -- # kill -0 1667521 00:26:01.043 17:45:38 -- common/autotest_common.sh@941 -- # uname 00:26:01.043 17:45:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:01.043 17:45:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1667521 00:26:01.043 17:45:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:01.043 17:45:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:01.043 17:45:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1667521' 00:26:01.043 killing process with pid 1667521 00:26:01.043 17:45:38 -- common/autotest_common.sh@955 -- # kill 1667521 00:26:01.043 17:45:38 -- common/autotest_common.sh@960 -- # wait 1667521 00:26:01.301 17:45:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:01.301 17:45:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:01.301 17:45:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:01.301 17:45:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:01.301 17:45:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:01.301 17:45:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:01.301 17:45:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:01.301 17:45:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:03.208 17:45:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:03.208 00:26:03.208 real 0m6.325s 00:26:03.208 user 0m3.086s 00:26:03.208 sys 0m1.889s 00:26:03.208 17:45:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:03.208 17:45:40 -- common/autotest_common.sh@10 -- # set +x 00:26:03.208 ************************************ 00:26:03.208 END TEST nvmf_async_init 00:26:03.208 ************************************ 00:26:03.208 17:45:40 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:03.208 17:45:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:03.208 17:45:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:03.208 17:45:40 -- common/autotest_common.sh@10 -- # set +x 00:26:03.208 ************************************ 00:26:03.208 START TEST dma 00:26:03.208 ************************************ 00:26:03.208 17:45:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:03.208 * Looking for test storage... 00:26:03.208 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:03.208 17:45:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:03.208 17:45:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:03.208 17:45:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:03.467 17:45:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:03.467 17:45:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:03.467 17:45:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:03.467 17:45:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:03.467 17:45:40 -- scripts/common.sh@335 -- # IFS=.-: 00:26:03.467 17:45:40 -- scripts/common.sh@335 -- # read -ra ver1 00:26:03.467 17:45:40 -- scripts/common.sh@336 -- # IFS=.-: 00:26:03.467 17:45:40 -- scripts/common.sh@336 -- # read -ra ver2 00:26:03.467 17:45:40 -- scripts/common.sh@337 -- # local 'op=<' 00:26:03.467 17:45:40 -- scripts/common.sh@339 -- # ver1_l=2 00:26:03.467 17:45:40 -- scripts/common.sh@340 -- # ver2_l=1 00:26:03.467 17:45:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:03.467 17:45:40 -- scripts/common.sh@343 -- # case "$op" in 00:26:03.467 17:45:40 -- scripts/common.sh@344 -- # : 1 00:26:03.467 17:45:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:03.467 17:45:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:03.467 17:45:40 -- scripts/common.sh@364 -- # decimal 1 00:26:03.467 17:45:40 -- scripts/common.sh@352 -- # local d=1 00:26:03.467 17:45:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:03.467 17:45:40 -- scripts/common.sh@354 -- # echo 1 00:26:03.467 17:45:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:03.467 17:45:40 -- scripts/common.sh@365 -- # decimal 2 00:26:03.467 17:45:40 -- scripts/common.sh@352 -- # local d=2 00:26:03.467 17:45:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:03.467 17:45:40 -- scripts/common.sh@354 -- # echo 2 00:26:03.467 17:45:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:03.467 17:45:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:03.467 17:45:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:03.467 17:45:40 -- scripts/common.sh@367 -- # return 0 00:26:03.467 17:45:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:03.467 17:45:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:03.467 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.467 --rc genhtml_branch_coverage=1 00:26:03.467 --rc genhtml_function_coverage=1 00:26:03.468 --rc genhtml_legend=1 00:26:03.468 --rc geninfo_all_blocks=1 00:26:03.468 --rc geninfo_unexecuted_blocks=1 00:26:03.468 00:26:03.468 ' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:03.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.468 --rc genhtml_branch_coverage=1 00:26:03.468 --rc genhtml_function_coverage=1 00:26:03.468 --rc genhtml_legend=1 00:26:03.468 --rc geninfo_all_blocks=1 00:26:03.468 --rc geninfo_unexecuted_blocks=1 00:26:03.468 00:26:03.468 ' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:03.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.468 --rc genhtml_branch_coverage=1 00:26:03.468 --rc genhtml_function_coverage=1 00:26:03.468 --rc genhtml_legend=1 00:26:03.468 --rc geninfo_all_blocks=1 00:26:03.468 --rc geninfo_unexecuted_blocks=1 00:26:03.468 00:26:03.468 ' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:03.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.468 --rc genhtml_branch_coverage=1 00:26:03.468 --rc genhtml_function_coverage=1 00:26:03.468 --rc genhtml_legend=1 00:26:03.468 --rc geninfo_all_blocks=1 00:26:03.468 --rc geninfo_unexecuted_blocks=1 00:26:03.468 00:26:03.468 ' 00:26:03.468 17:45:40 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:03.468 17:45:40 -- nvmf/common.sh@7 -- # uname -s 00:26:03.468 17:45:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:03.468 17:45:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:03.468 17:45:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:03.468 17:45:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:03.468 17:45:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:03.468 17:45:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:03.468 17:45:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:03.468 17:45:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:03.468 17:45:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:03.468 17:45:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:03.468 17:45:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.468 17:45:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.468 17:45:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:03.468 17:45:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:03.468 17:45:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:03.468 17:45:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:03.468 17:45:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:03.468 17:45:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:03.468 17:45:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:03.468 17:45:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.468 17:45:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.468 17:45:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.468 17:45:40 -- paths/export.sh@5 -- # export PATH 00:26:03.468 17:45:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.468 17:45:40 -- nvmf/common.sh@46 -- # : 0 00:26:03.468 17:45:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:03.468 17:45:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:03.468 17:45:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:03.468 17:45:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:03.468 17:45:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:03.468 17:45:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:03.468 17:45:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:03.468 17:45:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:03.468 17:45:40 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:03.468 17:45:40 -- host/dma.sh@13 -- # exit 0 00:26:03.468 00:26:03.468 real 0m0.140s 00:26:03.468 user 0m0.096s 00:26:03.468 sys 0m0.052s 00:26:03.468 17:45:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:03.468 17:45:40 -- common/autotest_common.sh@10 -- # set +x 00:26:03.468 ************************************ 00:26:03.468 END TEST dma 00:26:03.468 ************************************ 00:26:03.468 17:45:40 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:03.468 17:45:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:03.468 17:45:40 -- common/autotest_common.sh@10 -- # set +x 00:26:03.468 ************************************ 00:26:03.468 START TEST nvmf_identify 00:26:03.468 ************************************ 00:26:03.468 17:45:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:03.468 * Looking for test storage... 00:26:03.468 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:03.468 17:45:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:03.468 17:45:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:03.468 17:45:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:03.468 17:45:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:03.468 17:45:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:03.468 17:45:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:03.468 17:45:40 -- scripts/common.sh@335 -- # IFS=.-: 00:26:03.468 17:45:40 -- scripts/common.sh@335 -- # read -ra ver1 00:26:03.468 17:45:40 -- scripts/common.sh@336 -- # IFS=.-: 00:26:03.468 17:45:40 -- scripts/common.sh@336 -- # read -ra ver2 00:26:03.468 17:45:40 -- scripts/common.sh@337 -- # local 'op=<' 00:26:03.468 17:45:40 -- scripts/common.sh@339 -- # ver1_l=2 00:26:03.468 17:45:40 -- scripts/common.sh@340 -- # ver2_l=1 00:26:03.468 17:45:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:03.468 17:45:40 -- scripts/common.sh@343 -- # case "$op" in 00:26:03.468 17:45:40 -- scripts/common.sh@344 -- # : 1 00:26:03.468 17:45:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:03.468 17:45:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:03.468 17:45:40 -- scripts/common.sh@364 -- # decimal 1 00:26:03.468 17:45:40 -- scripts/common.sh@352 -- # local d=1 00:26:03.468 17:45:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:03.468 17:45:40 -- scripts/common.sh@354 -- # echo 1 00:26:03.468 17:45:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:03.468 17:45:40 -- scripts/common.sh@365 -- # decimal 2 00:26:03.468 17:45:40 -- scripts/common.sh@352 -- # local d=2 00:26:03.468 17:45:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:03.468 17:45:40 -- scripts/common.sh@354 -- # echo 2 00:26:03.468 17:45:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:03.468 17:45:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:03.468 17:45:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:03.468 17:45:40 -- scripts/common.sh@367 -- # return 0 00:26:03.468 17:45:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:03.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.468 --rc genhtml_branch_coverage=1 00:26:03.468 --rc genhtml_function_coverage=1 00:26:03.468 --rc genhtml_legend=1 00:26:03.468 --rc geninfo_all_blocks=1 00:26:03.468 --rc geninfo_unexecuted_blocks=1 00:26:03.468 00:26:03.468 ' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:03.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.468 --rc genhtml_branch_coverage=1 00:26:03.468 --rc genhtml_function_coverage=1 00:26:03.468 --rc genhtml_legend=1 00:26:03.468 --rc geninfo_all_blocks=1 00:26:03.468 --rc geninfo_unexecuted_blocks=1 00:26:03.468 00:26:03.468 ' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:03.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.468 --rc genhtml_branch_coverage=1 00:26:03.468 --rc genhtml_function_coverage=1 00:26:03.468 --rc genhtml_legend=1 00:26:03.468 --rc geninfo_all_blocks=1 00:26:03.468 --rc geninfo_unexecuted_blocks=1 00:26:03.468 00:26:03.468 ' 00:26:03.468 17:45:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:03.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:03.468 --rc genhtml_branch_coverage=1 00:26:03.468 --rc genhtml_function_coverage=1 00:26:03.468 --rc genhtml_legend=1 00:26:03.468 --rc geninfo_all_blocks=1 00:26:03.468 --rc geninfo_unexecuted_blocks=1 00:26:03.468 00:26:03.468 ' 00:26:03.468 17:45:40 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:03.468 17:45:40 -- nvmf/common.sh@7 -- # uname -s 00:26:03.469 17:45:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:03.469 17:45:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:03.469 17:45:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:03.469 17:45:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:03.469 17:45:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:03.469 17:45:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:03.469 17:45:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:03.469 17:45:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:03.469 17:45:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:03.469 17:45:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:03.469 17:45:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.469 17:45:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:03.469 17:45:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:03.469 17:45:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:03.469 17:45:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:03.469 17:45:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:03.469 17:45:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:03.469 17:45:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:03.469 17:45:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:03.469 17:45:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.469 17:45:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.469 17:45:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.469 17:45:40 -- paths/export.sh@5 -- # export PATH 00:26:03.469 17:45:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:03.469 17:45:40 -- nvmf/common.sh@46 -- # : 0 00:26:03.469 17:45:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:03.469 17:45:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:03.469 17:45:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:03.469 17:45:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:03.469 17:45:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:03.469 17:45:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:03.469 17:45:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:03.469 17:45:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:03.469 17:45:40 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:03.469 17:45:40 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:03.469 17:45:40 -- host/identify.sh@14 -- # nvmftestinit 00:26:03.469 17:45:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:03.469 17:45:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:03.469 17:45:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:03.469 17:45:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:03.469 17:45:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:03.469 17:45:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:03.469 17:45:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:03.469 17:45:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:03.469 17:45:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:03.469 17:45:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:03.469 17:45:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:03.469 17:45:40 -- common/autotest_common.sh@10 -- # set +x 00:26:06.005 17:45:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:06.005 17:45:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:06.005 17:45:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:06.005 17:45:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:06.005 17:45:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:06.005 17:45:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:06.005 17:45:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:06.005 17:45:42 -- nvmf/common.sh@294 -- # net_devs=() 00:26:06.005 17:45:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:06.005 17:45:42 -- nvmf/common.sh@295 -- # e810=() 00:26:06.005 17:45:42 -- nvmf/common.sh@295 -- # local -ga e810 00:26:06.005 17:45:42 -- nvmf/common.sh@296 -- # x722=() 00:26:06.005 17:45:42 -- nvmf/common.sh@296 -- # local -ga x722 00:26:06.005 17:45:42 -- nvmf/common.sh@297 -- # mlx=() 00:26:06.005 17:45:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:06.005 17:45:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:06.005 17:45:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:06.005 17:45:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:06.005 17:45:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:06.005 17:45:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:06.005 17:45:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:06.005 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:06.005 17:45:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:06.005 17:45:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:06.005 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:06.005 17:45:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:06.005 17:45:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:06.006 17:45:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:06.006 17:45:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:06.006 17:45:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:06.006 17:45:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:06.006 17:45:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:06.006 17:45:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:06.006 17:45:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:06.006 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:06.006 17:45:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:06.006 17:45:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:06.006 17:45:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:06.006 17:45:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:06.006 17:45:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:06.006 17:45:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:06.006 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:06.006 17:45:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:06.006 17:45:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:06.006 17:45:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:06.006 17:45:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:06.006 17:45:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:06.006 17:45:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:06.006 17:45:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:06.006 17:45:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:06.006 17:45:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:06.006 17:45:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:06.006 17:45:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:06.006 17:45:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:06.006 17:45:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:06.006 17:45:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:06.006 17:45:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:06.006 17:45:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:06.006 17:45:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:06.006 17:45:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:06.006 17:45:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:06.006 17:45:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:06.006 17:45:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:06.006 17:45:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:06.006 17:45:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:06.006 17:45:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:06.006 17:45:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:06.006 17:45:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:06.006 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:06.006 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:26:06.006 00:26:06.006 --- 10.0.0.2 ping statistics --- 00:26:06.006 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:06.006 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:26:06.006 17:45:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:06.006 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:06.006 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:26:06.006 00:26:06.006 --- 10.0.0.1 ping statistics --- 00:26:06.006 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:06.006 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:26:06.006 17:45:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:06.006 17:45:43 -- nvmf/common.sh@410 -- # return 0 00:26:06.006 17:45:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:06.006 17:45:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:06.006 17:45:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:06.006 17:45:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:06.006 17:45:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:06.006 17:45:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:06.006 17:45:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:06.006 17:45:43 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:06.006 17:45:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:06.006 17:45:43 -- common/autotest_common.sh@10 -- # set +x 00:26:06.006 17:45:43 -- host/identify.sh@19 -- # nvmfpid=1669754 00:26:06.006 17:45:43 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:06.006 17:45:43 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:06.006 17:45:43 -- host/identify.sh@23 -- # waitforlisten 1669754 00:26:06.006 17:45:43 -- common/autotest_common.sh@829 -- # '[' -z 1669754 ']' 00:26:06.006 17:45:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:06.006 17:45:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:06.006 17:45:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:06.006 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:06.006 17:45:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:06.006 17:45:43 -- common/autotest_common.sh@10 -- # set +x 00:26:06.006 [2024-11-16 17:45:43.160599] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:06.006 [2024-11-16 17:45:43.160695] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:06.006 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.006 [2024-11-16 17:45:43.230471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:06.006 [2024-11-16 17:45:43.321730] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:06.006 [2024-11-16 17:45:43.321889] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:06.006 [2024-11-16 17:45:43.321918] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:06.006 [2024-11-16 17:45:43.321933] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:06.006 [2024-11-16 17:45:43.321992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:06.006 [2024-11-16 17:45:43.322070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:06.006 [2024-11-16 17:45:43.322117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:06.006 [2024-11-16 17:45:43.322120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:06.944 17:45:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:06.944 17:45:44 -- common/autotest_common.sh@862 -- # return 0 00:26:06.944 17:45:44 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:06.944 17:45:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.944 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.944 [2024-11-16 17:45:44.109134] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:06.944 17:45:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.944 17:45:44 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:06.944 17:45:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:06.944 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.944 17:45:44 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:06.944 17:45:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.944 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.944 Malloc0 00:26:06.944 17:45:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.944 17:45:44 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:06.944 17:45:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.944 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.944 17:45:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.944 17:45:44 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:06.944 17:45:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.944 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.944 17:45:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.944 17:45:44 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:06.944 17:45:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.944 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.944 [2024-11-16 17:45:44.180205] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:06.944 17:45:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.944 17:45:44 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:06.944 17:45:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.944 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.944 17:45:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.944 17:45:44 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:06.944 17:45:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:06.944 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:06.944 [2024-11-16 17:45:44.195962] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:06.944 [ 00:26:06.944 { 00:26:06.944 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:06.944 "subtype": "Discovery", 00:26:06.944 "listen_addresses": [ 00:26:06.944 { 00:26:06.944 "transport": "TCP", 00:26:06.944 "trtype": "TCP", 00:26:06.944 "adrfam": "IPv4", 00:26:06.944 "traddr": "10.0.0.2", 00:26:06.944 "trsvcid": "4420" 00:26:06.944 } 00:26:06.944 ], 00:26:06.944 "allow_any_host": true, 00:26:06.944 "hosts": [] 00:26:06.944 }, 00:26:06.944 { 00:26:06.944 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:06.944 "subtype": "NVMe", 00:26:06.944 "listen_addresses": [ 00:26:06.944 { 00:26:06.944 "transport": "TCP", 00:26:06.944 "trtype": "TCP", 00:26:06.944 "adrfam": "IPv4", 00:26:06.944 "traddr": "10.0.0.2", 00:26:06.944 "trsvcid": "4420" 00:26:06.944 } 00:26:06.944 ], 00:26:06.944 "allow_any_host": true, 00:26:06.944 "hosts": [], 00:26:06.944 "serial_number": "SPDK00000000000001", 00:26:06.944 "model_number": "SPDK bdev Controller", 00:26:06.944 "max_namespaces": 32, 00:26:06.944 "min_cntlid": 1, 00:26:06.944 "max_cntlid": 65519, 00:26:06.944 "namespaces": [ 00:26:06.944 { 00:26:06.944 "nsid": 1, 00:26:06.944 "bdev_name": "Malloc0", 00:26:06.944 "name": "Malloc0", 00:26:06.944 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:06.944 "eui64": "ABCDEF0123456789", 00:26:06.944 "uuid": "0c305e8a-41a7-4323-b380-90dcafd1e759" 00:26:06.944 } 00:26:06.944 ] 00:26:06.944 } 00:26:06.944 ] 00:26:06.944 17:45:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:06.944 17:45:44 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:06.944 [2024-11-16 17:45:44.217056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:06.944 [2024-11-16 17:45:44.217091] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1669913 ] 00:26:06.944 EAL: No free 2048 kB hugepages reported on node 1 00:26:06.945 [2024-11-16 17:45:44.251012] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:06.945 [2024-11-16 17:45:44.251062] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:06.945 [2024-11-16 17:45:44.251072] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:06.945 [2024-11-16 17:45:44.251086] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:06.945 [2024-11-16 17:45:44.251098] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:06.945 [2024-11-16 17:45:44.251381] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:06.945 [2024-11-16 17:45:44.251438] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1364420 0 00:26:06.945 [2024-11-16 17:45:44.257629] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:06.945 [2024-11-16 17:45:44.257650] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:06.945 [2024-11-16 17:45:44.257658] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:06.945 [2024-11-16 17:45:44.257664] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:06.945 [2024-11-16 17:45:44.257714] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.257727] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.257734] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.945 [2024-11-16 17:45:44.257751] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:06.945 [2024-11-16 17:45:44.257778] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.945 [2024-11-16 17:45:44.265646] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.945 [2024-11-16 17:45:44.265663] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.945 [2024-11-16 17:45:44.265671] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.265678] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.945 [2024-11-16 17:45:44.265697] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:06.945 [2024-11-16 17:45:44.265723] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:06.945 [2024-11-16 17:45:44.265732] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:06.945 [2024-11-16 17:45:44.265751] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.265759] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.265766] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.945 [2024-11-16 17:45:44.265777] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.945 [2024-11-16 17:45:44.265801] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.945 [2024-11-16 17:45:44.265926] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.945 [2024-11-16 17:45:44.265938] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.945 [2024-11-16 17:45:44.265944] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.265951] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.945 [2024-11-16 17:45:44.265961] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:06.945 [2024-11-16 17:45:44.265973] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:06.945 [2024-11-16 17:45:44.265992] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266000] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266006] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.945 [2024-11-16 17:45:44.266016] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.945 [2024-11-16 17:45:44.266038] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.945 [2024-11-16 17:45:44.266118] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.945 [2024-11-16 17:45:44.266130] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.945 [2024-11-16 17:45:44.266136] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266143] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.945 [2024-11-16 17:45:44.266152] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:06.945 [2024-11-16 17:45:44.266165] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:06.945 [2024-11-16 17:45:44.266177] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266184] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266191] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.945 [2024-11-16 17:45:44.266201] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.945 [2024-11-16 17:45:44.266221] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.945 [2024-11-16 17:45:44.266304] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.945 [2024-11-16 17:45:44.266318] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.945 [2024-11-16 17:45:44.266324] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266331] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.945 [2024-11-16 17:45:44.266340] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:06.945 [2024-11-16 17:45:44.266357] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266366] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266372] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.945 [2024-11-16 17:45:44.266382] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.945 [2024-11-16 17:45:44.266402] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.945 [2024-11-16 17:45:44.266478] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.945 [2024-11-16 17:45:44.266492] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.945 [2024-11-16 17:45:44.266499] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266505] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.945 [2024-11-16 17:45:44.266514] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:06.945 [2024-11-16 17:45:44.266523] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:06.945 [2024-11-16 17:45:44.266535] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:06.945 [2024-11-16 17:45:44.266649] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:06.945 [2024-11-16 17:45:44.266660] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:06.945 [2024-11-16 17:45:44.266674] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266681] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266688] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.945 [2024-11-16 17:45:44.266698] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.945 [2024-11-16 17:45:44.266719] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.945 [2024-11-16 17:45:44.266830] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.945 [2024-11-16 17:45:44.266844] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.945 [2024-11-16 17:45:44.266851] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266857] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.945 [2024-11-16 17:45:44.266866] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:06.945 [2024-11-16 17:45:44.266882] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266891] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.266897] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.945 [2024-11-16 17:45:44.266908] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.945 [2024-11-16 17:45:44.266928] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.945 [2024-11-16 17:45:44.267007] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.945 [2024-11-16 17:45:44.267021] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.945 [2024-11-16 17:45:44.267027] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.267033] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.945 [2024-11-16 17:45:44.267042] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:06.945 [2024-11-16 17:45:44.267050] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:06.945 [2024-11-16 17:45:44.267063] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:06.945 [2024-11-16 17:45:44.267078] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:06.945 [2024-11-16 17:45:44.267092] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.267099] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.945 [2024-11-16 17:45:44.267105] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.945 [2024-11-16 17:45:44.267116] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.945 [2024-11-16 17:45:44.267137] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.945 [2024-11-16 17:45:44.267244] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.945 [2024-11-16 17:45:44.267256] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.946 [2024-11-16 17:45:44.267266] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267273] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1364420): datao=0, datal=4096, cccid=0 00:26:06.946 [2024-11-16 17:45:44.267281] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13c9b00) on tqpair(0x1364420): expected_datao=0, payload_size=4096 00:26:06.946 [2024-11-16 17:45:44.267298] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267307] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267319] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.946 [2024-11-16 17:45:44.267328] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.946 [2024-11-16 17:45:44.267335] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267341] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.946 [2024-11-16 17:45:44.267353] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:06.946 [2024-11-16 17:45:44.267362] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:06.946 [2024-11-16 17:45:44.267369] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:06.946 [2024-11-16 17:45:44.267377] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:06.946 [2024-11-16 17:45:44.267384] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:06.946 [2024-11-16 17:45:44.267392] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:06.946 [2024-11-16 17:45:44.267410] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:06.946 [2024-11-16 17:45:44.267423] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267430] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267437] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.267447] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:06.946 [2024-11-16 17:45:44.267469] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.946 [2024-11-16 17:45:44.267557] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.946 [2024-11-16 17:45:44.267571] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.946 [2024-11-16 17:45:44.267577] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267584] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9b00) on tqpair=0x1364420 00:26:06.946 [2024-11-16 17:45:44.267596] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267604] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267610] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.267627] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.946 [2024-11-16 17:45:44.267638] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267645] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267651] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.267660] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.946 [2024-11-16 17:45:44.267670] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267680] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267687] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.267696] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.946 [2024-11-16 17:45:44.267706] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267712] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267719] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.267727] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.946 [2024-11-16 17:45:44.267736] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:06.946 [2024-11-16 17:45:44.267754] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:06.946 [2024-11-16 17:45:44.267766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267773] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.267779] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.267790] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.946 [2024-11-16 17:45:44.267812] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9b00, cid 0, qid 0 00:26:06.946 [2024-11-16 17:45:44.267823] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9c60, cid 1, qid 0 00:26:06.946 [2024-11-16 17:45:44.267831] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9dc0, cid 2, qid 0 00:26:06.946 [2024-11-16 17:45:44.267838] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.946 [2024-11-16 17:45:44.267845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ca080, cid 4, qid 0 00:26:06.946 [2024-11-16 17:45:44.267981] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.946 [2024-11-16 17:45:44.267992] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.946 [2024-11-16 17:45:44.267999] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.268005] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ca080) on tqpair=0x1364420 00:26:06.946 [2024-11-16 17:45:44.268015] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:06.946 [2024-11-16 17:45:44.268024] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:06.946 [2024-11-16 17:45:44.268040] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.268048] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.268055] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.268065] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.946 [2024-11-16 17:45:44.268085] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ca080, cid 4, qid 0 00:26:06.946 [2024-11-16 17:45:44.268177] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.946 [2024-11-16 17:45:44.268192] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.946 [2024-11-16 17:45:44.268198] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.268204] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1364420): datao=0, datal=4096, cccid=4 00:26:06.946 [2024-11-16 17:45:44.268216] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ca080) on tqpair(0x1364420): expected_datao=0, payload_size=4096 00:26:06.946 [2024-11-16 17:45:44.268233] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.268242] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.312646] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.946 [2024-11-16 17:45:44.312666] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.946 [2024-11-16 17:45:44.312673] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.312688] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ca080) on tqpair=0x1364420 00:26:06.946 [2024-11-16 17:45:44.312708] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:06.946 [2024-11-16 17:45:44.312745] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.312756] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.312763] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.312775] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.946 [2024-11-16 17:45:44.312787] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.312794] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.312800] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1364420) 00:26:06.946 [2024-11-16 17:45:44.312809] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:06.946 [2024-11-16 17:45:44.312838] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ca080, cid 4, qid 0 00:26:06.946 [2024-11-16 17:45:44.312850] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ca1e0, cid 5, qid 0 00:26:06.946 [2024-11-16 17:45:44.313018] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.946 [2024-11-16 17:45:44.313033] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.946 [2024-11-16 17:45:44.313040] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.313046] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1364420): datao=0, datal=1024, cccid=4 00:26:06.946 [2024-11-16 17:45:44.313054] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ca080) on tqpair(0x1364420): expected_datao=0, payload_size=1024 00:26:06.946 [2024-11-16 17:45:44.313064] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.313071] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.313079] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.946 [2024-11-16 17:45:44.313088] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.946 [2024-11-16 17:45:44.313094] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.313101] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ca1e0) on tqpair=0x1364420 00:26:06.946 [2024-11-16 17:45:44.356640] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.946 [2024-11-16 17:45:44.356659] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.946 [2024-11-16 17:45:44.356666] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.946 [2024-11-16 17:45:44.356673] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ca080) on tqpair=0x1364420 00:26:06.946 [2024-11-16 17:45:44.356692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.356701] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.356707] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1364420) 00:26:06.947 [2024-11-16 17:45:44.356718] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.947 [2024-11-16 17:45:44.356770] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ca080, cid 4, qid 0 00:26:06.947 [2024-11-16 17:45:44.356985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.947 [2024-11-16 17:45:44.356997] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.947 [2024-11-16 17:45:44.357004] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.357010] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1364420): datao=0, datal=3072, cccid=4 00:26:06.947 [2024-11-16 17:45:44.357017] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ca080) on tqpair(0x1364420): expected_datao=0, payload_size=3072 00:26:06.947 [2024-11-16 17:45:44.357036] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.357045] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.357056] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.947 [2024-11-16 17:45:44.357066] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.947 [2024-11-16 17:45:44.357072] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.357079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ca080) on tqpair=0x1364420 00:26:06.947 [2024-11-16 17:45:44.357094] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.357103] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.357109] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1364420) 00:26:06.947 [2024-11-16 17:45:44.357120] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.947 [2024-11-16 17:45:44.357147] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13ca080, cid 4, qid 0 00:26:06.947 [2024-11-16 17:45:44.357259] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:06.947 [2024-11-16 17:45:44.357273] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:06.947 [2024-11-16 17:45:44.357280] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.357286] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1364420): datao=0, datal=8, cccid=4 00:26:06.947 [2024-11-16 17:45:44.357293] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13ca080) on tqpair(0x1364420): expected_datao=0, payload_size=8 00:26:06.947 [2024-11-16 17:45:44.357304] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.357310] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.398642] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.947 [2024-11-16 17:45:44.398660] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.947 [2024-11-16 17:45:44.398667] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.947 [2024-11-16 17:45:44.398673] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13ca080) on tqpair=0x1364420 00:26:06.947 ===================================================== 00:26:06.947 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:06.947 ===================================================== 00:26:06.947 Controller Capabilities/Features 00:26:06.947 ================================ 00:26:06.947 Vendor ID: 0000 00:26:06.947 Subsystem Vendor ID: 0000 00:26:06.947 Serial Number: .................... 00:26:06.947 Model Number: ........................................ 00:26:06.947 Firmware Version: 24.01.1 00:26:06.947 Recommended Arb Burst: 0 00:26:06.947 IEEE OUI Identifier: 00 00 00 00:26:06.947 Multi-path I/O 00:26:06.947 May have multiple subsystem ports: No 00:26:06.947 May have multiple controllers: No 00:26:06.947 Associated with SR-IOV VF: No 00:26:06.947 Max Data Transfer Size: 131072 00:26:06.947 Max Number of Namespaces: 0 00:26:06.947 Max Number of I/O Queues: 1024 00:26:06.947 NVMe Specification Version (VS): 1.3 00:26:06.947 NVMe Specification Version (Identify): 1.3 00:26:06.947 Maximum Queue Entries: 128 00:26:06.947 Contiguous Queues Required: Yes 00:26:06.947 Arbitration Mechanisms Supported 00:26:06.947 Weighted Round Robin: Not Supported 00:26:06.947 Vendor Specific: Not Supported 00:26:06.947 Reset Timeout: 15000 ms 00:26:06.947 Doorbell Stride: 4 bytes 00:26:06.947 NVM Subsystem Reset: Not Supported 00:26:06.947 Command Sets Supported 00:26:06.947 NVM Command Set: Supported 00:26:06.947 Boot Partition: Not Supported 00:26:06.947 Memory Page Size Minimum: 4096 bytes 00:26:06.947 Memory Page Size Maximum: 4096 bytes 00:26:06.947 Persistent Memory Region: Not Supported 00:26:06.947 Optional Asynchronous Events Supported 00:26:06.947 Namespace Attribute Notices: Not Supported 00:26:06.947 Firmware Activation Notices: Not Supported 00:26:06.947 ANA Change Notices: Not Supported 00:26:06.947 PLE Aggregate Log Change Notices: Not Supported 00:26:06.947 LBA Status Info Alert Notices: Not Supported 00:26:06.947 EGE Aggregate Log Change Notices: Not Supported 00:26:06.947 Normal NVM Subsystem Shutdown event: Not Supported 00:26:06.947 Zone Descriptor Change Notices: Not Supported 00:26:06.947 Discovery Log Change Notices: Supported 00:26:06.947 Controller Attributes 00:26:06.947 128-bit Host Identifier: Not Supported 00:26:06.947 Non-Operational Permissive Mode: Not Supported 00:26:06.947 NVM Sets: Not Supported 00:26:06.947 Read Recovery Levels: Not Supported 00:26:06.947 Endurance Groups: Not Supported 00:26:06.947 Predictable Latency Mode: Not Supported 00:26:06.947 Traffic Based Keep ALive: Not Supported 00:26:06.947 Namespace Granularity: Not Supported 00:26:06.947 SQ Associations: Not Supported 00:26:06.947 UUID List: Not Supported 00:26:06.947 Multi-Domain Subsystem: Not Supported 00:26:06.947 Fixed Capacity Management: Not Supported 00:26:06.947 Variable Capacity Management: Not Supported 00:26:06.947 Delete Endurance Group: Not Supported 00:26:06.947 Delete NVM Set: Not Supported 00:26:06.947 Extended LBA Formats Supported: Not Supported 00:26:06.947 Flexible Data Placement Supported: Not Supported 00:26:06.947 00:26:06.947 Controller Memory Buffer Support 00:26:06.947 ================================ 00:26:06.947 Supported: No 00:26:06.947 00:26:06.947 Persistent Memory Region Support 00:26:06.947 ================================ 00:26:06.947 Supported: No 00:26:06.947 00:26:06.947 Admin Command Set Attributes 00:26:06.947 ============================ 00:26:06.947 Security Send/Receive: Not Supported 00:26:06.947 Format NVM: Not Supported 00:26:06.947 Firmware Activate/Download: Not Supported 00:26:06.947 Namespace Management: Not Supported 00:26:06.947 Device Self-Test: Not Supported 00:26:06.947 Directives: Not Supported 00:26:06.947 NVMe-MI: Not Supported 00:26:06.947 Virtualization Management: Not Supported 00:26:06.947 Doorbell Buffer Config: Not Supported 00:26:06.947 Get LBA Status Capability: Not Supported 00:26:06.947 Command & Feature Lockdown Capability: Not Supported 00:26:06.947 Abort Command Limit: 1 00:26:06.947 Async Event Request Limit: 4 00:26:06.947 Number of Firmware Slots: N/A 00:26:06.947 Firmware Slot 1 Read-Only: N/A 00:26:06.947 Firmware Activation Without Reset: N/A 00:26:06.947 Multiple Update Detection Support: N/A 00:26:06.947 Firmware Update Granularity: No Information Provided 00:26:06.947 Per-Namespace SMART Log: No 00:26:06.947 Asymmetric Namespace Access Log Page: Not Supported 00:26:06.947 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:06.947 Command Effects Log Page: Not Supported 00:26:06.947 Get Log Page Extended Data: Supported 00:26:06.947 Telemetry Log Pages: Not Supported 00:26:06.947 Persistent Event Log Pages: Not Supported 00:26:06.947 Supported Log Pages Log Page: May Support 00:26:06.947 Commands Supported & Effects Log Page: Not Supported 00:26:06.947 Feature Identifiers & Effects Log Page:May Support 00:26:06.947 NVMe-MI Commands & Effects Log Page: May Support 00:26:06.947 Data Area 4 for Telemetry Log: Not Supported 00:26:06.947 Error Log Page Entries Supported: 128 00:26:06.947 Keep Alive: Not Supported 00:26:06.947 00:26:06.947 NVM Command Set Attributes 00:26:06.947 ========================== 00:26:06.947 Submission Queue Entry Size 00:26:06.947 Max: 1 00:26:06.947 Min: 1 00:26:06.947 Completion Queue Entry Size 00:26:06.947 Max: 1 00:26:06.947 Min: 1 00:26:06.947 Number of Namespaces: 0 00:26:06.947 Compare Command: Not Supported 00:26:06.947 Write Uncorrectable Command: Not Supported 00:26:06.947 Dataset Management Command: Not Supported 00:26:06.947 Write Zeroes Command: Not Supported 00:26:06.947 Set Features Save Field: Not Supported 00:26:06.947 Reservations: Not Supported 00:26:06.947 Timestamp: Not Supported 00:26:06.947 Copy: Not Supported 00:26:06.947 Volatile Write Cache: Not Present 00:26:06.947 Atomic Write Unit (Normal): 1 00:26:06.947 Atomic Write Unit (PFail): 1 00:26:06.947 Atomic Compare & Write Unit: 1 00:26:06.947 Fused Compare & Write: Supported 00:26:06.947 Scatter-Gather List 00:26:06.947 SGL Command Set: Supported 00:26:06.947 SGL Keyed: Supported 00:26:06.947 SGL Bit Bucket Descriptor: Not Supported 00:26:06.948 SGL Metadata Pointer: Not Supported 00:26:06.948 Oversized SGL: Not Supported 00:26:06.948 SGL Metadata Address: Not Supported 00:26:06.948 SGL Offset: Supported 00:26:06.948 Transport SGL Data Block: Not Supported 00:26:06.948 Replay Protected Memory Block: Not Supported 00:26:06.948 00:26:06.948 Firmware Slot Information 00:26:06.948 ========================= 00:26:06.948 Active slot: 0 00:26:06.948 00:26:06.948 00:26:06.948 Error Log 00:26:06.948 ========= 00:26:06.948 00:26:06.948 Active Namespaces 00:26:06.948 ================= 00:26:06.948 Discovery Log Page 00:26:06.948 ================== 00:26:06.948 Generation Counter: 2 00:26:06.948 Number of Records: 2 00:26:06.948 Record Format: 0 00:26:06.948 00:26:06.948 Discovery Log Entry 0 00:26:06.948 ---------------------- 00:26:06.948 Transport Type: 3 (TCP) 00:26:06.948 Address Family: 1 (IPv4) 00:26:06.948 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:06.948 Entry Flags: 00:26:06.948 Duplicate Returned Information: 1 00:26:06.948 Explicit Persistent Connection Support for Discovery: 1 00:26:06.948 Transport Requirements: 00:26:06.948 Secure Channel: Not Required 00:26:06.948 Port ID: 0 (0x0000) 00:26:06.948 Controller ID: 65535 (0xffff) 00:26:06.948 Admin Max SQ Size: 128 00:26:06.948 Transport Service Identifier: 4420 00:26:06.948 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:06.948 Transport Address: 10.0.0.2 00:26:06.948 Discovery Log Entry 1 00:26:06.948 ---------------------- 00:26:06.948 Transport Type: 3 (TCP) 00:26:06.948 Address Family: 1 (IPv4) 00:26:06.948 Subsystem Type: 2 (NVM Subsystem) 00:26:06.948 Entry Flags: 00:26:06.948 Duplicate Returned Information: 0 00:26:06.948 Explicit Persistent Connection Support for Discovery: 0 00:26:06.948 Transport Requirements: 00:26:06.948 Secure Channel: Not Required 00:26:06.948 Port ID: 0 (0x0000) 00:26:06.948 Controller ID: 65535 (0xffff) 00:26:06.948 Admin Max SQ Size: 128 00:26:06.948 Transport Service Identifier: 4420 00:26:06.948 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:06.948 Transport Address: 10.0.0.2 [2024-11-16 17:45:44.398813] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:06.948 [2024-11-16 17:45:44.398838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.948 [2024-11-16 17:45:44.398850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.948 [2024-11-16 17:45:44.398860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.948 [2024-11-16 17:45:44.398869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:06.948 [2024-11-16 17:45:44.398882] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.398893] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.398901] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.948 [2024-11-16 17:45:44.398912] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.948 [2024-11-16 17:45:44.398937] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.948 [2024-11-16 17:45:44.399018] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.948 [2024-11-16 17:45:44.399032] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.948 [2024-11-16 17:45:44.399039] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399045] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.948 [2024-11-16 17:45:44.399058] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399065] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399072] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.948 [2024-11-16 17:45:44.399082] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.948 [2024-11-16 17:45:44.399109] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.948 [2024-11-16 17:45:44.399232] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.948 [2024-11-16 17:45:44.399245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.948 [2024-11-16 17:45:44.399252] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399258] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.948 [2024-11-16 17:45:44.399267] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:06.948 [2024-11-16 17:45:44.399275] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:06.948 [2024-11-16 17:45:44.399291] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399300] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399307] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.948 [2024-11-16 17:45:44.399317] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.948 [2024-11-16 17:45:44.399337] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.948 [2024-11-16 17:45:44.399421] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.948 [2024-11-16 17:45:44.399434] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.948 [2024-11-16 17:45:44.399441] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399447] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.948 [2024-11-16 17:45:44.399465] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399475] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399481] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.948 [2024-11-16 17:45:44.399491] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.948 [2024-11-16 17:45:44.399512] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.948 [2024-11-16 17:45:44.399593] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.948 [2024-11-16 17:45:44.399604] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.948 [2024-11-16 17:45:44.399611] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399629] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.948 [2024-11-16 17:45:44.399649] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399658] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399664] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.948 [2024-11-16 17:45:44.399675] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.948 [2024-11-16 17:45:44.399696] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.948 [2024-11-16 17:45:44.399770] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.948 [2024-11-16 17:45:44.399784] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.948 [2024-11-16 17:45:44.399791] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399797] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.948 [2024-11-16 17:45:44.399814] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399823] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399830] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.948 [2024-11-16 17:45:44.399840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.948 [2024-11-16 17:45:44.399861] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.948 [2024-11-16 17:45:44.399937] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.948 [2024-11-16 17:45:44.399951] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.948 [2024-11-16 17:45:44.399957] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399964] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.948 [2024-11-16 17:45:44.399981] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399990] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.399996] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.948 [2024-11-16 17:45:44.400007] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.948 [2024-11-16 17:45:44.400027] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.948 [2024-11-16 17:45:44.400107] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.948 [2024-11-16 17:45:44.400121] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.948 [2024-11-16 17:45:44.400128] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.400134] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.948 [2024-11-16 17:45:44.400151] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.400160] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.948 [2024-11-16 17:45:44.400167] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.948 [2024-11-16 17:45:44.400177] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.400197] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.400272] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.400283] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.400290] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400296] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.400318] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400327] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400334] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.400344] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.400365] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.400441] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.400455] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.400461] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400468] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.400485] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400493] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400500] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.400510] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.400530] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.400604] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.400627] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.400635] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400642] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.400660] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400669] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400675] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.400686] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.400706] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.400789] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.400803] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.400809] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400816] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.400833] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400842] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400849] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.400859] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.400879] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.400958] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.400972] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.400978] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.400985] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.401006] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401016] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401023] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.401033] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.401053] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.401128] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.401140] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.401146] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401153] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.401169] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401178] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401185] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.401195] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.401215] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.401284] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.401296] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.401302] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401308] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.401325] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401334] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401340] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.401350] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.401370] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.401446] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.401460] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.401466] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401473] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.401490] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401499] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401505] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.401516] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.401536] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.401622] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.401637] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.401644] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401650] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.401668] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401681] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401688] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.401699] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.401720] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.401797] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.401811] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.949 [2024-11-16 17:45:44.401817] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401824] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.949 [2024-11-16 17:45:44.401841] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401850] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.949 [2024-11-16 17:45:44.401857] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.949 [2024-11-16 17:45:44.401867] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.949 [2024-11-16 17:45:44.401887] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.949 [2024-11-16 17:45:44.401963] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.949 [2024-11-16 17:45:44.401977] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.950 [2024-11-16 17:45:44.401983] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.401989] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.950 [2024-11-16 17:45:44.402006] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402015] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402022] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.950 [2024-11-16 17:45:44.402032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.950 [2024-11-16 17:45:44.402052] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.950 [2024-11-16 17:45:44.402124] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.950 [2024-11-16 17:45:44.402136] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.950 [2024-11-16 17:45:44.402142] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402148] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.950 [2024-11-16 17:45:44.402165] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402174] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402180] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.950 [2024-11-16 17:45:44.402191] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.950 [2024-11-16 17:45:44.402211] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.950 [2024-11-16 17:45:44.402301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.950 [2024-11-16 17:45:44.402312] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.950 [2024-11-16 17:45:44.402319] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402325] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.950 [2024-11-16 17:45:44.402341] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402350] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402361] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.950 [2024-11-16 17:45:44.402372] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.950 [2024-11-16 17:45:44.402392] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.950 [2024-11-16 17:45:44.402483] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.950 [2024-11-16 17:45:44.402494] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.950 [2024-11-16 17:45:44.402501] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402507] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.950 [2024-11-16 17:45:44.402524] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402533] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.402539] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.950 [2024-11-16 17:45:44.402550] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.950 [2024-11-16 17:45:44.402569] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.950 [2024-11-16 17:45:44.406628] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.950 [2024-11-16 17:45:44.406645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.950 [2024-11-16 17:45:44.406652] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.406658] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.950 [2024-11-16 17:45:44.406677] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.406686] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.406693] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1364420) 00:26:06.950 [2024-11-16 17:45:44.406703] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:06.950 [2024-11-16 17:45:44.406725] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13c9f20, cid 3, qid 0 00:26:06.950 [2024-11-16 17:45:44.406838] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:06.950 [2024-11-16 17:45:44.406852] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:06.950 [2024-11-16 17:45:44.406858] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:06.950 [2024-11-16 17:45:44.406865] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13c9f20) on tqpair=0x1364420 00:26:06.950 [2024-11-16 17:45:44.406879] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:26:06.950 00:26:06.950 17:45:44 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:07.213 [2024-11-16 17:45:44.440645] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:07.213 [2024-11-16 17:45:44.440708] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1669922 ] 00:26:07.213 EAL: No free 2048 kB hugepages reported on node 1 00:26:07.213 [2024-11-16 17:45:44.472160] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:07.213 [2024-11-16 17:45:44.472208] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:07.213 [2024-11-16 17:45:44.472221] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:07.213 [2024-11-16 17:45:44.472235] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:07.213 [2024-11-16 17:45:44.472246] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:07.213 [2024-11-16 17:45:44.475667] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:07.213 [2024-11-16 17:45:44.475709] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1d96420 0 00:26:07.213 [2024-11-16 17:45:44.482652] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:07.213 [2024-11-16 17:45:44.482672] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:07.213 [2024-11-16 17:45:44.482680] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:07.213 [2024-11-16 17:45:44.482686] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:07.213 [2024-11-16 17:45:44.482723] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.213 [2024-11-16 17:45:44.482735] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.213 [2024-11-16 17:45:44.482741] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.213 [2024-11-16 17:45:44.482756] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:07.213 [2024-11-16 17:45:44.482781] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.213 [2024-11-16 17:45:44.490628] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.213 [2024-11-16 17:45:44.490645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.213 [2024-11-16 17:45:44.490652] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.213 [2024-11-16 17:45:44.490658] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.213 [2024-11-16 17:45:44.490673] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:07.213 [2024-11-16 17:45:44.490697] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:07.213 [2024-11-16 17:45:44.490706] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:07.213 [2024-11-16 17:45:44.490723] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.213 [2024-11-16 17:45:44.490732] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.213 [2024-11-16 17:45:44.490738] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.213 [2024-11-16 17:45:44.490749] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.213 [2024-11-16 17:45:44.490773] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.213 [2024-11-16 17:45:44.490895] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.213 [2024-11-16 17:45:44.490909] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.213 [2024-11-16 17:45:44.490916] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.213 [2024-11-16 17:45:44.490922] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.214 [2024-11-16 17:45:44.490931] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:07.214 [2024-11-16 17:45:44.490944] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:07.214 [2024-11-16 17:45:44.490957] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.490964] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.490970] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.214 [2024-11-16 17:45:44.490985] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.214 [2024-11-16 17:45:44.491007] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.214 [2024-11-16 17:45:44.491094] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.214 [2024-11-16 17:45:44.491108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.214 [2024-11-16 17:45:44.491115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.214 [2024-11-16 17:45:44.491130] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:07.214 [2024-11-16 17:45:44.491144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:07.214 [2024-11-16 17:45:44.491156] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491163] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491169] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.214 [2024-11-16 17:45:44.491180] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.214 [2024-11-16 17:45:44.491201] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.214 [2024-11-16 17:45:44.491275] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.214 [2024-11-16 17:45:44.491289] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.214 [2024-11-16 17:45:44.491295] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491301] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.214 [2024-11-16 17:45:44.491311] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:07.214 [2024-11-16 17:45:44.491328] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491337] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491343] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.214 [2024-11-16 17:45:44.491353] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.214 [2024-11-16 17:45:44.491374] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.214 [2024-11-16 17:45:44.491454] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.214 [2024-11-16 17:45:44.491467] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.214 [2024-11-16 17:45:44.491474] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491480] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.214 [2024-11-16 17:45:44.491488] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:07.214 [2024-11-16 17:45:44.491497] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:07.214 [2024-11-16 17:45:44.491509] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:07.214 [2024-11-16 17:45:44.491622] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:07.214 [2024-11-16 17:45:44.491631] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:07.214 [2024-11-16 17:45:44.491642] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491653] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491660] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.214 [2024-11-16 17:45:44.491671] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.214 [2024-11-16 17:45:44.491692] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.214 [2024-11-16 17:45:44.491813] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.214 [2024-11-16 17:45:44.491825] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.214 [2024-11-16 17:45:44.491831] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491837] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.214 [2024-11-16 17:45:44.491846] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:07.214 [2024-11-16 17:45:44.491863] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491871] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.491878] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.214 [2024-11-16 17:45:44.491888] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.214 [2024-11-16 17:45:44.491908] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.214 [2024-11-16 17:45:44.491985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.214 [2024-11-16 17:45:44.491999] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.214 [2024-11-16 17:45:44.492005] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.492011] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.214 [2024-11-16 17:45:44.492020] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:07.214 [2024-11-16 17:45:44.492028] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:07.214 [2024-11-16 17:45:44.492041] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:07.214 [2024-11-16 17:45:44.492055] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:07.214 [2024-11-16 17:45:44.492068] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.492075] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.492081] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.214 [2024-11-16 17:45:44.492092] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.214 [2024-11-16 17:45:44.492113] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.214 [2024-11-16 17:45:44.492239] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.214 [2024-11-16 17:45:44.492253] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.214 [2024-11-16 17:45:44.492260] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.492266] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d96420): datao=0, datal=4096, cccid=0 00:26:07.214 [2024-11-16 17:45:44.492273] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1dfbb00) on tqpair(0x1d96420): expected_datao=0, payload_size=4096 00:26:07.214 [2024-11-16 17:45:44.492291] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.492299] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.532709] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.214 [2024-11-16 17:45:44.532729] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.214 [2024-11-16 17:45:44.532736] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.532743] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.214 [2024-11-16 17:45:44.532755] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:07.214 [2024-11-16 17:45:44.532764] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:07.214 [2024-11-16 17:45:44.532771] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:07.214 [2024-11-16 17:45:44.532777] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:07.214 [2024-11-16 17:45:44.532784] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:07.214 [2024-11-16 17:45:44.532792] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:07.214 [2024-11-16 17:45:44.532812] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:07.214 [2024-11-16 17:45:44.532826] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.532833] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.532840] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.214 [2024-11-16 17:45:44.532851] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:07.214 [2024-11-16 17:45:44.532874] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.214 [2024-11-16 17:45:44.532954] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.214 [2024-11-16 17:45:44.532968] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.214 [2024-11-16 17:45:44.532974] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.532981] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbb00) on tqpair=0x1d96420 00:26:07.214 [2024-11-16 17:45:44.532992] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.532999] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.533006] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d96420) 00:26:07.214 [2024-11-16 17:45:44.533015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.214 [2024-11-16 17:45:44.533025] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.533032] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.214 [2024-11-16 17:45:44.533039] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1d96420) 00:26:07.215 [2024-11-16 17:45:44.533047] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.215 [2024-11-16 17:45:44.533057] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533063] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533069] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1d96420) 00:26:07.215 [2024-11-16 17:45:44.533078] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.215 [2024-11-16 17:45:44.533087] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533094] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533104] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.215 [2024-11-16 17:45:44.533113] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.215 [2024-11-16 17:45:44.533122] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.533141] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.533168] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533175] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533181] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d96420) 00:26:07.215 [2024-11-16 17:45:44.533191] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.215 [2024-11-16 17:45:44.533214] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbb00, cid 0, qid 0 00:26:07.215 [2024-11-16 17:45:44.533240] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbc60, cid 1, qid 0 00:26:07.215 [2024-11-16 17:45:44.533247] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbdc0, cid 2, qid 0 00:26:07.215 [2024-11-16 17:45:44.533255] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.215 [2024-11-16 17:45:44.533262] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc080, cid 4, qid 0 00:26:07.215 [2024-11-16 17:45:44.533397] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.215 [2024-11-16 17:45:44.533411] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.215 [2024-11-16 17:45:44.533417] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533424] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc080) on tqpair=0x1d96420 00:26:07.215 [2024-11-16 17:45:44.533433] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:07.215 [2024-11-16 17:45:44.533441] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.533455] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.533470] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.533481] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533489] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533495] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d96420) 00:26:07.215 [2024-11-16 17:45:44.533505] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:07.215 [2024-11-16 17:45:44.533526] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc080, cid 4, qid 0 00:26:07.215 [2024-11-16 17:45:44.533710] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.215 [2024-11-16 17:45:44.533726] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.215 [2024-11-16 17:45:44.533734] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533741] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc080) on tqpair=0x1d96420 00:26:07.215 [2024-11-16 17:45:44.533807] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.533825] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.533842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533850] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.533856] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d96420) 00:26:07.215 [2024-11-16 17:45:44.533868] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.215 [2024-11-16 17:45:44.533890] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc080, cid 4, qid 0 00:26:07.215 [2024-11-16 17:45:44.533996] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.215 [2024-11-16 17:45:44.534008] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.215 [2024-11-16 17:45:44.534015] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534021] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d96420): datao=0, datal=4096, cccid=4 00:26:07.215 [2024-11-16 17:45:44.534028] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1dfc080) on tqpair(0x1d96420): expected_datao=0, payload_size=4096 00:26:07.215 [2024-11-16 17:45:44.534039] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534046] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534057] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.215 [2024-11-16 17:45:44.534067] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.215 [2024-11-16 17:45:44.534073] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc080) on tqpair=0x1d96420 00:26:07.215 [2024-11-16 17:45:44.534099] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:07.215 [2024-11-16 17:45:44.534116] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.534133] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.534145] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534152] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534159] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d96420) 00:26:07.215 [2024-11-16 17:45:44.534169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.215 [2024-11-16 17:45:44.534190] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc080, cid 4, qid 0 00:26:07.215 [2024-11-16 17:45:44.534293] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.215 [2024-11-16 17:45:44.534305] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.215 [2024-11-16 17:45:44.534312] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534318] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d96420): datao=0, datal=4096, cccid=4 00:26:07.215 [2024-11-16 17:45:44.534325] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1dfc080) on tqpair(0x1d96420): expected_datao=0, payload_size=4096 00:26:07.215 [2024-11-16 17:45:44.534335] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534342] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534353] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.215 [2024-11-16 17:45:44.534362] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.215 [2024-11-16 17:45:44.534368] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534375] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc080) on tqpair=0x1d96420 00:26:07.215 [2024-11-16 17:45:44.534400] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.534420] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.534433] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534440] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534446] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d96420) 00:26:07.215 [2024-11-16 17:45:44.534457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.215 [2024-11-16 17:45:44.534478] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc080, cid 4, qid 0 00:26:07.215 [2024-11-16 17:45:44.534573] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.215 [2024-11-16 17:45:44.534588] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.215 [2024-11-16 17:45:44.534595] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.534601] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d96420): datao=0, datal=4096, cccid=4 00:26:07.215 [2024-11-16 17:45:44.534608] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1dfc080) on tqpair(0x1d96420): expected_datao=0, payload_size=4096 00:26:07.215 [2024-11-16 17:45:44.538630] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.538642] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.538654] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.215 [2024-11-16 17:45:44.538663] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.215 [2024-11-16 17:45:44.538670] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.215 [2024-11-16 17:45:44.538676] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc080) on tqpair=0x1d96420 00:26:07.215 [2024-11-16 17:45:44.538690] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.538705] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.538736] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.538746] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.538754] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:07.215 [2024-11-16 17:45:44.538762] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:07.216 [2024-11-16 17:45:44.538770] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:07.216 [2024-11-16 17:45:44.538778] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:07.216 [2024-11-16 17:45:44.538797] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.538806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.538812] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.538823] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.216 [2024-11-16 17:45:44.538834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.538844] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.538851] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.538861] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:07.216 [2024-11-16 17:45:44.538886] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc080, cid 4, qid 0 00:26:07.216 [2024-11-16 17:45:44.538898] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc1e0, cid 5, qid 0 00:26:07.216 [2024-11-16 17:45:44.539032] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.216 [2024-11-16 17:45:44.539044] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.216 [2024-11-16 17:45:44.539050] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539056] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc080) on tqpair=0x1d96420 00:26:07.216 [2024-11-16 17:45:44.539068] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.216 [2024-11-16 17:45:44.539077] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.216 [2024-11-16 17:45:44.539083] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539089] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc1e0) on tqpair=0x1d96420 00:26:07.216 [2024-11-16 17:45:44.539106] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539115] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539122] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.539131] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.216 [2024-11-16 17:45:44.539152] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc1e0, cid 5, qid 0 00:26:07.216 [2024-11-16 17:45:44.539231] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.216 [2024-11-16 17:45:44.539245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.216 [2024-11-16 17:45:44.539252] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539258] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc1e0) on tqpair=0x1d96420 00:26:07.216 [2024-11-16 17:45:44.539274] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539282] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539289] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.539299] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.216 [2024-11-16 17:45:44.539319] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc1e0, cid 5, qid 0 00:26:07.216 [2024-11-16 17:45:44.539394] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.216 [2024-11-16 17:45:44.539405] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.216 [2024-11-16 17:45:44.539412] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc1e0) on tqpair=0x1d96420 00:26:07.216 [2024-11-16 17:45:44.539434] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539443] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539450] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.539461] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.216 [2024-11-16 17:45:44.539482] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc1e0, cid 5, qid 0 00:26:07.216 [2024-11-16 17:45:44.539557] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.216 [2024-11-16 17:45:44.539572] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.216 [2024-11-16 17:45:44.539578] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539585] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc1e0) on tqpair=0x1d96420 00:26:07.216 [2024-11-16 17:45:44.539603] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539613] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539629] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.539640] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.216 [2024-11-16 17:45:44.539651] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539658] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539665] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.539674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.216 [2024-11-16 17:45:44.539685] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539692] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539699] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.539708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.216 [2024-11-16 17:45:44.539719] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539726] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.539732] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1d96420) 00:26:07.216 [2024-11-16 17:45:44.539741] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.216 [2024-11-16 17:45:44.539763] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc1e0, cid 5, qid 0 00:26:07.216 [2024-11-16 17:45:44.539774] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc080, cid 4, qid 0 00:26:07.216 [2024-11-16 17:45:44.539782] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc340, cid 6, qid 0 00:26:07.216 [2024-11-16 17:45:44.539790] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc4a0, cid 7, qid 0 00:26:07.216 [2024-11-16 17:45:44.539997] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.216 [2024-11-16 17:45:44.540013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.216 [2024-11-16 17:45:44.540020] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540027] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d96420): datao=0, datal=8192, cccid=5 00:26:07.216 [2024-11-16 17:45:44.540035] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1dfc1e0) on tqpair(0x1d96420): expected_datao=0, payload_size=8192 00:26:07.216 [2024-11-16 17:45:44.540046] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540053] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540061] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.216 [2024-11-16 17:45:44.540070] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.216 [2024-11-16 17:45:44.540077] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540082] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d96420): datao=0, datal=512, cccid=4 00:26:07.216 [2024-11-16 17:45:44.540095] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1dfc080) on tqpair(0x1d96420): expected_datao=0, payload_size=512 00:26:07.216 [2024-11-16 17:45:44.540105] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540112] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540120] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.216 [2024-11-16 17:45:44.540129] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.216 [2024-11-16 17:45:44.540135] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540141] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d96420): datao=0, datal=512, cccid=6 00:26:07.216 [2024-11-16 17:45:44.540148] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1dfc340) on tqpair(0x1d96420): expected_datao=0, payload_size=512 00:26:07.216 [2024-11-16 17:45:44.540158] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540165] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540173] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:07.216 [2024-11-16 17:45:44.540182] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:07.216 [2024-11-16 17:45:44.540189] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540195] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d96420): datao=0, datal=4096, cccid=7 00:26:07.216 [2024-11-16 17:45:44.540202] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1dfc4a0) on tqpair(0x1d96420): expected_datao=0, payload_size=4096 00:26:07.216 [2024-11-16 17:45:44.540212] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540218] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540230] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.216 [2024-11-16 17:45:44.540240] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.216 [2024-11-16 17:45:44.540247] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540254] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc1e0) on tqpair=0x1d96420 00:26:07.216 [2024-11-16 17:45:44.540289] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.216 [2024-11-16 17:45:44.540301] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.216 [2024-11-16 17:45:44.540307] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.216 [2024-11-16 17:45:44.540313] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc080) on tqpair=0x1d96420 00:26:07.216 [2024-11-16 17:45:44.540327] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.217 [2024-11-16 17:45:44.540353] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.217 [2024-11-16 17:45:44.540359] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.217 [2024-11-16 17:45:44.540364] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc340) on tqpair=0x1d96420 00:26:07.217 [2024-11-16 17:45:44.540375] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.217 [2024-11-16 17:45:44.540385] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.217 [2024-11-16 17:45:44.540391] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.217 [2024-11-16 17:45:44.540397] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc4a0) on tqpair=0x1d96420 00:26:07.217 ===================================================== 00:26:07.217 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:07.217 ===================================================== 00:26:07.217 Controller Capabilities/Features 00:26:07.217 ================================ 00:26:07.217 Vendor ID: 8086 00:26:07.217 Subsystem Vendor ID: 8086 00:26:07.217 Serial Number: SPDK00000000000001 00:26:07.217 Model Number: SPDK bdev Controller 00:26:07.217 Firmware Version: 24.01.1 00:26:07.217 Recommended Arb Burst: 6 00:26:07.217 IEEE OUI Identifier: e4 d2 5c 00:26:07.217 Multi-path I/O 00:26:07.217 May have multiple subsystem ports: Yes 00:26:07.217 May have multiple controllers: Yes 00:26:07.217 Associated with SR-IOV VF: No 00:26:07.217 Max Data Transfer Size: 131072 00:26:07.217 Max Number of Namespaces: 32 00:26:07.217 Max Number of I/O Queues: 127 00:26:07.217 NVMe Specification Version (VS): 1.3 00:26:07.217 NVMe Specification Version (Identify): 1.3 00:26:07.217 Maximum Queue Entries: 128 00:26:07.217 Contiguous Queues Required: Yes 00:26:07.217 Arbitration Mechanisms Supported 00:26:07.217 Weighted Round Robin: Not Supported 00:26:07.217 Vendor Specific: Not Supported 00:26:07.217 Reset Timeout: 15000 ms 00:26:07.217 Doorbell Stride: 4 bytes 00:26:07.217 NVM Subsystem Reset: Not Supported 00:26:07.217 Command Sets Supported 00:26:07.217 NVM Command Set: Supported 00:26:07.217 Boot Partition: Not Supported 00:26:07.217 Memory Page Size Minimum: 4096 bytes 00:26:07.217 Memory Page Size Maximum: 4096 bytes 00:26:07.217 Persistent Memory Region: Not Supported 00:26:07.217 Optional Asynchronous Events Supported 00:26:07.217 Namespace Attribute Notices: Supported 00:26:07.217 Firmware Activation Notices: Not Supported 00:26:07.217 ANA Change Notices: Not Supported 00:26:07.217 PLE Aggregate Log Change Notices: Not Supported 00:26:07.217 LBA Status Info Alert Notices: Not Supported 00:26:07.217 EGE Aggregate Log Change Notices: Not Supported 00:26:07.217 Normal NVM Subsystem Shutdown event: Not Supported 00:26:07.217 Zone Descriptor Change Notices: Not Supported 00:26:07.217 Discovery Log Change Notices: Not Supported 00:26:07.217 Controller Attributes 00:26:07.217 128-bit Host Identifier: Supported 00:26:07.217 Non-Operational Permissive Mode: Not Supported 00:26:07.217 NVM Sets: Not Supported 00:26:07.217 Read Recovery Levels: Not Supported 00:26:07.217 Endurance Groups: Not Supported 00:26:07.217 Predictable Latency Mode: Not Supported 00:26:07.217 Traffic Based Keep ALive: Not Supported 00:26:07.217 Namespace Granularity: Not Supported 00:26:07.217 SQ Associations: Not Supported 00:26:07.217 UUID List: Not Supported 00:26:07.217 Multi-Domain Subsystem: Not Supported 00:26:07.217 Fixed Capacity Management: Not Supported 00:26:07.217 Variable Capacity Management: Not Supported 00:26:07.217 Delete Endurance Group: Not Supported 00:26:07.217 Delete NVM Set: Not Supported 00:26:07.217 Extended LBA Formats Supported: Not Supported 00:26:07.217 Flexible Data Placement Supported: Not Supported 00:26:07.217 00:26:07.217 Controller Memory Buffer Support 00:26:07.217 ================================ 00:26:07.217 Supported: No 00:26:07.217 00:26:07.217 Persistent Memory Region Support 00:26:07.217 ================================ 00:26:07.217 Supported: No 00:26:07.217 00:26:07.217 Admin Command Set Attributes 00:26:07.217 ============================ 00:26:07.217 Security Send/Receive: Not Supported 00:26:07.217 Format NVM: Not Supported 00:26:07.217 Firmware Activate/Download: Not Supported 00:26:07.217 Namespace Management: Not Supported 00:26:07.217 Device Self-Test: Not Supported 00:26:07.217 Directives: Not Supported 00:26:07.217 NVMe-MI: Not Supported 00:26:07.217 Virtualization Management: Not Supported 00:26:07.217 Doorbell Buffer Config: Not Supported 00:26:07.217 Get LBA Status Capability: Not Supported 00:26:07.217 Command & Feature Lockdown Capability: Not Supported 00:26:07.217 Abort Command Limit: 4 00:26:07.217 Async Event Request Limit: 4 00:26:07.217 Number of Firmware Slots: N/A 00:26:07.217 Firmware Slot 1 Read-Only: N/A 00:26:07.217 Firmware Activation Without Reset: N/A 00:26:07.217 Multiple Update Detection Support: N/A 00:26:07.217 Firmware Update Granularity: No Information Provided 00:26:07.217 Per-Namespace SMART Log: No 00:26:07.217 Asymmetric Namespace Access Log Page: Not Supported 00:26:07.217 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:07.217 Command Effects Log Page: Supported 00:26:07.217 Get Log Page Extended Data: Supported 00:26:07.217 Telemetry Log Pages: Not Supported 00:26:07.217 Persistent Event Log Pages: Not Supported 00:26:07.217 Supported Log Pages Log Page: May Support 00:26:07.217 Commands Supported & Effects Log Page: Not Supported 00:26:07.217 Feature Identifiers & Effects Log Page:May Support 00:26:07.217 NVMe-MI Commands & Effects Log Page: May Support 00:26:07.217 Data Area 4 for Telemetry Log: Not Supported 00:26:07.217 Error Log Page Entries Supported: 128 00:26:07.217 Keep Alive: Supported 00:26:07.217 Keep Alive Granularity: 10000 ms 00:26:07.217 00:26:07.217 NVM Command Set Attributes 00:26:07.217 ========================== 00:26:07.217 Submission Queue Entry Size 00:26:07.217 Max: 64 00:26:07.217 Min: 64 00:26:07.217 Completion Queue Entry Size 00:26:07.217 Max: 16 00:26:07.217 Min: 16 00:26:07.217 Number of Namespaces: 32 00:26:07.217 Compare Command: Supported 00:26:07.217 Write Uncorrectable Command: Not Supported 00:26:07.217 Dataset Management Command: Supported 00:26:07.217 Write Zeroes Command: Supported 00:26:07.217 Set Features Save Field: Not Supported 00:26:07.217 Reservations: Supported 00:26:07.217 Timestamp: Not Supported 00:26:07.217 Copy: Supported 00:26:07.217 Volatile Write Cache: Present 00:26:07.217 Atomic Write Unit (Normal): 1 00:26:07.217 Atomic Write Unit (PFail): 1 00:26:07.217 Atomic Compare & Write Unit: 1 00:26:07.217 Fused Compare & Write: Supported 00:26:07.217 Scatter-Gather List 00:26:07.217 SGL Command Set: Supported 00:26:07.217 SGL Keyed: Supported 00:26:07.217 SGL Bit Bucket Descriptor: Not Supported 00:26:07.217 SGL Metadata Pointer: Not Supported 00:26:07.217 Oversized SGL: Not Supported 00:26:07.217 SGL Metadata Address: Not Supported 00:26:07.217 SGL Offset: Supported 00:26:07.217 Transport SGL Data Block: Not Supported 00:26:07.217 Replay Protected Memory Block: Not Supported 00:26:07.217 00:26:07.217 Firmware Slot Information 00:26:07.217 ========================= 00:26:07.217 Active slot: 1 00:26:07.217 Slot 1 Firmware Revision: 24.01.1 00:26:07.217 00:26:07.217 00:26:07.217 Commands Supported and Effects 00:26:07.217 ============================== 00:26:07.217 Admin Commands 00:26:07.217 -------------- 00:26:07.217 Get Log Page (02h): Supported 00:26:07.217 Identify (06h): Supported 00:26:07.217 Abort (08h): Supported 00:26:07.217 Set Features (09h): Supported 00:26:07.217 Get Features (0Ah): Supported 00:26:07.217 Asynchronous Event Request (0Ch): Supported 00:26:07.217 Keep Alive (18h): Supported 00:26:07.217 I/O Commands 00:26:07.217 ------------ 00:26:07.217 Flush (00h): Supported LBA-Change 00:26:07.217 Write (01h): Supported LBA-Change 00:26:07.217 Read (02h): Supported 00:26:07.217 Compare (05h): Supported 00:26:07.217 Write Zeroes (08h): Supported LBA-Change 00:26:07.217 Dataset Management (09h): Supported LBA-Change 00:26:07.217 Copy (19h): Supported LBA-Change 00:26:07.217 Unknown (79h): Supported LBA-Change 00:26:07.217 Unknown (7Ah): Supported 00:26:07.217 00:26:07.217 Error Log 00:26:07.217 ========= 00:26:07.217 00:26:07.217 Arbitration 00:26:07.217 =========== 00:26:07.217 Arbitration Burst: 1 00:26:07.217 00:26:07.217 Power Management 00:26:07.217 ================ 00:26:07.217 Number of Power States: 1 00:26:07.217 Current Power State: Power State #0 00:26:07.217 Power State #0: 00:26:07.217 Max Power: 0.00 W 00:26:07.217 Non-Operational State: Operational 00:26:07.217 Entry Latency: Not Reported 00:26:07.217 Exit Latency: Not Reported 00:26:07.217 Relative Read Throughput: 0 00:26:07.218 Relative Read Latency: 0 00:26:07.218 Relative Write Throughput: 0 00:26:07.218 Relative Write Latency: 0 00:26:07.218 Idle Power: Not Reported 00:26:07.218 Active Power: Not Reported 00:26:07.218 Non-Operational Permissive Mode: Not Supported 00:26:07.218 00:26:07.218 Health Information 00:26:07.218 ================== 00:26:07.218 Critical Warnings: 00:26:07.218 Available Spare Space: OK 00:26:07.218 Temperature: OK 00:26:07.218 Device Reliability: OK 00:26:07.218 Read Only: No 00:26:07.218 Volatile Memory Backup: OK 00:26:07.218 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:07.218 Temperature Threshold: [2024-11-16 17:45:44.540530] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.540542] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.540548] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x1d96420) 00:26:07.218 [2024-11-16 17:45:44.540558] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.218 [2024-11-16 17:45:44.540580] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfc4a0, cid 7, qid 0 00:26:07.218 [2024-11-16 17:45:44.540712] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.218 [2024-11-16 17:45:44.540726] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.218 [2024-11-16 17:45:44.540733] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.540739] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfc4a0) on tqpair=0x1d96420 00:26:07.218 [2024-11-16 17:45:44.540780] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:07.218 [2024-11-16 17:45:44.540802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.218 [2024-11-16 17:45:44.540814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.218 [2024-11-16 17:45:44.540823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.218 [2024-11-16 17:45:44.540833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:07.218 [2024-11-16 17:45:44.540845] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.540852] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.540859] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.218 [2024-11-16 17:45:44.540869] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.218 [2024-11-16 17:45:44.540891] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.218 [2024-11-16 17:45:44.540970] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.218 [2024-11-16 17:45:44.540984] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.218 [2024-11-16 17:45:44.540990] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.540996] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.218 [2024-11-16 17:45:44.541008] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541016] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541022] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.218 [2024-11-16 17:45:44.541032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.218 [2024-11-16 17:45:44.541058] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.218 [2024-11-16 17:45:44.541160] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.218 [2024-11-16 17:45:44.541174] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.218 [2024-11-16 17:45:44.541180] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541186] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.218 [2024-11-16 17:45:44.541195] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:07.218 [2024-11-16 17:45:44.541202] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:07.218 [2024-11-16 17:45:44.541218] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541226] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541233] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.218 [2024-11-16 17:45:44.541243] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.218 [2024-11-16 17:45:44.541264] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.218 [2024-11-16 17:45:44.541335] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.218 [2024-11-16 17:45:44.541347] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.218 [2024-11-16 17:45:44.541354] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541360] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.218 [2024-11-16 17:45:44.541377] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541386] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541393] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.218 [2024-11-16 17:45:44.541403] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.218 [2024-11-16 17:45:44.541423] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.218 [2024-11-16 17:45:44.541498] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.218 [2024-11-16 17:45:44.541510] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.218 [2024-11-16 17:45:44.541516] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541522] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.218 [2024-11-16 17:45:44.541539] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541548] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541554] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.218 [2024-11-16 17:45:44.541564] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.218 [2024-11-16 17:45:44.541584] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.218 [2024-11-16 17:45:44.541683] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.218 [2024-11-16 17:45:44.541697] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.218 [2024-11-16 17:45:44.541704] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541710] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.218 [2024-11-16 17:45:44.541728] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541737] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541743] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.218 [2024-11-16 17:45:44.541753] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.218 [2024-11-16 17:45:44.541773] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.218 [2024-11-16 17:45:44.541856] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.218 [2024-11-16 17:45:44.541870] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.218 [2024-11-16 17:45:44.541876] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541882] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.218 [2024-11-16 17:45:44.541899] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541908] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.541914] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.218 [2024-11-16 17:45:44.541925] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.218 [2024-11-16 17:45:44.541945] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.218 [2024-11-16 17:45:44.542027] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.218 [2024-11-16 17:45:44.542045] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.218 [2024-11-16 17:45:44.542052] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.218 [2024-11-16 17:45:44.542058] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.218 [2024-11-16 17:45:44.542076] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542085] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542091] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.219 [2024-11-16 17:45:44.542101] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.219 [2024-11-16 17:45:44.542121] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.219 [2024-11-16 17:45:44.542192] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.219 [2024-11-16 17:45:44.542206] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.219 [2024-11-16 17:45:44.542212] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542218] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.219 [2024-11-16 17:45:44.542235] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542244] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542250] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.219 [2024-11-16 17:45:44.542260] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.219 [2024-11-16 17:45:44.542281] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.219 [2024-11-16 17:45:44.542354] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.219 [2024-11-16 17:45:44.542367] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.219 [2024-11-16 17:45:44.542374] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542380] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.219 [2024-11-16 17:45:44.542397] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542406] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542412] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.219 [2024-11-16 17:45:44.542423] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.219 [2024-11-16 17:45:44.542443] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.219 [2024-11-16 17:45:44.542515] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.219 [2024-11-16 17:45:44.542527] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.219 [2024-11-16 17:45:44.542533] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542539] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.219 [2024-11-16 17:45:44.542556] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542568] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.542576] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.219 [2024-11-16 17:45:44.542586] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.219 [2024-11-16 17:45:44.542606] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.219 [2024-11-16 17:45:44.546648] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.219 [2024-11-16 17:45:44.546663] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.219 [2024-11-16 17:45:44.546674] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.546681] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.219 [2024-11-16 17:45:44.546700] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.546710] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.546716] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d96420) 00:26:07.219 [2024-11-16 17:45:44.546727] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:07.219 [2024-11-16 17:45:44.546748] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1dfbf20, cid 3, qid 0 00:26:07.219 [2024-11-16 17:45:44.546861] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:07.219 [2024-11-16 17:45:44.546873] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:07.219 [2024-11-16 17:45:44.546879] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:07.219 [2024-11-16 17:45:44.546886] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1dfbf20) on tqpair=0x1d96420 00:26:07.219 [2024-11-16 17:45:44.546899] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:26:07.219 0 Kelvin (-273 Celsius) 00:26:07.219 Available Spare: 0% 00:26:07.219 Available Spare Threshold: 0% 00:26:07.219 Life Percentage Used: 0% 00:26:07.219 Data Units Read: 0 00:26:07.219 Data Units Written: 0 00:26:07.219 Host Read Commands: 0 00:26:07.219 Host Write Commands: 0 00:26:07.219 Controller Busy Time: 0 minutes 00:26:07.219 Power Cycles: 0 00:26:07.219 Power On Hours: 0 hours 00:26:07.219 Unsafe Shutdowns: 0 00:26:07.219 Unrecoverable Media Errors: 0 00:26:07.219 Lifetime Error Log Entries: 0 00:26:07.219 Warning Temperature Time: 0 minutes 00:26:07.219 Critical Temperature Time: 0 minutes 00:26:07.219 00:26:07.219 Number of Queues 00:26:07.219 ================ 00:26:07.219 Number of I/O Submission Queues: 127 00:26:07.219 Number of I/O Completion Queues: 127 00:26:07.219 00:26:07.219 Active Namespaces 00:26:07.219 ================= 00:26:07.219 Namespace ID:1 00:26:07.219 Error Recovery Timeout: Unlimited 00:26:07.219 Command Set Identifier: NVM (00h) 00:26:07.219 Deallocate: Supported 00:26:07.219 Deallocated/Unwritten Error: Not Supported 00:26:07.219 Deallocated Read Value: Unknown 00:26:07.219 Deallocate in Write Zeroes: Not Supported 00:26:07.219 Deallocated Guard Field: 0xFFFF 00:26:07.219 Flush: Supported 00:26:07.219 Reservation: Supported 00:26:07.219 Namespace Sharing Capabilities: Multiple Controllers 00:26:07.219 Size (in LBAs): 131072 (0GiB) 00:26:07.219 Capacity (in LBAs): 131072 (0GiB) 00:26:07.219 Utilization (in LBAs): 131072 (0GiB) 00:26:07.219 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:07.219 EUI64: ABCDEF0123456789 00:26:07.219 UUID: 0c305e8a-41a7-4323-b380-90dcafd1e759 00:26:07.219 Thin Provisioning: Not Supported 00:26:07.219 Per-NS Atomic Units: Yes 00:26:07.219 Atomic Boundary Size (Normal): 0 00:26:07.219 Atomic Boundary Size (PFail): 0 00:26:07.219 Atomic Boundary Offset: 0 00:26:07.219 Maximum Single Source Range Length: 65535 00:26:07.219 Maximum Copy Length: 65535 00:26:07.219 Maximum Source Range Count: 1 00:26:07.219 NGUID/EUI64 Never Reused: No 00:26:07.219 Namespace Write Protected: No 00:26:07.219 Number of LBA Formats: 1 00:26:07.219 Current LBA Format: LBA Format #00 00:26:07.219 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:07.219 00:26:07.219 17:45:44 -- host/identify.sh@51 -- # sync 00:26:07.219 17:45:44 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:07.219 17:45:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:07.219 17:45:44 -- common/autotest_common.sh@10 -- # set +x 00:26:07.219 17:45:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:07.219 17:45:44 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:07.219 17:45:44 -- host/identify.sh@56 -- # nvmftestfini 00:26:07.219 17:45:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:07.219 17:45:44 -- nvmf/common.sh@116 -- # sync 00:26:07.219 17:45:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:07.219 17:45:44 -- nvmf/common.sh@119 -- # set +e 00:26:07.219 17:45:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:07.219 17:45:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:07.219 rmmod nvme_tcp 00:26:07.219 rmmod nvme_fabrics 00:26:07.219 rmmod nvme_keyring 00:26:07.219 17:45:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:07.219 17:45:44 -- nvmf/common.sh@123 -- # set -e 00:26:07.219 17:45:44 -- nvmf/common.sh@124 -- # return 0 00:26:07.219 17:45:44 -- nvmf/common.sh@477 -- # '[' -n 1669754 ']' 00:26:07.219 17:45:44 -- nvmf/common.sh@478 -- # killprocess 1669754 00:26:07.219 17:45:44 -- common/autotest_common.sh@936 -- # '[' -z 1669754 ']' 00:26:07.219 17:45:44 -- common/autotest_common.sh@940 -- # kill -0 1669754 00:26:07.219 17:45:44 -- common/autotest_common.sh@941 -- # uname 00:26:07.219 17:45:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:07.219 17:45:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1669754 00:26:07.219 17:45:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:07.219 17:45:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:07.219 17:45:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1669754' 00:26:07.219 killing process with pid 1669754 00:26:07.219 17:45:44 -- common/autotest_common.sh@955 -- # kill 1669754 00:26:07.219 [2024-11-16 17:45:44.657337] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:07.219 17:45:44 -- common/autotest_common.sh@960 -- # wait 1669754 00:26:07.480 17:45:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:07.480 17:45:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:07.480 17:45:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:07.480 17:45:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:07.480 17:45:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:07.480 17:45:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:07.480 17:45:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:07.480 17:45:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.019 17:45:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:10.019 00:26:10.019 real 0m6.177s 00:26:10.019 user 0m7.250s 00:26:10.019 sys 0m1.969s 00:26:10.019 17:45:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:10.019 17:45:46 -- common/autotest_common.sh@10 -- # set +x 00:26:10.019 ************************************ 00:26:10.019 END TEST nvmf_identify 00:26:10.019 ************************************ 00:26:10.019 17:45:46 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:10.019 17:45:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:10.019 17:45:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:10.019 17:45:46 -- common/autotest_common.sh@10 -- # set +x 00:26:10.019 ************************************ 00:26:10.019 START TEST nvmf_perf 00:26:10.019 ************************************ 00:26:10.019 17:45:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:10.019 * Looking for test storage... 00:26:10.019 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:10.019 17:45:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:10.019 17:45:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:10.019 17:45:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:10.019 17:45:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:10.019 17:45:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:10.019 17:45:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:10.019 17:45:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:10.019 17:45:47 -- scripts/common.sh@335 -- # IFS=.-: 00:26:10.019 17:45:47 -- scripts/common.sh@335 -- # read -ra ver1 00:26:10.019 17:45:47 -- scripts/common.sh@336 -- # IFS=.-: 00:26:10.019 17:45:47 -- scripts/common.sh@336 -- # read -ra ver2 00:26:10.019 17:45:47 -- scripts/common.sh@337 -- # local 'op=<' 00:26:10.019 17:45:47 -- scripts/common.sh@339 -- # ver1_l=2 00:26:10.019 17:45:47 -- scripts/common.sh@340 -- # ver2_l=1 00:26:10.019 17:45:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:10.019 17:45:47 -- scripts/common.sh@343 -- # case "$op" in 00:26:10.019 17:45:47 -- scripts/common.sh@344 -- # : 1 00:26:10.019 17:45:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:10.019 17:45:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:10.019 17:45:47 -- scripts/common.sh@364 -- # decimal 1 00:26:10.019 17:45:47 -- scripts/common.sh@352 -- # local d=1 00:26:10.019 17:45:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:10.019 17:45:47 -- scripts/common.sh@354 -- # echo 1 00:26:10.019 17:45:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:10.019 17:45:47 -- scripts/common.sh@365 -- # decimal 2 00:26:10.019 17:45:47 -- scripts/common.sh@352 -- # local d=2 00:26:10.019 17:45:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:10.019 17:45:47 -- scripts/common.sh@354 -- # echo 2 00:26:10.019 17:45:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:10.019 17:45:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:10.019 17:45:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:10.019 17:45:47 -- scripts/common.sh@367 -- # return 0 00:26:10.019 17:45:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:10.019 17:45:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:10.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.019 --rc genhtml_branch_coverage=1 00:26:10.019 --rc genhtml_function_coverage=1 00:26:10.019 --rc genhtml_legend=1 00:26:10.019 --rc geninfo_all_blocks=1 00:26:10.019 --rc geninfo_unexecuted_blocks=1 00:26:10.019 00:26:10.019 ' 00:26:10.019 17:45:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:10.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.019 --rc genhtml_branch_coverage=1 00:26:10.019 --rc genhtml_function_coverage=1 00:26:10.019 --rc genhtml_legend=1 00:26:10.019 --rc geninfo_all_blocks=1 00:26:10.019 --rc geninfo_unexecuted_blocks=1 00:26:10.019 00:26:10.019 ' 00:26:10.019 17:45:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:10.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.019 --rc genhtml_branch_coverage=1 00:26:10.019 --rc genhtml_function_coverage=1 00:26:10.019 --rc genhtml_legend=1 00:26:10.019 --rc geninfo_all_blocks=1 00:26:10.019 --rc geninfo_unexecuted_blocks=1 00:26:10.019 00:26:10.019 ' 00:26:10.019 17:45:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:10.019 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.019 --rc genhtml_branch_coverage=1 00:26:10.019 --rc genhtml_function_coverage=1 00:26:10.019 --rc genhtml_legend=1 00:26:10.019 --rc geninfo_all_blocks=1 00:26:10.019 --rc geninfo_unexecuted_blocks=1 00:26:10.019 00:26:10.019 ' 00:26:10.019 17:45:47 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:10.019 17:45:47 -- nvmf/common.sh@7 -- # uname -s 00:26:10.019 17:45:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:10.019 17:45:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:10.019 17:45:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:10.019 17:45:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:10.019 17:45:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:10.019 17:45:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:10.019 17:45:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:10.019 17:45:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:10.019 17:45:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:10.019 17:45:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:10.019 17:45:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:10.019 17:45:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:10.019 17:45:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:10.019 17:45:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:10.019 17:45:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:10.019 17:45:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:10.019 17:45:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:10.019 17:45:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:10.019 17:45:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:10.019 17:45:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.019 17:45:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.019 17:45:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.019 17:45:47 -- paths/export.sh@5 -- # export PATH 00:26:10.019 17:45:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.019 17:45:47 -- nvmf/common.sh@46 -- # : 0 00:26:10.019 17:45:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:10.019 17:45:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:10.019 17:45:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:10.019 17:45:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:10.019 17:45:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:10.019 17:45:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:10.019 17:45:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:10.019 17:45:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:10.020 17:45:47 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:10.020 17:45:47 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:10.020 17:45:47 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:10.020 17:45:47 -- host/perf.sh@17 -- # nvmftestinit 00:26:10.020 17:45:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:10.020 17:45:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:10.020 17:45:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:10.020 17:45:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:10.020 17:45:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:10.020 17:45:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:10.020 17:45:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:10.020 17:45:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.020 17:45:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:10.020 17:45:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:10.020 17:45:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:10.020 17:45:47 -- common/autotest_common.sh@10 -- # set +x 00:26:11.930 17:45:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:11.930 17:45:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:11.930 17:45:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:11.930 17:45:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:11.930 17:45:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:11.930 17:45:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:11.930 17:45:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:11.930 17:45:49 -- nvmf/common.sh@294 -- # net_devs=() 00:26:11.930 17:45:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:11.930 17:45:49 -- nvmf/common.sh@295 -- # e810=() 00:26:11.930 17:45:49 -- nvmf/common.sh@295 -- # local -ga e810 00:26:11.930 17:45:49 -- nvmf/common.sh@296 -- # x722=() 00:26:11.930 17:45:49 -- nvmf/common.sh@296 -- # local -ga x722 00:26:11.930 17:45:49 -- nvmf/common.sh@297 -- # mlx=() 00:26:11.930 17:45:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:11.930 17:45:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:11.930 17:45:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:11.930 17:45:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:11.930 17:45:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:11.930 17:45:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:11.930 17:45:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:11.930 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:11.930 17:45:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:11.930 17:45:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:11.930 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:11.930 17:45:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:11.930 17:45:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:11.930 17:45:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:11.930 17:45:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:11.930 17:45:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:11.930 17:45:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:11.930 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:11.930 17:45:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:11.930 17:45:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:11.930 17:45:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:11.930 17:45:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:11.930 17:45:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:11.930 17:45:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:11.930 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:11.930 17:45:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:11.930 17:45:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:11.930 17:45:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:11.930 17:45:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:11.930 17:45:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:11.930 17:45:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:11.930 17:45:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:11.930 17:45:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:11.930 17:45:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:11.930 17:45:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:11.930 17:45:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:11.930 17:45:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:11.930 17:45:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:11.930 17:45:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:11.930 17:45:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:11.930 17:45:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:11.930 17:45:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:11.930 17:45:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:11.930 17:45:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:11.930 17:45:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:11.930 17:45:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:11.930 17:45:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:11.930 17:45:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:11.930 17:45:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:11.930 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:11.930 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.138 ms 00:26:11.930 00:26:11.930 --- 10.0.0.2 ping statistics --- 00:26:11.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:11.930 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:26:11.930 17:45:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:11.930 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:11.930 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:26:11.930 00:26:11.930 --- 10.0.0.1 ping statistics --- 00:26:11.930 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:11.930 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:26:11.930 17:45:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:11.930 17:45:49 -- nvmf/common.sh@410 -- # return 0 00:26:11.930 17:45:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:11.930 17:45:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:11.930 17:45:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:11.930 17:45:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:11.930 17:45:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:11.930 17:45:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:11.931 17:45:49 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:11.931 17:45:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:11.931 17:45:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:11.931 17:45:49 -- common/autotest_common.sh@10 -- # set +x 00:26:11.931 17:45:49 -- nvmf/common.sh@469 -- # nvmfpid=1671943 00:26:11.931 17:45:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:11.931 17:45:49 -- nvmf/common.sh@470 -- # waitforlisten 1671943 00:26:11.931 17:45:49 -- common/autotest_common.sh@829 -- # '[' -z 1671943 ']' 00:26:11.931 17:45:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:11.931 17:45:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:11.931 17:45:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:11.931 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:11.931 17:45:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:11.931 17:45:49 -- common/autotest_common.sh@10 -- # set +x 00:26:11.931 [2024-11-16 17:45:49.225933] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:11.931 [2024-11-16 17:45:49.225999] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:11.931 EAL: No free 2048 kB hugepages reported on node 1 00:26:11.931 [2024-11-16 17:45:49.297856] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:11.931 [2024-11-16 17:45:49.389574] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:11.931 [2024-11-16 17:45:49.389739] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:11.931 [2024-11-16 17:45:49.389757] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:11.931 [2024-11-16 17:45:49.389771] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:11.931 [2024-11-16 17:45:49.389832] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:11.931 [2024-11-16 17:45:49.389861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:11.931 [2024-11-16 17:45:49.389917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:11.931 [2024-11-16 17:45:49.389919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:12.865 17:45:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:12.865 17:45:50 -- common/autotest_common.sh@862 -- # return 0 00:26:12.865 17:45:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:12.865 17:45:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:12.865 17:45:50 -- common/autotest_common.sh@10 -- # set +x 00:26:12.865 17:45:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:12.865 17:45:50 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:12.865 17:45:50 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:16.153 17:45:53 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:16.153 17:45:53 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:16.153 17:45:53 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:16.153 17:45:53 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:16.722 17:45:53 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:16.722 17:45:53 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:16.722 17:45:53 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:16.722 17:45:53 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:16.722 17:45:53 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:16.722 [2024-11-16 17:45:54.143529] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:16.722 17:45:54 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:16.980 17:45:54 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:16.980 17:45:54 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:17.257 17:45:54 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:17.257 17:45:54 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:17.515 17:45:54 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:17.773 [2024-11-16 17:45:55.167451] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:17.773 17:45:55 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:18.033 17:45:55 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:18.033 17:45:55 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:18.033 17:45:55 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:18.033 17:45:55 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:19.411 Initializing NVMe Controllers 00:26:19.411 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:19.411 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:19.411 Initialization complete. Launching workers. 00:26:19.411 ======================================================== 00:26:19.411 Latency(us) 00:26:19.411 Device Information : IOPS MiB/s Average min max 00:26:19.411 PCIE (0000:88:00.0) NSID 1 from core 0: 86310.25 337.15 370.07 32.47 6276.43 00:26:19.411 ======================================================== 00:26:19.411 Total : 86310.25 337.15 370.07 32.47 6276.43 00:26:19.411 00:26:19.411 17:45:56 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:19.411 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.785 Initializing NVMe Controllers 00:26:20.785 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:20.785 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:20.785 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:20.785 Initialization complete. Launching workers. 00:26:20.785 ======================================================== 00:26:20.785 Latency(us) 00:26:20.785 Device Information : IOPS MiB/s Average min max 00:26:20.785 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 88.69 0.35 11466.57 135.74 44782.74 00:26:20.785 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 46.84 0.18 21520.40 5404.47 48301.06 00:26:20.785 ======================================================== 00:26:20.785 Total : 135.53 0.53 14941.05 135.74 48301.06 00:26:20.785 00:26:20.785 17:45:58 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:20.785 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.164 Initializing NVMe Controllers 00:26:22.164 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:22.164 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:22.164 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:22.164 Initialization complete. Launching workers. 00:26:22.164 ======================================================== 00:26:22.164 Latency(us) 00:26:22.164 Device Information : IOPS MiB/s Average min max 00:26:22.164 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8546.52 33.38 3747.60 563.17 11069.32 00:26:22.164 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3803.56 14.86 8469.75 5675.20 18564.05 00:26:22.164 ======================================================== 00:26:22.164 Total : 12350.08 48.24 5201.92 563.17 18564.05 00:26:22.164 00:26:22.164 17:45:59 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:22.164 17:45:59 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:22.164 17:45:59 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:22.164 EAL: No free 2048 kB hugepages reported on node 1 00:26:24.700 Initializing NVMe Controllers 00:26:24.700 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:24.700 Controller IO queue size 128, less than required. 00:26:24.700 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:24.700 Controller IO queue size 128, less than required. 00:26:24.700 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:24.700 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:24.700 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:24.700 Initialization complete. Launching workers. 00:26:24.700 ======================================================== 00:26:24.700 Latency(us) 00:26:24.700 Device Information : IOPS MiB/s Average min max 00:26:24.700 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1702.33 425.58 76615.17 49521.05 136338.34 00:26:24.700 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 570.44 142.61 234498.06 71491.81 374147.40 00:26:24.700 ======================================================== 00:26:24.700 Total : 2272.78 568.19 116242.18 49521.05 374147.40 00:26:24.700 00:26:24.700 17:46:01 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:24.700 EAL: No free 2048 kB hugepages reported on node 1 00:26:24.960 No valid NVMe controllers or AIO or URING devices found 00:26:24.960 Initializing NVMe Controllers 00:26:24.960 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:24.960 Controller IO queue size 128, less than required. 00:26:24.960 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:24.960 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:24.960 Controller IO queue size 128, less than required. 00:26:24.960 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:24.960 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:24.960 WARNING: Some requested NVMe devices were skipped 00:26:24.960 17:46:02 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:24.960 EAL: No free 2048 kB hugepages reported on node 1 00:26:27.500 Initializing NVMe Controllers 00:26:27.500 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:27.500 Controller IO queue size 128, less than required. 00:26:27.500 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:27.500 Controller IO queue size 128, less than required. 00:26:27.500 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:27.500 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:27.500 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:27.500 Initialization complete. Launching workers. 00:26:27.500 00:26:27.500 ==================== 00:26:27.500 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:27.500 TCP transport: 00:26:27.500 polls: 11202 00:26:27.500 idle_polls: 8660 00:26:27.500 sock_completions: 2542 00:26:27.500 nvme_completions: 4893 00:26:27.500 submitted_requests: 7479 00:26:27.500 queued_requests: 1 00:26:27.500 00:26:27.500 ==================== 00:26:27.500 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:27.500 TCP transport: 00:26:27.500 polls: 11707 00:26:27.500 idle_polls: 8461 00:26:27.500 sock_completions: 3246 00:26:27.500 nvme_completions: 5492 00:26:27.500 submitted_requests: 8299 00:26:27.500 queued_requests: 1 00:26:27.500 ======================================================== 00:26:27.500 Latency(us) 00:26:27.500 Device Information : IOPS MiB/s Average min max 00:26:27.500 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1285.59 321.40 101093.72 59990.09 162984.75 00:26:27.500 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1435.48 358.87 91100.01 51124.94 136455.63 00:26:27.500 ======================================================== 00:26:27.500 Total : 2721.07 680.27 95821.60 51124.94 162984.75 00:26:27.500 00:26:27.500 17:46:04 -- host/perf.sh@66 -- # sync 00:26:27.500 17:46:04 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:27.759 17:46:05 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:27.759 17:46:05 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:27.759 17:46:05 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:31.050 17:46:08 -- host/perf.sh@72 -- # ls_guid=64b3ea41-8a24-41b5-977a-95edefe96885 00:26:31.050 17:46:08 -- host/perf.sh@73 -- # get_lvs_free_mb 64b3ea41-8a24-41b5-977a-95edefe96885 00:26:31.050 17:46:08 -- common/autotest_common.sh@1353 -- # local lvs_uuid=64b3ea41-8a24-41b5-977a-95edefe96885 00:26:31.050 17:46:08 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:31.050 17:46:08 -- common/autotest_common.sh@1355 -- # local fc 00:26:31.050 17:46:08 -- common/autotest_common.sh@1356 -- # local cs 00:26:31.050 17:46:08 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:31.309 17:46:08 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:31.309 { 00:26:31.309 "uuid": "64b3ea41-8a24-41b5-977a-95edefe96885", 00:26:31.309 "name": "lvs_0", 00:26:31.309 "base_bdev": "Nvme0n1", 00:26:31.309 "total_data_clusters": 238234, 00:26:31.309 "free_clusters": 238234, 00:26:31.309 "block_size": 512, 00:26:31.309 "cluster_size": 4194304 00:26:31.309 } 00:26:31.309 ]' 00:26:31.309 17:46:08 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="64b3ea41-8a24-41b5-977a-95edefe96885") .free_clusters' 00:26:31.309 17:46:08 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:31.309 17:46:08 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="64b3ea41-8a24-41b5-977a-95edefe96885") .cluster_size' 00:26:31.309 17:46:08 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:31.309 17:46:08 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:31.309 17:46:08 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:31.309 952936 00:26:31.309 17:46:08 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:31.309 17:46:08 -- host/perf.sh@78 -- # free_mb=20480 00:26:31.309 17:46:08 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 64b3ea41-8a24-41b5-977a-95edefe96885 lbd_0 20480 00:26:31.568 17:46:09 -- host/perf.sh@80 -- # lb_guid=1c5fe67e-c5ab-40eb-a00a-c97911391559 00:26:31.568 17:46:09 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 1c5fe67e-c5ab-40eb-a00a-c97911391559 lvs_n_0 00:26:32.505 17:46:09 -- host/perf.sh@83 -- # ls_nested_guid=b9c2699a-569e-40f8-b07c-eb5ec663e513 00:26:32.505 17:46:09 -- host/perf.sh@84 -- # get_lvs_free_mb b9c2699a-569e-40f8-b07c-eb5ec663e513 00:26:32.505 17:46:09 -- common/autotest_common.sh@1353 -- # local lvs_uuid=b9c2699a-569e-40f8-b07c-eb5ec663e513 00:26:32.505 17:46:09 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:32.505 17:46:09 -- common/autotest_common.sh@1355 -- # local fc 00:26:32.505 17:46:09 -- common/autotest_common.sh@1356 -- # local cs 00:26:32.505 17:46:09 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:32.764 17:46:10 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:32.764 { 00:26:32.764 "uuid": "64b3ea41-8a24-41b5-977a-95edefe96885", 00:26:32.764 "name": "lvs_0", 00:26:32.764 "base_bdev": "Nvme0n1", 00:26:32.764 "total_data_clusters": 238234, 00:26:32.764 "free_clusters": 233114, 00:26:32.764 "block_size": 512, 00:26:32.764 "cluster_size": 4194304 00:26:32.764 }, 00:26:32.764 { 00:26:32.764 "uuid": "b9c2699a-569e-40f8-b07c-eb5ec663e513", 00:26:32.764 "name": "lvs_n_0", 00:26:32.764 "base_bdev": "1c5fe67e-c5ab-40eb-a00a-c97911391559", 00:26:32.764 "total_data_clusters": 5114, 00:26:32.764 "free_clusters": 5114, 00:26:32.764 "block_size": 512, 00:26:32.764 "cluster_size": 4194304 00:26:32.764 } 00:26:32.764 ]' 00:26:32.764 17:46:10 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="b9c2699a-569e-40f8-b07c-eb5ec663e513") .free_clusters' 00:26:32.764 17:46:10 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:32.764 17:46:10 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="b9c2699a-569e-40f8-b07c-eb5ec663e513") .cluster_size' 00:26:33.023 17:46:10 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:33.023 17:46:10 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:33.023 17:46:10 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:33.023 20456 00:26:33.023 17:46:10 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:33.023 17:46:10 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b9c2699a-569e-40f8-b07c-eb5ec663e513 lbd_nest_0 20456 00:26:33.281 17:46:10 -- host/perf.sh@88 -- # lb_nested_guid=306a87b7-0a56-44b1-9304-6e2d7f871a8d 00:26:33.281 17:46:10 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:33.539 17:46:10 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:33.539 17:46:10 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 306a87b7-0a56-44b1-9304-6e2d7f871a8d 00:26:33.799 17:46:11 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:34.060 17:46:11 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:34.060 17:46:11 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:34.060 17:46:11 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:34.060 17:46:11 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:34.060 17:46:11 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:34.060 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.279 Initializing NVMe Controllers 00:26:46.279 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:46.279 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:46.279 Initialization complete. Launching workers. 00:26:46.279 ======================================================== 00:26:46.279 Latency(us) 00:26:46.279 Device Information : IOPS MiB/s Average min max 00:26:46.279 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.39 0.02 21588.85 165.42 45000.80 00:26:46.279 ======================================================== 00:26:46.279 Total : 46.39 0.02 21588.85 165.42 45000.80 00:26:46.279 00:26:46.279 17:46:21 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:46.279 17:46:21 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:46.279 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.342 Initializing NVMe Controllers 00:26:56.342 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:56.342 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:56.342 Initialization complete. Launching workers. 00:26:56.342 ======================================================== 00:26:56.342 Latency(us) 00:26:56.342 Device Information : IOPS MiB/s Average min max 00:26:56.342 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 65.10 8.14 15373.46 5030.75 54897.67 00:26:56.342 ======================================================== 00:26:56.342 Total : 65.10 8.14 15373.46 5030.75 54897.67 00:26:56.342 00:26:56.342 17:46:32 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:56.342 17:46:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:56.342 17:46:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:56.342 EAL: No free 2048 kB hugepages reported on node 1 00:27:06.325 Initializing NVMe Controllers 00:27:06.325 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:06.325 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:06.325 Initialization complete. Launching workers. 00:27:06.325 ======================================================== 00:27:06.325 Latency(us) 00:27:06.325 Device Information : IOPS MiB/s Average min max 00:27:06.325 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7838.76 3.83 4081.94 317.09 10745.53 00:27:06.325 ======================================================== 00:27:06.325 Total : 7838.76 3.83 4081.94 317.09 10745.53 00:27:06.325 00:27:06.325 17:46:42 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:06.325 17:46:42 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:06.325 EAL: No free 2048 kB hugepages reported on node 1 00:27:16.313 Initializing NVMe Controllers 00:27:16.313 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:16.313 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:16.313 Initialization complete. Launching workers. 00:27:16.313 ======================================================== 00:27:16.313 Latency(us) 00:27:16.313 Device Information : IOPS MiB/s Average min max 00:27:16.313 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4010.39 501.30 7982.65 708.66 17284.67 00:27:16.313 ======================================================== 00:27:16.313 Total : 4010.39 501.30 7982.65 708.66 17284.67 00:27:16.313 00:27:16.313 17:46:52 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:16.313 17:46:52 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:16.313 17:46:52 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:16.313 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.295 Initializing NVMe Controllers 00:27:26.295 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:26.295 Controller IO queue size 128, less than required. 00:27:26.295 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:26.295 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:26.295 Initialization complete. Launching workers. 00:27:26.295 ======================================================== 00:27:26.295 Latency(us) 00:27:26.295 Device Information : IOPS MiB/s Average min max 00:27:26.295 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12035.40 5.88 10639.78 1764.28 25244.00 00:27:26.295 ======================================================== 00:27:26.295 Total : 12035.40 5.88 10639.78 1764.28 25244.00 00:27:26.295 00:27:26.295 17:47:03 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:26.295 17:47:03 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:26.295 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.284 Initializing NVMe Controllers 00:27:36.284 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:36.284 Controller IO queue size 128, less than required. 00:27:36.284 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:36.284 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:36.284 Initialization complete. Launching workers. 00:27:36.284 ======================================================== 00:27:36.285 Latency(us) 00:27:36.285 Device Information : IOPS MiB/s Average min max 00:27:36.285 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1179.77 147.47 109061.52 15743.30 222729.33 00:27:36.285 ======================================================== 00:27:36.285 Total : 1179.77 147.47 109061.52 15743.30 222729.33 00:27:36.285 00:27:36.285 17:47:13 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:36.543 17:47:13 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 306a87b7-0a56-44b1-9304-6e2d7f871a8d 00:27:37.479 17:47:14 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:37.479 17:47:14 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 1c5fe67e-c5ab-40eb-a00a-c97911391559 00:27:38.046 17:47:15 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:38.046 17:47:15 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:38.046 17:47:15 -- host/perf.sh@114 -- # nvmftestfini 00:27:38.046 17:47:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:38.046 17:47:15 -- nvmf/common.sh@116 -- # sync 00:27:38.046 17:47:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:38.046 17:47:15 -- nvmf/common.sh@119 -- # set +e 00:27:38.046 17:47:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:38.046 17:47:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:38.046 rmmod nvme_tcp 00:27:38.307 rmmod nvme_fabrics 00:27:38.307 rmmod nvme_keyring 00:27:38.307 17:47:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:38.307 17:47:15 -- nvmf/common.sh@123 -- # set -e 00:27:38.307 17:47:15 -- nvmf/common.sh@124 -- # return 0 00:27:38.307 17:47:15 -- nvmf/common.sh@477 -- # '[' -n 1671943 ']' 00:27:38.307 17:47:15 -- nvmf/common.sh@478 -- # killprocess 1671943 00:27:38.307 17:47:15 -- common/autotest_common.sh@936 -- # '[' -z 1671943 ']' 00:27:38.307 17:47:15 -- common/autotest_common.sh@940 -- # kill -0 1671943 00:27:38.307 17:47:15 -- common/autotest_common.sh@941 -- # uname 00:27:38.307 17:47:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:38.307 17:47:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1671943 00:27:38.307 17:47:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:38.307 17:47:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:38.307 17:47:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1671943' 00:27:38.307 killing process with pid 1671943 00:27:38.307 17:47:15 -- common/autotest_common.sh@955 -- # kill 1671943 00:27:38.307 17:47:15 -- common/autotest_common.sh@960 -- # wait 1671943 00:27:40.213 17:47:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:40.213 17:47:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:40.213 17:47:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:40.213 17:47:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:40.213 17:47:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:40.213 17:47:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:40.213 17:47:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:40.213 17:47:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:42.120 17:47:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:42.120 00:27:42.120 real 1m32.365s 00:27:42.120 user 5m37.904s 00:27:42.120 sys 0m16.983s 00:27:42.120 17:47:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:42.120 17:47:19 -- common/autotest_common.sh@10 -- # set +x 00:27:42.120 ************************************ 00:27:42.120 END TEST nvmf_perf 00:27:42.120 ************************************ 00:27:42.120 17:47:19 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:42.120 17:47:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:42.120 17:47:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:42.120 17:47:19 -- common/autotest_common.sh@10 -- # set +x 00:27:42.120 ************************************ 00:27:42.120 START TEST nvmf_fio_host 00:27:42.120 ************************************ 00:27:42.120 17:47:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:42.120 * Looking for test storage... 00:27:42.120 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:42.120 17:47:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:42.120 17:47:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:42.120 17:47:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:42.120 17:47:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:42.120 17:47:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:42.120 17:47:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:42.120 17:47:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:42.120 17:47:19 -- scripts/common.sh@335 -- # IFS=.-: 00:27:42.120 17:47:19 -- scripts/common.sh@335 -- # read -ra ver1 00:27:42.121 17:47:19 -- scripts/common.sh@336 -- # IFS=.-: 00:27:42.121 17:47:19 -- scripts/common.sh@336 -- # read -ra ver2 00:27:42.121 17:47:19 -- scripts/common.sh@337 -- # local 'op=<' 00:27:42.121 17:47:19 -- scripts/common.sh@339 -- # ver1_l=2 00:27:42.121 17:47:19 -- scripts/common.sh@340 -- # ver2_l=1 00:27:42.121 17:47:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:42.121 17:47:19 -- scripts/common.sh@343 -- # case "$op" in 00:27:42.121 17:47:19 -- scripts/common.sh@344 -- # : 1 00:27:42.121 17:47:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:42.121 17:47:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:42.121 17:47:19 -- scripts/common.sh@364 -- # decimal 1 00:27:42.121 17:47:19 -- scripts/common.sh@352 -- # local d=1 00:27:42.121 17:47:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:42.121 17:47:19 -- scripts/common.sh@354 -- # echo 1 00:27:42.121 17:47:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:42.121 17:47:19 -- scripts/common.sh@365 -- # decimal 2 00:27:42.121 17:47:19 -- scripts/common.sh@352 -- # local d=2 00:27:42.121 17:47:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:42.121 17:47:19 -- scripts/common.sh@354 -- # echo 2 00:27:42.121 17:47:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:42.121 17:47:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:42.121 17:47:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:42.121 17:47:19 -- scripts/common.sh@367 -- # return 0 00:27:42.121 17:47:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:42.121 17:47:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:42.121 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:42.121 --rc genhtml_branch_coverage=1 00:27:42.121 --rc genhtml_function_coverage=1 00:27:42.121 --rc genhtml_legend=1 00:27:42.121 --rc geninfo_all_blocks=1 00:27:42.121 --rc geninfo_unexecuted_blocks=1 00:27:42.121 00:27:42.121 ' 00:27:42.121 17:47:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:42.121 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:42.121 --rc genhtml_branch_coverage=1 00:27:42.121 --rc genhtml_function_coverage=1 00:27:42.121 --rc genhtml_legend=1 00:27:42.121 --rc geninfo_all_blocks=1 00:27:42.121 --rc geninfo_unexecuted_blocks=1 00:27:42.121 00:27:42.121 ' 00:27:42.121 17:47:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:42.121 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:42.121 --rc genhtml_branch_coverage=1 00:27:42.121 --rc genhtml_function_coverage=1 00:27:42.121 --rc genhtml_legend=1 00:27:42.121 --rc geninfo_all_blocks=1 00:27:42.121 --rc geninfo_unexecuted_blocks=1 00:27:42.121 00:27:42.121 ' 00:27:42.121 17:47:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:42.121 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:42.121 --rc genhtml_branch_coverage=1 00:27:42.121 --rc genhtml_function_coverage=1 00:27:42.121 --rc genhtml_legend=1 00:27:42.121 --rc geninfo_all_blocks=1 00:27:42.121 --rc geninfo_unexecuted_blocks=1 00:27:42.121 00:27:42.121 ' 00:27:42.121 17:47:19 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:42.121 17:47:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:42.121 17:47:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:42.121 17:47:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:42.121 17:47:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.121 17:47:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.121 17:47:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.121 17:47:19 -- paths/export.sh@5 -- # export PATH 00:27:42.121 17:47:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.121 17:47:19 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:42.121 17:47:19 -- nvmf/common.sh@7 -- # uname -s 00:27:42.121 17:47:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:42.121 17:47:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:42.121 17:47:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:42.121 17:47:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:42.121 17:47:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:42.121 17:47:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:42.121 17:47:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:42.121 17:47:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:42.121 17:47:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:42.121 17:47:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:42.121 17:47:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:42.121 17:47:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:42.121 17:47:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:42.121 17:47:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:42.121 17:47:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:42.121 17:47:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:42.121 17:47:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:42.121 17:47:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:42.121 17:47:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:42.121 17:47:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.121 17:47:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.121 17:47:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.121 17:47:19 -- paths/export.sh@5 -- # export PATH 00:27:42.121 17:47:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:42.121 17:47:19 -- nvmf/common.sh@46 -- # : 0 00:27:42.121 17:47:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:42.121 17:47:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:42.121 17:47:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:42.121 17:47:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:42.121 17:47:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:42.121 17:47:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:42.121 17:47:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:42.121 17:47:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:42.121 17:47:19 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:42.121 17:47:19 -- host/fio.sh@14 -- # nvmftestinit 00:27:42.121 17:47:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:42.121 17:47:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:42.122 17:47:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:42.122 17:47:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:42.122 17:47:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:42.122 17:47:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:42.122 17:47:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:42.122 17:47:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:42.122 17:47:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:42.122 17:47:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:42.122 17:47:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:42.122 17:47:19 -- common/autotest_common.sh@10 -- # set +x 00:27:44.024 17:47:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:44.024 17:47:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:44.024 17:47:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:44.024 17:47:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:44.024 17:47:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:44.024 17:47:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:44.024 17:47:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:44.024 17:47:21 -- nvmf/common.sh@294 -- # net_devs=() 00:27:44.024 17:47:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:44.024 17:47:21 -- nvmf/common.sh@295 -- # e810=() 00:27:44.024 17:47:21 -- nvmf/common.sh@295 -- # local -ga e810 00:27:44.024 17:47:21 -- nvmf/common.sh@296 -- # x722=() 00:27:44.024 17:47:21 -- nvmf/common.sh@296 -- # local -ga x722 00:27:44.024 17:47:21 -- nvmf/common.sh@297 -- # mlx=() 00:27:44.024 17:47:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:44.024 17:47:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:44.024 17:47:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:44.024 17:47:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:44.024 17:47:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:44.024 17:47:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:44.024 17:47:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:44.024 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:44.024 17:47:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:44.024 17:47:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:44.024 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:44.024 17:47:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:44.024 17:47:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:44.024 17:47:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:44.024 17:47:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:44.024 17:47:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:44.024 17:47:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:44.024 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:44.024 17:47:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:44.024 17:47:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:44.024 17:47:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:44.024 17:47:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:44.024 17:47:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:44.024 17:47:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:44.024 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:44.024 17:47:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:44.024 17:47:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:44.024 17:47:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:44.024 17:47:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:44.024 17:47:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:44.024 17:47:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:44.024 17:47:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:44.024 17:47:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:44.024 17:47:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:44.024 17:47:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:44.024 17:47:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:44.024 17:47:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:44.024 17:47:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:44.024 17:47:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:44.024 17:47:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:44.024 17:47:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:44.024 17:47:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:44.024 17:47:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:44.283 17:47:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:44.283 17:47:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:44.283 17:47:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:44.283 17:47:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:44.283 17:47:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:44.283 17:47:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:44.283 17:47:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:44.283 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:44.283 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:27:44.283 00:27:44.283 --- 10.0.0.2 ping statistics --- 00:27:44.283 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:44.283 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:27:44.283 17:47:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:44.283 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:44.283 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:27:44.283 00:27:44.283 --- 10.0.0.1 ping statistics --- 00:27:44.283 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:44.283 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:27:44.283 17:47:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:44.283 17:47:21 -- nvmf/common.sh@410 -- # return 0 00:27:44.283 17:47:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:44.283 17:47:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:44.283 17:47:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:44.283 17:47:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:44.283 17:47:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:44.283 17:47:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:44.283 17:47:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:44.283 17:47:21 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:44.283 17:47:21 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:44.283 17:47:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:44.283 17:47:21 -- common/autotest_common.sh@10 -- # set +x 00:27:44.283 17:47:21 -- host/fio.sh@24 -- # nvmfpid=1684433 00:27:44.283 17:47:21 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:44.283 17:47:21 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:44.283 17:47:21 -- host/fio.sh@28 -- # waitforlisten 1684433 00:27:44.283 17:47:21 -- common/autotest_common.sh@829 -- # '[' -z 1684433 ']' 00:27:44.283 17:47:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:44.283 17:47:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:44.283 17:47:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:44.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:44.283 17:47:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:44.283 17:47:21 -- common/autotest_common.sh@10 -- # set +x 00:27:44.283 [2024-11-16 17:47:21.675979] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:44.283 [2024-11-16 17:47:21.676053] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:44.283 EAL: No free 2048 kB hugepages reported on node 1 00:27:44.283 [2024-11-16 17:47:21.740101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:44.542 [2024-11-16 17:47:21.824447] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:44.542 [2024-11-16 17:47:21.824624] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:44.542 [2024-11-16 17:47:21.824643] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:44.542 [2024-11-16 17:47:21.824657] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:44.542 [2024-11-16 17:47:21.824778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:44.542 [2024-11-16 17:47:21.824833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:44.542 [2024-11-16 17:47:21.824883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:44.542 [2024-11-16 17:47:21.824886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:45.476 17:47:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:45.476 17:47:22 -- common/autotest_common.sh@862 -- # return 0 00:27:45.476 17:47:22 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:45.476 [2024-11-16 17:47:22.869988] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:45.476 17:47:22 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:45.476 17:47:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:45.476 17:47:22 -- common/autotest_common.sh@10 -- # set +x 00:27:45.476 17:47:22 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:45.734 Malloc1 00:27:45.734 17:47:23 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:45.992 17:47:23 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:46.251 17:47:23 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:46.509 [2024-11-16 17:47:23.928894] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:46.509 17:47:23 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:46.768 17:47:24 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:46.768 17:47:24 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:46.768 17:47:24 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:46.768 17:47:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:46.768 17:47:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:46.768 17:47:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:46.768 17:47:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.768 17:47:24 -- common/autotest_common.sh@1330 -- # shift 00:27:46.768 17:47:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:46.768 17:47:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:46.768 17:47:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.768 17:47:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:46.768 17:47:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:46.768 17:47:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:46.768 17:47:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:46.768 17:47:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:46.768 17:47:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:46.768 17:47:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:46.768 17:47:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:46.768 17:47:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:46.768 17:47:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:46.768 17:47:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:46.768 17:47:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:47.027 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:47.027 fio-3.35 00:27:47.027 Starting 1 thread 00:27:47.027 EAL: No free 2048 kB hugepages reported on node 1 00:27:49.559 00:27:49.559 test: (groupid=0, jobs=1): err= 0: pid=1684933: Sat Nov 16 17:47:26 2024 00:27:49.559 read: IOPS=9612, BW=37.5MiB/s (39.4MB/s)(75.3MiB/2006msec) 00:27:49.559 slat (nsec): min=1861, max=158591, avg=2428.30, stdev=1735.38 00:27:49.559 clat (usec): min=2424, max=12745, avg=7327.95, stdev=575.48 00:27:49.559 lat (usec): min=2441, max=12748, avg=7330.37, stdev=575.38 00:27:49.559 clat percentiles (usec): 00:27:49.559 | 1.00th=[ 5932], 5.00th=[ 6456], 10.00th=[ 6652], 20.00th=[ 6849], 00:27:49.559 | 30.00th=[ 7046], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7439], 00:27:49.559 | 70.00th=[ 7635], 80.00th=[ 7767], 90.00th=[ 8029], 95.00th=[ 8225], 00:27:49.559 | 99.00th=[ 8586], 99.50th=[ 8717], 99.90th=[10552], 99.95th=[11994], 00:27:49.559 | 99.99th=[12649] 00:27:49.559 bw ( KiB/s): min=37128, max=39104, per=99.90%, avg=38412.00, stdev=889.46, samples=4 00:27:49.559 iops : min= 9282, max= 9776, avg=9603.00, stdev=222.37, samples=4 00:27:49.559 write: IOPS=9613, BW=37.6MiB/s (39.4MB/s)(75.3MiB/2006msec); 0 zone resets 00:27:49.559 slat (nsec): min=1961, max=128643, avg=2534.74, stdev=1524.50 00:27:49.559 clat (usec): min=1274, max=11317, avg=5927.39, stdev=478.61 00:27:49.559 lat (usec): min=1298, max=11320, avg=5929.93, stdev=478.56 00:27:49.559 clat percentiles (usec): 00:27:49.559 | 1.00th=[ 4817], 5.00th=[ 5211], 10.00th=[ 5342], 20.00th=[ 5538], 00:27:49.559 | 30.00th=[ 5735], 40.00th=[ 5800], 50.00th=[ 5932], 60.00th=[ 6063], 00:27:49.559 | 70.00th=[ 6128], 80.00th=[ 6259], 90.00th=[ 6456], 95.00th=[ 6652], 00:27:49.559 | 99.00th=[ 6980], 99.50th=[ 7111], 99.90th=[ 9110], 99.95th=[10290], 00:27:49.559 | 99.99th=[11207] 00:27:49.559 bw ( KiB/s): min=37968, max=38976, per=100.00%, avg=38468.00, stdev=424.60, samples=4 00:27:49.559 iops : min= 9492, max= 9744, avg=9617.00, stdev=106.15, samples=4 00:27:49.559 lat (msec) : 2=0.03%, 4=0.11%, 10=99.75%, 20=0.12% 00:27:49.559 cpu : usr=66.38%, sys=31.72%, ctx=88, majf=0, minf=41 00:27:49.559 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:49.559 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:49.559 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:49.559 issued rwts: total=19282,19285,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:49.559 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:49.559 00:27:49.559 Run status group 0 (all jobs): 00:27:49.559 READ: bw=37.5MiB/s (39.4MB/s), 37.5MiB/s-37.5MiB/s (39.4MB/s-39.4MB/s), io=75.3MiB (79.0MB), run=2006-2006msec 00:27:49.559 WRITE: bw=37.6MiB/s (39.4MB/s), 37.6MiB/s-37.6MiB/s (39.4MB/s-39.4MB/s), io=75.3MiB (79.0MB), run=2006-2006msec 00:27:49.559 17:47:26 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:49.559 17:47:26 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:49.559 17:47:26 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:49.559 17:47:26 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:49.559 17:47:26 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:49.559 17:47:26 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:49.559 17:47:26 -- common/autotest_common.sh@1330 -- # shift 00:27:49.559 17:47:26 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:49.559 17:47:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:49.559 17:47:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:49.559 17:47:26 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:49.559 17:47:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:49.559 17:47:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:49.559 17:47:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:49.559 17:47:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:49.559 17:47:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:49.559 17:47:26 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:49.559 17:47:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:49.559 17:47:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:49.559 17:47:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:49.559 17:47:26 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:49.559 17:47:26 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:49.559 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:49.559 fio-3.35 00:27:49.559 Starting 1 thread 00:27:49.559 EAL: No free 2048 kB hugepages reported on node 1 00:27:52.090 00:27:52.090 test: (groupid=0, jobs=1): err= 0: pid=1685287: Sat Nov 16 17:47:29 2024 00:27:52.090 read: IOPS=8320, BW=130MiB/s (136MB/s)(261MiB/2011msec) 00:27:52.090 slat (usec): min=2, max=106, avg= 3.60, stdev= 1.77 00:27:52.090 clat (usec): min=2262, max=17336, avg=8650.13, stdev=1930.19 00:27:52.090 lat (usec): min=2265, max=17340, avg=8653.73, stdev=1930.26 00:27:52.090 clat percentiles (usec): 00:27:52.090 | 1.00th=[ 4490], 5.00th=[ 5604], 10.00th=[ 6194], 20.00th=[ 6980], 00:27:52.090 | 30.00th=[ 7570], 40.00th=[ 8094], 50.00th=[ 8586], 60.00th=[ 9241], 00:27:52.090 | 70.00th=[ 9634], 80.00th=[10159], 90.00th=[10945], 95.00th=[11731], 00:27:52.090 | 99.00th=[13698], 99.50th=[14746], 99.90th=[16581], 99.95th=[16909], 00:27:52.090 | 99.99th=[17433] 00:27:52.090 bw ( KiB/s): min=63072, max=80544, per=52.76%, avg=70240.00, stdev=7725.69, samples=4 00:27:52.090 iops : min= 3942, max= 5034, avg=4390.00, stdev=482.86, samples=4 00:27:52.090 write: IOPS=5072, BW=79.3MiB/s (83.1MB/s)(143MiB/1810msec); 0 zone resets 00:27:52.090 slat (usec): min=30, max=127, avg=33.42, stdev= 4.97 00:27:52.090 clat (usec): min=3640, max=21696, avg=11576.34, stdev=2423.55 00:27:52.090 lat (usec): min=3673, max=21728, avg=11609.75, stdev=2424.13 00:27:52.090 clat percentiles (usec): 00:27:52.090 | 1.00th=[ 6980], 5.00th=[ 8029], 10.00th=[ 8717], 20.00th=[ 9503], 00:27:52.090 | 30.00th=[10028], 40.00th=[10552], 50.00th=[11207], 60.00th=[11994], 00:27:52.090 | 70.00th=[12911], 80.00th=[13829], 90.00th=[14877], 95.00th=[15533], 00:27:52.090 | 99.00th=[17433], 99.50th=[18220], 99.90th=[20317], 99.95th=[20317], 00:27:52.090 | 99.99th=[21627] 00:27:52.090 bw ( KiB/s): min=66944, max=83072, per=89.92%, avg=72976.00, stdev=7400.12, samples=4 00:27:52.090 iops : min= 4184, max= 5192, avg=4561.00, stdev=462.51, samples=4 00:27:52.090 lat (msec) : 4=0.27%, 10=59.95%, 20=39.70%, 50=0.07% 00:27:52.090 cpu : usr=76.52%, sys=21.99%, ctx=45, majf=0, minf=67 00:27:52.090 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:27:52.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:52.090 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:52.090 issued rwts: total=16733,9181,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:52.090 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:52.090 00:27:52.090 Run status group 0 (all jobs): 00:27:52.090 READ: bw=130MiB/s (136MB/s), 130MiB/s-130MiB/s (136MB/s-136MB/s), io=261MiB (274MB), run=2011-2011msec 00:27:52.090 WRITE: bw=79.3MiB/s (83.1MB/s), 79.3MiB/s-79.3MiB/s (83.1MB/s-83.1MB/s), io=143MiB (150MB), run=1810-1810msec 00:27:52.090 17:47:29 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:52.349 17:47:29 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:52.349 17:47:29 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:52.349 17:47:29 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:52.349 17:47:29 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:52.349 17:47:29 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:52.349 17:47:29 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:52.349 17:47:29 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:52.349 17:47:29 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:52.349 17:47:29 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:52.349 17:47:29 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:52.349 17:47:29 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:55.687 Nvme0n1 00:27:55.687 17:47:32 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:58.220 17:47:35 -- host/fio.sh@53 -- # ls_guid=26ee9237-c5be-4a93-892f-a8956883420b 00:27:58.220 17:47:35 -- host/fio.sh@54 -- # get_lvs_free_mb 26ee9237-c5be-4a93-892f-a8956883420b 00:27:58.220 17:47:35 -- common/autotest_common.sh@1353 -- # local lvs_uuid=26ee9237-c5be-4a93-892f-a8956883420b 00:27:58.220 17:47:35 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:58.220 17:47:35 -- common/autotest_common.sh@1355 -- # local fc 00:27:58.220 17:47:35 -- common/autotest_common.sh@1356 -- # local cs 00:27:58.220 17:47:35 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:58.478 17:47:35 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:58.478 { 00:27:58.478 "uuid": "26ee9237-c5be-4a93-892f-a8956883420b", 00:27:58.478 "name": "lvs_0", 00:27:58.478 "base_bdev": "Nvme0n1", 00:27:58.478 "total_data_clusters": 930, 00:27:58.478 "free_clusters": 930, 00:27:58.478 "block_size": 512, 00:27:58.478 "cluster_size": 1073741824 00:27:58.478 } 00:27:58.478 ]' 00:27:58.479 17:47:35 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="26ee9237-c5be-4a93-892f-a8956883420b") .free_clusters' 00:27:58.479 17:47:35 -- common/autotest_common.sh@1358 -- # fc=930 00:27:58.479 17:47:35 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="26ee9237-c5be-4a93-892f-a8956883420b") .cluster_size' 00:27:58.736 17:47:35 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:58.736 17:47:35 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:58.736 17:47:35 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:58.736 952320 00:27:58.736 17:47:35 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:58.994 5984c900-f876-48c1-bfab-232b3463e5a9 00:27:58.994 17:47:36 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:59.253 17:47:36 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:59.511 17:47:36 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:59.769 17:47:37 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:59.769 17:47:37 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:59.769 17:47:37 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:59.769 17:47:37 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:59.769 17:47:37 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:59.769 17:47:37 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.769 17:47:37 -- common/autotest_common.sh@1330 -- # shift 00:27:59.769 17:47:37 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:59.769 17:47:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:59.769 17:47:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.769 17:47:37 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:59.769 17:47:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:59.769 17:47:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:59.769 17:47:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:59.769 17:47:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:59.769 17:47:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:59.769 17:47:37 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:59.769 17:47:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:59.769 17:47:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:59.769 17:47:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:59.769 17:47:37 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:59.769 17:47:37 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:00.028 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:00.028 fio-3.35 00:28:00.028 Starting 1 thread 00:28:00.028 EAL: No free 2048 kB hugepages reported on node 1 00:28:02.566 00:28:02.566 test: (groupid=0, jobs=1): err= 0: pid=1686610: Sat Nov 16 17:47:39 2024 00:28:02.566 read: IOPS=6415, BW=25.1MiB/s (26.3MB/s)(50.3MiB/2007msec) 00:28:02.566 slat (nsec): min=1947, max=205649, avg=2536.27, stdev=2423.86 00:28:02.566 clat (usec): min=913, max=170635, avg=10924.95, stdev=11291.72 00:28:02.566 lat (usec): min=916, max=170667, avg=10927.48, stdev=11291.94 00:28:02.566 clat percentiles (msec): 00:28:02.566 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:28:02.566 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:28:02.566 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:28:02.566 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:02.566 | 99.99th=[ 171] 00:28:02.566 bw ( KiB/s): min=17840, max=28232, per=99.79%, avg=25608.00, stdev=5178.73, samples=4 00:28:02.566 iops : min= 4460, max= 7058, avg=6402.00, stdev=1294.68, samples=4 00:28:02.566 write: IOPS=6415, BW=25.1MiB/s (26.3MB/s)(50.3MiB/2007msec); 0 zone resets 00:28:02.566 slat (nsec): min=2029, max=88918, avg=2638.21, stdev=1460.98 00:28:02.566 clat (usec): min=247, max=168895, avg=8870.48, stdev=10588.58 00:28:02.566 lat (usec): min=249, max=168900, avg=8873.12, stdev=10588.76 00:28:02.566 clat percentiles (msec): 00:28:02.566 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:28:02.566 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:28:02.566 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:28:02.566 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:28:02.566 | 99.99th=[ 169] 00:28:02.566 bw ( KiB/s): min=18856, max=28224, per=99.92%, avg=25642.00, stdev=4529.73, samples=4 00:28:02.566 iops : min= 4714, max= 7056, avg=6410.50, stdev=1132.43, samples=4 00:28:02.566 lat (usec) : 250=0.01%, 750=0.01%, 1000=0.01% 00:28:02.566 lat (msec) : 2=0.03%, 4=0.17%, 10=71.31%, 20=27.97%, 250=0.50% 00:28:02.566 cpu : usr=61.62%, sys=36.84%, ctx=101, majf=0, minf=41 00:28:02.566 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:28:02.566 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:02.566 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:02.566 issued rwts: total=12876,12876,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:02.566 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:02.566 00:28:02.566 Run status group 0 (all jobs): 00:28:02.566 READ: bw=25.1MiB/s (26.3MB/s), 25.1MiB/s-25.1MiB/s (26.3MB/s-26.3MB/s), io=50.3MiB (52.7MB), run=2007-2007msec 00:28:02.567 WRITE: bw=25.1MiB/s (26.3MB/s), 25.1MiB/s-25.1MiB/s (26.3MB/s-26.3MB/s), io=50.3MiB (52.7MB), run=2007-2007msec 00:28:02.567 17:47:39 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:02.567 17:47:39 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:03.945 17:47:41 -- host/fio.sh@64 -- # ls_nested_guid=c426566d-54c4-404d-ab58-299fa5a906ea 00:28:03.945 17:47:41 -- host/fio.sh@65 -- # get_lvs_free_mb c426566d-54c4-404d-ab58-299fa5a906ea 00:28:03.945 17:47:41 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c426566d-54c4-404d-ab58-299fa5a906ea 00:28:03.945 17:47:41 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:03.945 17:47:41 -- common/autotest_common.sh@1355 -- # local fc 00:28:03.946 17:47:41 -- common/autotest_common.sh@1356 -- # local cs 00:28:03.946 17:47:41 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:03.946 17:47:41 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:03.946 { 00:28:03.946 "uuid": "26ee9237-c5be-4a93-892f-a8956883420b", 00:28:03.946 "name": "lvs_0", 00:28:03.946 "base_bdev": "Nvme0n1", 00:28:03.946 "total_data_clusters": 930, 00:28:03.946 "free_clusters": 0, 00:28:03.946 "block_size": 512, 00:28:03.946 "cluster_size": 1073741824 00:28:03.946 }, 00:28:03.946 { 00:28:03.946 "uuid": "c426566d-54c4-404d-ab58-299fa5a906ea", 00:28:03.946 "name": "lvs_n_0", 00:28:03.946 "base_bdev": "5984c900-f876-48c1-bfab-232b3463e5a9", 00:28:03.946 "total_data_clusters": 237847, 00:28:03.946 "free_clusters": 237847, 00:28:03.946 "block_size": 512, 00:28:03.946 "cluster_size": 4194304 00:28:03.946 } 00:28:03.946 ]' 00:28:03.946 17:47:41 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c426566d-54c4-404d-ab58-299fa5a906ea") .free_clusters' 00:28:03.946 17:47:41 -- common/autotest_common.sh@1358 -- # fc=237847 00:28:03.946 17:47:41 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c426566d-54c4-404d-ab58-299fa5a906ea") .cluster_size' 00:28:04.204 17:47:41 -- common/autotest_common.sh@1359 -- # cs=4194304 00:28:04.204 17:47:41 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:28:04.204 17:47:41 -- common/autotest_common.sh@1363 -- # echo 951388 00:28:04.204 951388 00:28:04.204 17:47:41 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:04.772 301d607f-428c-4eec-ad68-7a8d9bc0ef26 00:28:04.772 17:47:42 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:05.029 17:47:42 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:05.287 17:47:42 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:05.545 17:47:42 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:05.545 17:47:42 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:05.545 17:47:42 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:05.545 17:47:42 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:05.545 17:47:42 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:05.545 17:47:42 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:05.545 17:47:42 -- common/autotest_common.sh@1330 -- # shift 00:28:05.545 17:47:42 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:05.545 17:47:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:05.545 17:47:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:05.545 17:47:42 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:05.545 17:47:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:05.545 17:47:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:05.545 17:47:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:05.545 17:47:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:05.545 17:47:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:05.545 17:47:42 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:05.545 17:47:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:05.545 17:47:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:05.545 17:47:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:05.545 17:47:42 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:05.545 17:47:42 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:05.803 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:05.803 fio-3.35 00:28:05.803 Starting 1 thread 00:28:05.803 EAL: No free 2048 kB hugepages reported on node 1 00:28:08.328 00:28:08.328 test: (groupid=0, jobs=1): err= 0: pid=1687371: Sat Nov 16 17:47:45 2024 00:28:08.328 read: IOPS=6225, BW=24.3MiB/s (25.5MB/s)(48.9MiB/2009msec) 00:28:08.328 slat (nsec): min=1981, max=129365, avg=2500.26, stdev=1761.87 00:28:08.328 clat (usec): min=4209, max=17741, avg=11266.84, stdev=985.82 00:28:08.328 lat (usec): min=4213, max=17743, avg=11269.34, stdev=985.73 00:28:08.328 clat percentiles (usec): 00:28:08.328 | 1.00th=[ 8979], 5.00th=[ 9634], 10.00th=[10028], 20.00th=[10421], 00:28:08.328 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11469], 00:28:08.328 | 70.00th=[11731], 80.00th=[12125], 90.00th=[12387], 95.00th=[12780], 00:28:08.328 | 99.00th=[13435], 99.50th=[13829], 99.90th=[15270], 99.95th=[16450], 00:28:08.328 | 99.99th=[17695] 00:28:08.328 bw ( KiB/s): min=23480, max=25464, per=99.92%, avg=24884.00, stdev=939.91, samples=4 00:28:08.328 iops : min= 5870, max= 6366, avg=6221.00, stdev=234.98, samples=4 00:28:08.328 write: IOPS=6220, BW=24.3MiB/s (25.5MB/s)(48.8MiB/2009msec); 0 zone resets 00:28:08.328 slat (nsec): min=2089, max=88944, avg=2585.87, stdev=1253.24 00:28:08.328 clat (usec): min=2043, max=16525, avg=9141.46, stdev=865.00 00:28:08.328 lat (usec): min=2048, max=16528, avg=9144.04, stdev=864.97 00:28:08.328 clat percentiles (usec): 00:28:08.328 | 1.00th=[ 7177], 5.00th=[ 7832], 10.00th=[ 8160], 20.00th=[ 8455], 00:28:08.328 | 30.00th=[ 8717], 40.00th=[ 8979], 50.00th=[ 9110], 60.00th=[ 9372], 00:28:08.328 | 70.00th=[ 9503], 80.00th=[ 9765], 90.00th=[10159], 95.00th=[10421], 00:28:08.328 | 99.00th=[10945], 99.50th=[11469], 99.90th=[15270], 99.95th=[16188], 00:28:08.329 | 99.99th=[16450] 00:28:08.329 bw ( KiB/s): min=24536, max=25096, per=99.96%, avg=24870.00, stdev=238.79, samples=4 00:28:08.329 iops : min= 6134, max= 6274, avg=6217.50, stdev=59.70, samples=4 00:28:08.329 lat (msec) : 4=0.04%, 10=47.58%, 20=52.37% 00:28:08.329 cpu : usr=66.14%, sys=32.32%, ctx=126, majf=0, minf=41 00:28:08.329 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:08.329 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:08.329 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:08.329 issued rwts: total=12508,12496,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:08.329 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:08.329 00:28:08.329 Run status group 0 (all jobs): 00:28:08.329 READ: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.9MiB (51.2MB), run=2009-2009msec 00:28:08.329 WRITE: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.8MiB (51.2MB), run=2009-2009msec 00:28:08.329 17:47:45 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:08.329 17:47:45 -- host/fio.sh@74 -- # sync 00:28:08.329 17:47:45 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:12.510 17:47:49 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:12.510 17:47:49 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:15.790 17:47:52 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:15.790 17:47:52 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:17.688 17:47:54 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:17.688 17:47:54 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:17.688 17:47:54 -- host/fio.sh@86 -- # nvmftestfini 00:28:17.688 17:47:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:17.688 17:47:54 -- nvmf/common.sh@116 -- # sync 00:28:17.688 17:47:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:17.688 17:47:54 -- nvmf/common.sh@119 -- # set +e 00:28:17.688 17:47:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:17.688 17:47:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:17.688 rmmod nvme_tcp 00:28:17.688 rmmod nvme_fabrics 00:28:17.688 rmmod nvme_keyring 00:28:17.688 17:47:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:17.688 17:47:54 -- nvmf/common.sh@123 -- # set -e 00:28:17.688 17:47:54 -- nvmf/common.sh@124 -- # return 0 00:28:17.688 17:47:54 -- nvmf/common.sh@477 -- # '[' -n 1684433 ']' 00:28:17.688 17:47:54 -- nvmf/common.sh@478 -- # killprocess 1684433 00:28:17.688 17:47:54 -- common/autotest_common.sh@936 -- # '[' -z 1684433 ']' 00:28:17.688 17:47:54 -- common/autotest_common.sh@940 -- # kill -0 1684433 00:28:17.688 17:47:54 -- common/autotest_common.sh@941 -- # uname 00:28:17.688 17:47:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:17.688 17:47:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1684433 00:28:17.688 17:47:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:17.688 17:47:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:17.688 17:47:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1684433' 00:28:17.688 killing process with pid 1684433 00:28:17.688 17:47:54 -- common/autotest_common.sh@955 -- # kill 1684433 00:28:17.688 17:47:54 -- common/autotest_common.sh@960 -- # wait 1684433 00:28:17.947 17:47:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:17.947 17:47:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:17.947 17:47:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:17.947 17:47:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:17.947 17:47:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:17.947 17:47:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:17.947 17:47:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:17.947 17:47:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:19.852 17:47:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:19.852 00:28:19.852 real 0m37.876s 00:28:19.852 user 2m25.989s 00:28:19.852 sys 0m6.649s 00:28:19.852 17:47:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:19.852 17:47:57 -- common/autotest_common.sh@10 -- # set +x 00:28:19.852 ************************************ 00:28:19.852 END TEST nvmf_fio_host 00:28:19.852 ************************************ 00:28:19.852 17:47:57 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:19.852 17:47:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:19.852 17:47:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:19.852 17:47:57 -- common/autotest_common.sh@10 -- # set +x 00:28:19.852 ************************************ 00:28:19.852 START TEST nvmf_failover 00:28:19.852 ************************************ 00:28:19.852 17:47:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:19.852 * Looking for test storage... 00:28:19.852 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:19.852 17:47:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:19.852 17:47:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:19.852 17:47:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:20.111 17:47:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:20.111 17:47:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:20.111 17:47:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:20.111 17:47:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:20.111 17:47:57 -- scripts/common.sh@335 -- # IFS=.-: 00:28:20.111 17:47:57 -- scripts/common.sh@335 -- # read -ra ver1 00:28:20.111 17:47:57 -- scripts/common.sh@336 -- # IFS=.-: 00:28:20.111 17:47:57 -- scripts/common.sh@336 -- # read -ra ver2 00:28:20.111 17:47:57 -- scripts/common.sh@337 -- # local 'op=<' 00:28:20.112 17:47:57 -- scripts/common.sh@339 -- # ver1_l=2 00:28:20.112 17:47:57 -- scripts/common.sh@340 -- # ver2_l=1 00:28:20.112 17:47:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:20.112 17:47:57 -- scripts/common.sh@343 -- # case "$op" in 00:28:20.112 17:47:57 -- scripts/common.sh@344 -- # : 1 00:28:20.112 17:47:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:20.112 17:47:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:20.112 17:47:57 -- scripts/common.sh@364 -- # decimal 1 00:28:20.112 17:47:57 -- scripts/common.sh@352 -- # local d=1 00:28:20.112 17:47:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:20.112 17:47:57 -- scripts/common.sh@354 -- # echo 1 00:28:20.112 17:47:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:20.112 17:47:57 -- scripts/common.sh@365 -- # decimal 2 00:28:20.112 17:47:57 -- scripts/common.sh@352 -- # local d=2 00:28:20.112 17:47:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:20.112 17:47:57 -- scripts/common.sh@354 -- # echo 2 00:28:20.112 17:47:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:20.112 17:47:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:20.112 17:47:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:20.112 17:47:57 -- scripts/common.sh@367 -- # return 0 00:28:20.112 17:47:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:20.112 17:47:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:20.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:20.112 --rc genhtml_branch_coverage=1 00:28:20.112 --rc genhtml_function_coverage=1 00:28:20.112 --rc genhtml_legend=1 00:28:20.112 --rc geninfo_all_blocks=1 00:28:20.112 --rc geninfo_unexecuted_blocks=1 00:28:20.112 00:28:20.112 ' 00:28:20.112 17:47:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:20.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:20.112 --rc genhtml_branch_coverage=1 00:28:20.112 --rc genhtml_function_coverage=1 00:28:20.112 --rc genhtml_legend=1 00:28:20.112 --rc geninfo_all_blocks=1 00:28:20.112 --rc geninfo_unexecuted_blocks=1 00:28:20.112 00:28:20.112 ' 00:28:20.112 17:47:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:20.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:20.112 --rc genhtml_branch_coverage=1 00:28:20.112 --rc genhtml_function_coverage=1 00:28:20.112 --rc genhtml_legend=1 00:28:20.112 --rc geninfo_all_blocks=1 00:28:20.112 --rc geninfo_unexecuted_blocks=1 00:28:20.112 00:28:20.112 ' 00:28:20.112 17:47:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:20.112 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:20.112 --rc genhtml_branch_coverage=1 00:28:20.112 --rc genhtml_function_coverage=1 00:28:20.112 --rc genhtml_legend=1 00:28:20.112 --rc geninfo_all_blocks=1 00:28:20.112 --rc geninfo_unexecuted_blocks=1 00:28:20.112 00:28:20.112 ' 00:28:20.112 17:47:57 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:20.112 17:47:57 -- nvmf/common.sh@7 -- # uname -s 00:28:20.112 17:47:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:20.112 17:47:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:20.112 17:47:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:20.112 17:47:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:20.112 17:47:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:20.112 17:47:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:20.112 17:47:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:20.112 17:47:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:20.112 17:47:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:20.112 17:47:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:20.112 17:47:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:20.112 17:47:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:20.112 17:47:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:20.112 17:47:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:20.112 17:47:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:20.112 17:47:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:20.112 17:47:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:20.112 17:47:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:20.112 17:47:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:20.112 17:47:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:20.112 17:47:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:20.112 17:47:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:20.112 17:47:57 -- paths/export.sh@5 -- # export PATH 00:28:20.112 17:47:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:20.112 17:47:57 -- nvmf/common.sh@46 -- # : 0 00:28:20.112 17:47:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:20.112 17:47:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:20.112 17:47:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:20.112 17:47:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:20.112 17:47:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:20.112 17:47:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:20.112 17:47:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:20.112 17:47:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:20.112 17:47:57 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:20.112 17:47:57 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:20.112 17:47:57 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:20.112 17:47:57 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:20.112 17:47:57 -- host/failover.sh@18 -- # nvmftestinit 00:28:20.112 17:47:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:20.112 17:47:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:20.112 17:47:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:20.112 17:47:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:20.112 17:47:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:20.112 17:47:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:20.112 17:47:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:20.112 17:47:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:20.112 17:47:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:20.112 17:47:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:20.112 17:47:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:20.112 17:47:57 -- common/autotest_common.sh@10 -- # set +x 00:28:22.014 17:47:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:22.014 17:47:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:22.014 17:47:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:22.014 17:47:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:22.014 17:47:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:22.014 17:47:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:22.014 17:47:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:22.014 17:47:59 -- nvmf/common.sh@294 -- # net_devs=() 00:28:22.014 17:47:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:22.014 17:47:59 -- nvmf/common.sh@295 -- # e810=() 00:28:22.014 17:47:59 -- nvmf/common.sh@295 -- # local -ga e810 00:28:22.014 17:47:59 -- nvmf/common.sh@296 -- # x722=() 00:28:22.014 17:47:59 -- nvmf/common.sh@296 -- # local -ga x722 00:28:22.014 17:47:59 -- nvmf/common.sh@297 -- # mlx=() 00:28:22.014 17:47:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:22.014 17:47:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:22.014 17:47:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:22.014 17:47:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:22.014 17:47:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:22.014 17:47:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:22.014 17:47:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:22.014 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:22.014 17:47:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:22.014 17:47:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:22.014 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:22.014 17:47:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:22.014 17:47:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:22.014 17:47:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:22.014 17:47:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:22.014 17:47:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:22.014 17:47:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:22.014 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:22.014 17:47:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:22.014 17:47:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:22.014 17:47:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:22.014 17:47:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:22.014 17:47:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:22.014 17:47:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:22.014 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:22.014 17:47:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:22.014 17:47:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:22.014 17:47:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:22.014 17:47:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:22.014 17:47:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:22.014 17:47:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:22.014 17:47:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:22.014 17:47:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:22.014 17:47:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:22.014 17:47:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:22.014 17:47:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:22.014 17:47:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:22.014 17:47:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:22.014 17:47:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:22.014 17:47:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:22.014 17:47:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:22.014 17:47:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:22.014 17:47:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:22.272 17:47:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:22.272 17:47:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:22.272 17:47:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:22.272 17:47:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:22.272 17:47:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:22.272 17:47:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:22.272 17:47:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:22.272 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:22.272 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.185 ms 00:28:22.272 00:28:22.272 --- 10.0.0.2 ping statistics --- 00:28:22.272 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:22.272 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:28:22.272 17:47:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:22.272 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:22.272 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:28:22.272 00:28:22.272 --- 10.0.0.1 ping statistics --- 00:28:22.272 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:22.272 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:28:22.272 17:47:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:22.272 17:47:59 -- nvmf/common.sh@410 -- # return 0 00:28:22.272 17:47:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:22.272 17:47:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:22.272 17:47:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:22.272 17:47:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:22.272 17:47:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:22.272 17:47:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:22.272 17:47:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:22.272 17:47:59 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:22.272 17:47:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:22.272 17:47:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:22.272 17:47:59 -- common/autotest_common.sh@10 -- # set +x 00:28:22.272 17:47:59 -- nvmf/common.sh@469 -- # nvmfpid=1690793 00:28:22.272 17:47:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:22.272 17:47:59 -- nvmf/common.sh@470 -- # waitforlisten 1690793 00:28:22.272 17:47:59 -- common/autotest_common.sh@829 -- # '[' -z 1690793 ']' 00:28:22.272 17:47:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:22.272 17:47:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:22.272 17:47:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:22.272 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:22.272 17:47:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:22.272 17:47:59 -- common/autotest_common.sh@10 -- # set +x 00:28:22.272 [2024-11-16 17:47:59.639319] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:22.272 [2024-11-16 17:47:59.639390] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:22.272 EAL: No free 2048 kB hugepages reported on node 1 00:28:22.272 [2024-11-16 17:47:59.707329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:22.531 [2024-11-16 17:47:59.799937] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:22.531 [2024-11-16 17:47:59.800114] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:22.531 [2024-11-16 17:47:59.800131] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:22.531 [2024-11-16 17:47:59.800144] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:22.531 [2024-11-16 17:47:59.800214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:22.531 [2024-11-16 17:47:59.800245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:22.531 [2024-11-16 17:47:59.800244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:23.463 17:48:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:23.463 17:48:00 -- common/autotest_common.sh@862 -- # return 0 00:28:23.463 17:48:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:23.463 17:48:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:23.463 17:48:00 -- common/autotest_common.sh@10 -- # set +x 00:28:23.463 17:48:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:23.463 17:48:00 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:23.463 [2024-11-16 17:48:00.947103] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:23.721 17:48:00 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:23.978 Malloc0 00:28:23.978 17:48:01 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:24.236 17:48:01 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:24.493 17:48:01 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:24.750 [2024-11-16 17:48:02.039166] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:24.750 17:48:02 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:25.008 [2024-11-16 17:48:02.287814] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:25.008 17:48:02 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:25.266 [2024-11-16 17:48:02.536697] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:25.266 17:48:02 -- host/failover.sh@31 -- # bdevperf_pid=1691215 00:28:25.266 17:48:02 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:25.266 17:48:02 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:25.266 17:48:02 -- host/failover.sh@34 -- # waitforlisten 1691215 /var/tmp/bdevperf.sock 00:28:25.266 17:48:02 -- common/autotest_common.sh@829 -- # '[' -z 1691215 ']' 00:28:25.266 17:48:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:25.266 17:48:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:25.266 17:48:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:25.266 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:25.266 17:48:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:25.266 17:48:02 -- common/autotest_common.sh@10 -- # set +x 00:28:26.199 17:48:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:26.199 17:48:03 -- common/autotest_common.sh@862 -- # return 0 00:28:26.199 17:48:03 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:26.763 NVMe0n1 00:28:26.763 17:48:04 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:27.021 00:28:27.021 17:48:04 -- host/failover.sh@39 -- # run_test_pid=1691488 00:28:27.021 17:48:04 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:27.021 17:48:04 -- host/failover.sh@41 -- # sleep 1 00:28:28.397 17:48:05 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:28.397 [2024-11-16 17:48:05.725572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.725996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.726016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.726035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.726053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.726070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.726088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 [2024-11-16 17:48:05.726107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb79930 is same with the state(5) to be set 00:28:28.397 17:48:05 -- host/failover.sh@45 -- # sleep 3 00:28:31.680 17:48:08 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:31.680 00:28:31.681 17:48:09 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:31.940 [2024-11-16 17:48:09.369996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.940 [2024-11-16 17:48:09.370062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.940 [2024-11-16 17:48:09.370078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.940 [2024-11-16 17:48:09.370090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.940 [2024-11-16 17:48:09.370103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.940 [2024-11-16 17:48:09.370115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 [2024-11-16 17:48:09.370788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7a7c0 is same with the state(5) to be set 00:28:31.941 17:48:09 -- host/failover.sh@50 -- # sleep 3 00:28:35.289 17:48:12 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:35.289 [2024-11-16 17:48:12.641066] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:35.289 17:48:12 -- host/failover.sh@55 -- # sleep 1 00:28:36.227 17:48:13 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:36.485 [2024-11-16 17:48:13.907720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.907994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.485 [2024-11-16 17:48:13.908123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 [2024-11-16 17:48:13.908472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb7b310 is same with the state(5) to be set 00:28:36.486 17:48:13 -- host/failover.sh@59 -- # wait 1691488 00:28:43.066 0 00:28:43.066 17:48:19 -- host/failover.sh@61 -- # killprocess 1691215 00:28:43.066 17:48:19 -- common/autotest_common.sh@936 -- # '[' -z 1691215 ']' 00:28:43.066 17:48:19 -- common/autotest_common.sh@940 -- # kill -0 1691215 00:28:43.066 17:48:19 -- common/autotest_common.sh@941 -- # uname 00:28:43.066 17:48:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:43.066 17:48:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1691215 00:28:43.066 17:48:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:43.066 17:48:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:43.066 17:48:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1691215' 00:28:43.066 killing process with pid 1691215 00:28:43.066 17:48:19 -- common/autotest_common.sh@955 -- # kill 1691215 00:28:43.066 17:48:19 -- common/autotest_common.sh@960 -- # wait 1691215 00:28:43.066 17:48:19 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:43.066 [2024-11-16 17:48:02.596397] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:43.066 [2024-11-16 17:48:02.596480] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1691215 ] 00:28:43.066 EAL: No free 2048 kB hugepages reported on node 1 00:28:43.066 [2024-11-16 17:48:02.655720] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:43.066 [2024-11-16 17:48:02.739393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:43.066 Running I/O for 15 seconds... 00:28:43.066 [2024-11-16 17:48:05.726443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:117472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:117480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:117504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:117616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.726978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.726992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:117664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.727005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.727019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:118280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.727032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.727047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.727060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.727074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:118320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.066 [2024-11-16 17:48:05.727086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.066 [2024-11-16 17:48:05.727100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:118336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:118352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:118360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:118392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:118432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.727224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:118440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.727252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:118448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.727279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:117688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:117712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:117736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:117760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:117768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:117776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:117816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:117824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:117832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:117848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:117856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:117864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:117880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:117888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:118456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.727812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:118464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.727898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:118488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.727928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:118496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.727971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.727987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:118504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.728010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.728026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:118512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.728040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.728054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:118520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.728068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.728083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:118528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.728096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.728111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.728124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.728139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:118544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.728152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.728167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:118552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.067 [2024-11-16 17:48:05.728180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.728195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.067 [2024-11-16 17:48:05.728208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.067 [2024-11-16 17:48:05.728224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:118568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.068 [2024-11-16 17:48:05.728237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:118576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:118584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.068 [2024-11-16 17:48:05.728293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:117904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:117912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:117944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:117960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:117968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:117976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:118600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:118016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:118040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:118072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:118136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:118608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:118616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.728913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:118624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.068 [2024-11-16 17:48:05.728958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.728973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:118632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.068 [2024-11-16 17:48:05.728987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.729001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:118640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.068 [2024-11-16 17:48:05.729015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.729029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:118648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.068 [2024-11-16 17:48:05.729043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.729057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:118656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.729070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.729085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.729098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.729113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:118672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.068 [2024-11-16 17:48:05.729126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.729141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:118680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.068 [2024-11-16 17:48:05.729158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.729172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:118144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.729185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.068 [2024-11-16 17:48:05.729200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.068 [2024-11-16 17:48:05.729213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:118168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:118184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:118192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:118200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:118240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:118688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:118696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.069 [2024-11-16 17:48:05.729445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:118720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.069 [2024-11-16 17:48:05.729532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:118728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.069 [2024-11-16 17:48:05.729560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:118736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.069 [2024-11-16 17:48:05.729589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:118744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:118760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:118776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:118256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:118264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:118272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:118304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.729958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.729973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.730001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:118328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.730030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:118784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.730065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:118792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.730094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:118800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.069 [2024-11-16 17:48:05.730122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:118808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.069 [2024-11-16 17:48:05.730150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:118816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.069 [2024-11-16 17:48:05.730177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:118344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.730205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:118368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.730233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.069 [2024-11-16 17:48:05.730262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.069 [2024-11-16 17:48:05.730277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:05.730290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:05.730322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:05.730350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:05.730384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x200ec60 is same with the state(5) to be set 00:28:43.070 [2024-11-16 17:48:05.730415] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:43.070 [2024-11-16 17:48:05.730425] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:43.070 [2024-11-16 17:48:05.730436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118424 len:8 PRP1 0x0 PRP2 0x0 00:28:43.070 [2024-11-16 17:48:05.730449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730512] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200ec60 was disconnected and freed. reset controller. 00:28:43.070 [2024-11-16 17:48:05.730538] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:43.070 [2024-11-16 17:48:05.730587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.070 [2024-11-16 17:48:05.730607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730631] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.070 [2024-11-16 17:48:05.730645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730664] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.070 [2024-11-16 17:48:05.730677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730690] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.070 [2024-11-16 17:48:05.730704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:05.730716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:43.070 [2024-11-16 17:48:05.730768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ff0000 (9): Bad file descriptor 00:28:43.070 [2024-11-16 17:48:05.733086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:43.070 [2024-11-16 17:48:05.766527] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:43.070 [2024-11-16 17:48:09.370942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:112856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.370983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:112880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:112224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:112248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:112288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:112296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:112312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:112320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:112336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:112344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:112896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:112912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:112952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:112976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:112352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:112392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:112440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:112456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:112496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.070 [2024-11-16 17:48:09.371545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:112536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.070 [2024-11-16 17:48:09.371558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:112552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:112568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:113008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:113024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:113032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:113040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:113048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:113056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:113064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.071 [2024-11-16 17:48:09.371841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:113072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:113080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:113088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.071 [2024-11-16 17:48:09.371949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:113096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.371983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.371998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:113104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:113112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.071 [2024-11-16 17:48:09.372038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:113120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:113128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:113136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:113144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.071 [2024-11-16 17:48:09.372150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:113152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:113160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:113168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.071 [2024-11-16 17:48:09.372231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:113176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.071 [2024-11-16 17:48:09.372258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:113184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:113192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:113200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.071 [2024-11-16 17:48:09.372340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:113208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.071 [2024-11-16 17:48:09.372367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:113216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.071 [2024-11-16 17:48:09.372394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.071 [2024-11-16 17:48:09.372408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:113224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:113232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.372454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:113240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.372481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:112576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:112592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:112600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:112632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:112656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:112664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:112688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:112704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:113248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:113256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.372786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:113264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.372813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:113272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:113280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.372869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:113288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.372906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:113296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.372950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:113304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.372977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.372991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:113312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.373004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:113320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.373031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:113328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:113336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.373087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:112712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:112720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:112728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:112736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:112744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:112768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:112776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:112784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:113344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.373337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:113352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.373368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:113360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.373395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:113368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.072 [2024-11-16 17:48:09.373422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.072 [2024-11-16 17:48:09.373437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:113376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.072 [2024-11-16 17:48:09.373450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:113384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.373477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:113392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.373503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:113400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:113408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:112840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:112848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:112864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:112872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:112888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:112904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:112920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:112928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:113416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:113424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:113432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:113440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:113448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.373970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.373985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:113456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.374002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:113464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:113472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:113480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:113488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:113496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:113504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:113512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.374194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:113520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.374221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:113528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.374249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:113536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.374276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:113544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:113552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:113560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:113568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:113576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.073 [2024-11-16 17:48:09.374424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:113584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.374458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.073 [2024-11-16 17:48:09.374472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:113592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.073 [2024-11-16 17:48:09.374485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:113600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.074 [2024-11-16 17:48:09.374512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:112936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:09.374540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:112944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:09.374567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:112960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:09.374594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:112968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:09.374643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:112984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:09.374673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:112992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:09.374702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:113000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:09.374733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffc4b0 is same with the state(5) to be set 00:28:43.074 [2024-11-16 17:48:09.374764] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:43.074 [2024-11-16 17:48:09.374775] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:43.074 [2024-11-16 17:48:09.374792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:113016 len:8 PRP1 0x0 PRP2 0x0 00:28:43.074 [2024-11-16 17:48:09.374805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374865] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ffc4b0 was disconnected and freed. reset controller. 00:28:43.074 [2024-11-16 17:48:09.374883] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:43.074 [2024-11-16 17:48:09.374930] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.074 [2024-11-16 17:48:09.374949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374964] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.074 [2024-11-16 17:48:09.374978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.374991] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.074 [2024-11-16 17:48:09.375005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.375019] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.074 [2024-11-16 17:48:09.375032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:09.375044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:43.074 [2024-11-16 17:48:09.375084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ff0000 (9): Bad file descriptor 00:28:43.074 [2024-11-16 17:48:09.377378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:43.074 [2024-11-16 17:48:09.412816] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:43.074 [2024-11-16 17:48:13.908613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:72328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:72336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:72344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:72352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:72360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:71728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:71736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:71744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:71752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.908984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:71760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.908997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:71776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:71792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:71800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:72384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:72424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:71824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:71856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:71864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:71880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.074 [2024-11-16 17:48:13.909271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:71888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.074 [2024-11-16 17:48:13.909284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:71904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:71920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:71936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:72440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:72448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:72456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:71944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:71984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:71992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:72008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:72032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:72040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:72056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:72072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:72464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:72472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:72488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:72504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:72528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:72552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.909865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:72560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.909900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:72568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.909947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:72576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.909975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.909989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:72584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.910003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:72592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.910030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:72600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.910057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:72608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.910084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:72616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.910110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:72624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.910138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:72632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.910164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:72640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.075 [2024-11-16 17:48:13.910191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:72080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.910219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:72088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.910245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:72112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.910272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.075 [2024-11-16 17:48:13.910289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:72120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.075 [2024-11-16 17:48:13.910303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:72128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:72176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:72200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:72208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:72648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:72656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:72664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:72672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:72680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:72688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:72696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:72704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:72712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:72720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:72728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:72736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:72744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:72752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:72760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:72768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:72776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:72784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.910967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.910981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:72792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.910995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.911009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:72800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.911022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.911036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:72808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.911053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.911068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:72816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.911082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.911096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:72824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.911109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.911123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:72832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.076 [2024-11-16 17:48:13.911137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.076 [2024-11-16 17:48:13.911151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:72840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.076 [2024-11-16 17:48:13.911164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:72848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:72856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:72864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:72872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:72880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:72888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:72896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.077 [2024-11-16 17:48:13.911362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:72904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:72912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.077 [2024-11-16 17:48:13.911419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:72216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:72224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:72232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:72240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:72272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:72280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:72288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:72296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:72304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:72312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:72320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:72368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:72376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:72392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:72400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:72408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:72920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.077 [2024-11-16 17:48:13.911937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:72928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.911979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:72936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.911992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.912011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:72944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.912024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.912038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:72952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.077 [2024-11-16 17:48:13.912051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.912065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:72960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.912079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.912093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:72968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.912105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.912119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:72976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.912131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.912149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:72984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.077 [2024-11-16 17:48:13.912162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.912176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:72992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.077 [2024-11-16 17:48:13.912188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.077 [2024-11-16 17:48:13.912202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:73000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:43.077 [2024-11-16 17:48:13.912216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:72416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.078 [2024-11-16 17:48:13.912243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:72432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.078 [2024-11-16 17:48:13.912269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:72480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.078 [2024-11-16 17:48:13.912295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:72496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.078 [2024-11-16 17:48:13.912322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:72512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.078 [2024-11-16 17:48:13.912349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:72520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.078 [2024-11-16 17:48:13.912376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:72536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:43.078 [2024-11-16 17:48:13.912407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2010c10 is same with the state(5) to be set 00:28:43.078 [2024-11-16 17:48:13.912437] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:43.078 [2024-11-16 17:48:13.912448] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:43.078 [2024-11-16 17:48:13.912459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:72544 len:8 PRP1 0x0 PRP2 0x0 00:28:43.078 [2024-11-16 17:48:13.912471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912524] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2010c10 was disconnected and freed. reset controller. 00:28:43.078 [2024-11-16 17:48:13.912557] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:43.078 [2024-11-16 17:48:13.912593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.078 [2024-11-16 17:48:13.912635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.078 [2024-11-16 17:48:13.912664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912677] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.078 [2024-11-16 17:48:13.912690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912704] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.078 [2024-11-16 17:48:13.912716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.078 [2024-11-16 17:48:13.912729] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:43.078 [2024-11-16 17:48:13.914808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:43.078 [2024-11-16 17:48:13.914847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ff0000 (9): Bad file descriptor 00:28:43.078 [2024-11-16 17:48:13.951610] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:43.078 00:28:43.078 Latency(us) 00:28:43.078 [2024-11-16T16:48:20.570Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:43.078 [2024-11-16T16:48:20.570Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:43.078 Verification LBA range: start 0x0 length 0x4000 00:28:43.078 NVMe0n1 : 15.01 12807.93 50.03 394.26 0.00 9678.38 643.22 14660.65 00:28:43.078 [2024-11-16T16:48:20.570Z] =================================================================================================================== 00:28:43.078 [2024-11-16T16:48:20.570Z] Total : 12807.93 50.03 394.26 0.00 9678.38 643.22 14660.65 00:28:43.078 Received shutdown signal, test time was about 15.000000 seconds 00:28:43.078 00:28:43.078 Latency(us) 00:28:43.078 [2024-11-16T16:48:20.570Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:43.078 [2024-11-16T16:48:20.570Z] =================================================================================================================== 00:28:43.078 [2024-11-16T16:48:20.570Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:43.078 17:48:19 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:43.078 17:48:19 -- host/failover.sh@65 -- # count=3 00:28:43.078 17:48:19 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:43.078 17:48:19 -- host/failover.sh@73 -- # bdevperf_pid=1693891 00:28:43.078 17:48:19 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:43.078 17:48:19 -- host/failover.sh@75 -- # waitforlisten 1693891 /var/tmp/bdevperf.sock 00:28:43.078 17:48:19 -- common/autotest_common.sh@829 -- # '[' -z 1693891 ']' 00:28:43.078 17:48:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:43.078 17:48:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:43.078 17:48:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:43.078 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:43.078 17:48:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:43.078 17:48:19 -- common/autotest_common.sh@10 -- # set +x 00:28:43.645 17:48:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:43.645 17:48:20 -- common/autotest_common.sh@862 -- # return 0 00:28:43.645 17:48:20 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:43.904 [2024-11-16 17:48:21.170929] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:43.904 17:48:21 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:44.162 [2024-11-16 17:48:21.419532] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:44.162 17:48:21 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:44.421 NVMe0n1 00:28:44.691 17:48:21 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:44.957 00:28:44.957 17:48:22 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:45.526 00:28:45.526 17:48:22 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:45.526 17:48:22 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:45.526 17:48:22 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:45.784 17:48:23 -- host/failover.sh@87 -- # sleep 3 00:28:49.074 17:48:26 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:49.074 17:48:26 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:49.074 17:48:26 -- host/failover.sh@90 -- # run_test_pid=1694630 00:28:49.074 17:48:26 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:49.074 17:48:26 -- host/failover.sh@92 -- # wait 1694630 00:28:50.450 0 00:28:50.450 17:48:27 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:50.450 [2024-11-16 17:48:19.915803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:50.450 [2024-11-16 17:48:19.915882] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1693891 ] 00:28:50.450 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.450 [2024-11-16 17:48:19.976846] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:50.450 [2024-11-16 17:48:20.065427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:50.450 [2024-11-16 17:48:23.240213] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:50.450 [2024-11-16 17:48:23.240296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.450 [2024-11-16 17:48:23.240319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.450 [2024-11-16 17:48:23.240336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.450 [2024-11-16 17:48:23.240349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.450 [2024-11-16 17:48:23.240362] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.450 [2024-11-16 17:48:23.240376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.450 [2024-11-16 17:48:23.240389] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:50.450 [2024-11-16 17:48:23.240402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:50.450 [2024-11-16 17:48:23.240415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:50.450 [2024-11-16 17:48:23.240450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:50.450 [2024-11-16 17:48:23.240478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c30000 (9): Bad file descriptor 00:28:50.450 [2024-11-16 17:48:23.285040] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:50.450 Running I/O for 1 seconds... 00:28:50.450 00:28:50.450 Latency(us) 00:28:50.450 [2024-11-16T16:48:27.942Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:50.450 [2024-11-16T16:48:27.942Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:50.450 Verification LBA range: start 0x0 length 0x4000 00:28:50.450 NVMe0n1 : 1.01 12950.55 50.59 0.00 0.00 9837.67 1061.93 10971.21 00:28:50.450 [2024-11-16T16:48:27.942Z] =================================================================================================================== 00:28:50.450 [2024-11-16T16:48:27.942Z] Total : 12950.55 50.59 0.00 0.00 9837.67 1061.93 10971.21 00:28:50.451 17:48:27 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:50.451 17:48:27 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:50.709 17:48:27 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:50.967 17:48:28 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:50.967 17:48:28 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:51.225 17:48:28 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:51.484 17:48:28 -- host/failover.sh@101 -- # sleep 3 00:28:54.775 17:48:31 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:54.776 17:48:31 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:54.776 17:48:32 -- host/failover.sh@108 -- # killprocess 1693891 00:28:54.776 17:48:32 -- common/autotest_common.sh@936 -- # '[' -z 1693891 ']' 00:28:54.776 17:48:32 -- common/autotest_common.sh@940 -- # kill -0 1693891 00:28:54.776 17:48:32 -- common/autotest_common.sh@941 -- # uname 00:28:54.776 17:48:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:54.776 17:48:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1693891 00:28:54.776 17:48:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:54.776 17:48:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:54.776 17:48:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1693891' 00:28:54.776 killing process with pid 1693891 00:28:54.776 17:48:32 -- common/autotest_common.sh@955 -- # kill 1693891 00:28:54.776 17:48:32 -- common/autotest_common.sh@960 -- # wait 1693891 00:28:55.034 17:48:32 -- host/failover.sh@110 -- # sync 00:28:55.034 17:48:32 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:55.294 17:48:32 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:55.294 17:48:32 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:55.294 17:48:32 -- host/failover.sh@116 -- # nvmftestfini 00:28:55.294 17:48:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:55.294 17:48:32 -- nvmf/common.sh@116 -- # sync 00:28:55.294 17:48:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:55.294 17:48:32 -- nvmf/common.sh@119 -- # set +e 00:28:55.294 17:48:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:55.294 17:48:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:55.294 rmmod nvme_tcp 00:28:55.294 rmmod nvme_fabrics 00:28:55.294 rmmod nvme_keyring 00:28:55.294 17:48:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:55.294 17:48:32 -- nvmf/common.sh@123 -- # set -e 00:28:55.294 17:48:32 -- nvmf/common.sh@124 -- # return 0 00:28:55.294 17:48:32 -- nvmf/common.sh@477 -- # '[' -n 1690793 ']' 00:28:55.294 17:48:32 -- nvmf/common.sh@478 -- # killprocess 1690793 00:28:55.294 17:48:32 -- common/autotest_common.sh@936 -- # '[' -z 1690793 ']' 00:28:55.294 17:48:32 -- common/autotest_common.sh@940 -- # kill -0 1690793 00:28:55.294 17:48:32 -- common/autotest_common.sh@941 -- # uname 00:28:55.294 17:48:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:55.294 17:48:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1690793 00:28:55.294 17:48:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:55.294 17:48:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:55.294 17:48:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1690793' 00:28:55.294 killing process with pid 1690793 00:28:55.294 17:48:32 -- common/autotest_common.sh@955 -- # kill 1690793 00:28:55.294 17:48:32 -- common/autotest_common.sh@960 -- # wait 1690793 00:28:55.554 17:48:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:55.554 17:48:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:55.554 17:48:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:55.554 17:48:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:55.554 17:48:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:55.554 17:48:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:55.554 17:48:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:55.554 17:48:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:57.456 17:48:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:57.456 00:28:57.456 real 0m37.666s 00:28:57.456 user 2m13.432s 00:28:57.456 sys 0m6.050s 00:28:57.456 17:48:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:57.456 17:48:34 -- common/autotest_common.sh@10 -- # set +x 00:28:57.456 ************************************ 00:28:57.456 END TEST nvmf_failover 00:28:57.456 ************************************ 00:28:57.716 17:48:34 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:57.716 17:48:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:57.716 17:48:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:57.716 17:48:34 -- common/autotest_common.sh@10 -- # set +x 00:28:57.716 ************************************ 00:28:57.716 START TEST nvmf_discovery 00:28:57.716 ************************************ 00:28:57.716 17:48:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:57.716 * Looking for test storage... 00:28:57.716 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:57.716 17:48:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:57.716 17:48:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:57.716 17:48:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:57.716 17:48:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:57.716 17:48:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:57.716 17:48:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:57.716 17:48:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:57.716 17:48:35 -- scripts/common.sh@335 -- # IFS=.-: 00:28:57.716 17:48:35 -- scripts/common.sh@335 -- # read -ra ver1 00:28:57.716 17:48:35 -- scripts/common.sh@336 -- # IFS=.-: 00:28:57.716 17:48:35 -- scripts/common.sh@336 -- # read -ra ver2 00:28:57.716 17:48:35 -- scripts/common.sh@337 -- # local 'op=<' 00:28:57.716 17:48:35 -- scripts/common.sh@339 -- # ver1_l=2 00:28:57.716 17:48:35 -- scripts/common.sh@340 -- # ver2_l=1 00:28:57.716 17:48:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:57.716 17:48:35 -- scripts/common.sh@343 -- # case "$op" in 00:28:57.716 17:48:35 -- scripts/common.sh@344 -- # : 1 00:28:57.716 17:48:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:57.716 17:48:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:57.716 17:48:35 -- scripts/common.sh@364 -- # decimal 1 00:28:57.716 17:48:35 -- scripts/common.sh@352 -- # local d=1 00:28:57.716 17:48:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:57.716 17:48:35 -- scripts/common.sh@354 -- # echo 1 00:28:57.716 17:48:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:57.716 17:48:35 -- scripts/common.sh@365 -- # decimal 2 00:28:57.716 17:48:35 -- scripts/common.sh@352 -- # local d=2 00:28:57.716 17:48:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:57.716 17:48:35 -- scripts/common.sh@354 -- # echo 2 00:28:57.716 17:48:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:57.716 17:48:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:57.716 17:48:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:57.716 17:48:35 -- scripts/common.sh@367 -- # return 0 00:28:57.716 17:48:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:57.716 17:48:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:57.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:57.716 --rc genhtml_branch_coverage=1 00:28:57.716 --rc genhtml_function_coverage=1 00:28:57.716 --rc genhtml_legend=1 00:28:57.716 --rc geninfo_all_blocks=1 00:28:57.716 --rc geninfo_unexecuted_blocks=1 00:28:57.716 00:28:57.716 ' 00:28:57.716 17:48:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:57.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:57.716 --rc genhtml_branch_coverage=1 00:28:57.716 --rc genhtml_function_coverage=1 00:28:57.716 --rc genhtml_legend=1 00:28:57.716 --rc geninfo_all_blocks=1 00:28:57.716 --rc geninfo_unexecuted_blocks=1 00:28:57.716 00:28:57.716 ' 00:28:57.716 17:48:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:57.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:57.716 --rc genhtml_branch_coverage=1 00:28:57.716 --rc genhtml_function_coverage=1 00:28:57.716 --rc genhtml_legend=1 00:28:57.716 --rc geninfo_all_blocks=1 00:28:57.716 --rc geninfo_unexecuted_blocks=1 00:28:57.716 00:28:57.716 ' 00:28:57.716 17:48:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:57.716 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:57.716 --rc genhtml_branch_coverage=1 00:28:57.716 --rc genhtml_function_coverage=1 00:28:57.716 --rc genhtml_legend=1 00:28:57.716 --rc geninfo_all_blocks=1 00:28:57.716 --rc geninfo_unexecuted_blocks=1 00:28:57.716 00:28:57.716 ' 00:28:57.716 17:48:35 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:57.716 17:48:35 -- nvmf/common.sh@7 -- # uname -s 00:28:57.716 17:48:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:57.716 17:48:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:57.716 17:48:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:57.716 17:48:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:57.716 17:48:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:57.716 17:48:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:57.716 17:48:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:57.716 17:48:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:57.716 17:48:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:57.716 17:48:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:57.716 17:48:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:57.716 17:48:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:57.716 17:48:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:57.716 17:48:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:57.716 17:48:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:57.716 17:48:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:57.716 17:48:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:57.716 17:48:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:57.716 17:48:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:57.716 17:48:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:57.716 17:48:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:57.716 17:48:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:57.716 17:48:35 -- paths/export.sh@5 -- # export PATH 00:28:57.716 17:48:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:57.716 17:48:35 -- nvmf/common.sh@46 -- # : 0 00:28:57.716 17:48:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:57.716 17:48:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:57.716 17:48:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:57.716 17:48:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:57.716 17:48:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:57.716 17:48:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:57.716 17:48:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:57.716 17:48:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:57.716 17:48:35 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:57.716 17:48:35 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:57.716 17:48:35 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:57.717 17:48:35 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:57.717 17:48:35 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:57.717 17:48:35 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:57.717 17:48:35 -- host/discovery.sh@25 -- # nvmftestinit 00:28:57.717 17:48:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:57.717 17:48:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:57.717 17:48:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:57.717 17:48:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:57.717 17:48:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:57.717 17:48:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:57.717 17:48:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:57.717 17:48:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:57.717 17:48:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:57.717 17:48:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:57.717 17:48:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:57.717 17:48:35 -- common/autotest_common.sh@10 -- # set +x 00:28:59.623 17:48:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:59.623 17:48:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:59.623 17:48:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:59.623 17:48:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:59.623 17:48:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:59.623 17:48:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:59.623 17:48:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:59.623 17:48:37 -- nvmf/common.sh@294 -- # net_devs=() 00:28:59.623 17:48:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:59.623 17:48:37 -- nvmf/common.sh@295 -- # e810=() 00:28:59.623 17:48:37 -- nvmf/common.sh@295 -- # local -ga e810 00:28:59.623 17:48:37 -- nvmf/common.sh@296 -- # x722=() 00:28:59.623 17:48:37 -- nvmf/common.sh@296 -- # local -ga x722 00:28:59.623 17:48:37 -- nvmf/common.sh@297 -- # mlx=() 00:28:59.623 17:48:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:59.623 17:48:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:59.623 17:48:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:59.623 17:48:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:59.623 17:48:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:59.623 17:48:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:59.623 17:48:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:59.623 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:59.623 17:48:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:59.623 17:48:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:59.623 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:59.623 17:48:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:59.623 17:48:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:59.623 17:48:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:59.623 17:48:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:59.623 17:48:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:59.623 17:48:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:59.623 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:59.623 17:48:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:59.623 17:48:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:59.623 17:48:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:59.623 17:48:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:59.623 17:48:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:59.623 17:48:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:59.623 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:59.623 17:48:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:59.623 17:48:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:59.623 17:48:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:59.623 17:48:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:59.623 17:48:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:59.623 17:48:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:59.623 17:48:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:59.623 17:48:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:59.623 17:48:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:59.623 17:48:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:59.623 17:48:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:59.623 17:48:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:59.623 17:48:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:59.623 17:48:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:59.623 17:48:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:59.623 17:48:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:59.623 17:48:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:59.623 17:48:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:59.623 17:48:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:59.623 17:48:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:59.623 17:48:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:59.623 17:48:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:59.883 17:48:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:59.883 17:48:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:59.883 17:48:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:59.883 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:59.883 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:28:59.883 00:28:59.884 --- 10.0.0.2 ping statistics --- 00:28:59.884 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:59.884 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:28:59.884 17:48:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:59.884 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:59.884 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:28:59.884 00:28:59.884 --- 10.0.0.1 ping statistics --- 00:28:59.884 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:59.884 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:28:59.884 17:48:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:59.884 17:48:37 -- nvmf/common.sh@410 -- # return 0 00:28:59.884 17:48:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:59.884 17:48:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:59.884 17:48:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:59.884 17:48:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:59.884 17:48:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:59.884 17:48:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:59.884 17:48:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:59.884 17:48:37 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:59.884 17:48:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:59.884 17:48:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:59.884 17:48:37 -- common/autotest_common.sh@10 -- # set +x 00:28:59.884 17:48:37 -- nvmf/common.sh@469 -- # nvmfpid=1697349 00:28:59.884 17:48:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:59.884 17:48:37 -- nvmf/common.sh@470 -- # waitforlisten 1697349 00:28:59.884 17:48:37 -- common/autotest_common.sh@829 -- # '[' -z 1697349 ']' 00:28:59.884 17:48:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:59.884 17:48:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:59.884 17:48:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:59.884 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:59.884 17:48:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:59.884 17:48:37 -- common/autotest_common.sh@10 -- # set +x 00:28:59.884 [2024-11-16 17:48:37.225958] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:59.884 [2024-11-16 17:48:37.226058] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:59.884 EAL: No free 2048 kB hugepages reported on node 1 00:28:59.884 [2024-11-16 17:48:37.289902] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:00.142 [2024-11-16 17:48:37.380298] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:00.142 [2024-11-16 17:48:37.380452] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:00.142 [2024-11-16 17:48:37.380469] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:00.142 [2024-11-16 17:48:37.380481] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:00.142 [2024-11-16 17:48:37.380508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:01.076 17:48:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:01.076 17:48:38 -- common/autotest_common.sh@862 -- # return 0 00:29:01.076 17:48:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:01.076 17:48:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:01.076 17:48:38 -- common/autotest_common.sh@10 -- # set +x 00:29:01.076 17:48:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:01.076 17:48:38 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:01.076 17:48:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.076 17:48:38 -- common/autotest_common.sh@10 -- # set +x 00:29:01.076 [2024-11-16 17:48:38.275557] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:01.076 17:48:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.076 17:48:38 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:29:01.076 17:48:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.076 17:48:38 -- common/autotest_common.sh@10 -- # set +x 00:29:01.076 [2024-11-16 17:48:38.283776] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:01.076 17:48:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.076 17:48:38 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:29:01.076 17:48:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.076 17:48:38 -- common/autotest_common.sh@10 -- # set +x 00:29:01.076 null0 00:29:01.076 17:48:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.076 17:48:38 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:29:01.076 17:48:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.076 17:48:38 -- common/autotest_common.sh@10 -- # set +x 00:29:01.076 null1 00:29:01.076 17:48:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.076 17:48:38 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:29:01.076 17:48:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.076 17:48:38 -- common/autotest_common.sh@10 -- # set +x 00:29:01.076 17:48:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.076 17:48:38 -- host/discovery.sh@45 -- # hostpid=1697508 00:29:01.076 17:48:38 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:29:01.076 17:48:38 -- host/discovery.sh@46 -- # waitforlisten 1697508 /tmp/host.sock 00:29:01.076 17:48:38 -- common/autotest_common.sh@829 -- # '[' -z 1697508 ']' 00:29:01.076 17:48:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:01.076 17:48:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:01.076 17:48:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:01.076 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:01.076 17:48:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:01.076 17:48:38 -- common/autotest_common.sh@10 -- # set +x 00:29:01.076 [2024-11-16 17:48:38.357012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:01.076 [2024-11-16 17:48:38.357089] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1697508 ] 00:29:01.076 EAL: No free 2048 kB hugepages reported on node 1 00:29:01.076 [2024-11-16 17:48:38.424263] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:01.076 [2024-11-16 17:48:38.513953] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:01.076 [2024-11-16 17:48:38.514099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:02.013 17:48:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:02.013 17:48:39 -- common/autotest_common.sh@862 -- # return 0 00:29:02.013 17:48:39 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:02.013 17:48:39 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:29:02.013 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.013 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.013 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.013 17:48:39 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:29:02.013 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.013 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.013 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.013 17:48:39 -- host/discovery.sh@72 -- # notify_id=0 00:29:02.013 17:48:39 -- host/discovery.sh@78 -- # get_subsystem_names 00:29:02.013 17:48:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.013 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.013 17:48:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.013 17:48:39 -- host/discovery.sh@59 -- # sort 00:29:02.013 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.013 17:48:39 -- host/discovery.sh@59 -- # xargs 00:29:02.013 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.013 17:48:39 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:29:02.013 17:48:39 -- host/discovery.sh@79 -- # get_bdev_list 00:29:02.013 17:48:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.013 17:48:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.013 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.013 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.013 17:48:39 -- host/discovery.sh@55 -- # sort 00:29:02.013 17:48:39 -- host/discovery.sh@55 -- # xargs 00:29:02.013 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.013 17:48:39 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:29:02.013 17:48:39 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:29:02.013 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.013 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.013 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.013 17:48:39 -- host/discovery.sh@82 -- # get_subsystem_names 00:29:02.013 17:48:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.013 17:48:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.013 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.013 17:48:39 -- host/discovery.sh@59 -- # sort 00:29:02.013 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.013 17:48:39 -- host/discovery.sh@59 -- # xargs 00:29:02.271 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.271 17:48:39 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:29:02.271 17:48:39 -- host/discovery.sh@83 -- # get_bdev_list 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.271 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # sort 00:29:02.271 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # xargs 00:29:02.271 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.271 17:48:39 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:29:02.271 17:48:39 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:29:02.271 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.271 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.271 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.271 17:48:39 -- host/discovery.sh@86 -- # get_subsystem_names 00:29:02.271 17:48:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.271 17:48:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.271 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.271 17:48:39 -- host/discovery.sh@59 -- # sort 00:29:02.271 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.271 17:48:39 -- host/discovery.sh@59 -- # xargs 00:29:02.271 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.271 17:48:39 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:29:02.271 17:48:39 -- host/discovery.sh@87 -- # get_bdev_list 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.271 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # sort 00:29:02.271 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # xargs 00:29:02.271 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.271 17:48:39 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:29:02.271 17:48:39 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:02.271 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.271 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.271 [2024-11-16 17:48:39.683575] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:02.271 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.271 17:48:39 -- host/discovery.sh@92 -- # get_subsystem_names 00:29:02.271 17:48:39 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.271 17:48:39 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.271 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.271 17:48:39 -- host/discovery.sh@59 -- # sort 00:29:02.271 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.271 17:48:39 -- host/discovery.sh@59 -- # xargs 00:29:02.271 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.271 17:48:39 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:29:02.271 17:48:39 -- host/discovery.sh@93 -- # get_bdev_list 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.271 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.271 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # sort 00:29:02.271 17:48:39 -- host/discovery.sh@55 -- # xargs 00:29:02.271 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.530 17:48:39 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:29:02.530 17:48:39 -- host/discovery.sh@94 -- # get_notification_count 00:29:02.530 17:48:39 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:02.530 17:48:39 -- host/discovery.sh@74 -- # jq '. | length' 00:29:02.530 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.530 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.530 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.530 17:48:39 -- host/discovery.sh@74 -- # notification_count=0 00:29:02.530 17:48:39 -- host/discovery.sh@75 -- # notify_id=0 00:29:02.530 17:48:39 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:29:02.530 17:48:39 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:29:02.530 17:48:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.530 17:48:39 -- common/autotest_common.sh@10 -- # set +x 00:29:02.530 17:48:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.530 17:48:39 -- host/discovery.sh@100 -- # sleep 1 00:29:03.099 [2024-11-16 17:48:40.404514] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:03.099 [2024-11-16 17:48:40.404554] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:03.099 [2024-11-16 17:48:40.404581] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:03.099 [2024-11-16 17:48:40.491853] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:03.099 [2024-11-16 17:48:40.555629] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:03.099 [2024-11-16 17:48:40.555681] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:03.358 17:48:40 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:03.358 17:48:40 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:03.358 17:48:40 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:03.358 17:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.358 17:48:40 -- common/autotest_common.sh@10 -- # set +x 00:29:03.358 17:48:40 -- host/discovery.sh@59 -- # sort 00:29:03.358 17:48:40 -- host/discovery.sh@59 -- # xargs 00:29:03.358 17:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.616 17:48:40 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:03.616 17:48:40 -- host/discovery.sh@102 -- # get_bdev_list 00:29:03.616 17:48:40 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.616 17:48:40 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:03.616 17:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.616 17:48:40 -- common/autotest_common.sh@10 -- # set +x 00:29:03.616 17:48:40 -- host/discovery.sh@55 -- # sort 00:29:03.616 17:48:40 -- host/discovery.sh@55 -- # xargs 00:29:03.616 17:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.616 17:48:40 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:03.616 17:48:40 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:03.616 17:48:40 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:03.616 17:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.616 17:48:40 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:03.616 17:48:40 -- common/autotest_common.sh@10 -- # set +x 00:29:03.616 17:48:40 -- host/discovery.sh@63 -- # sort -n 00:29:03.616 17:48:40 -- host/discovery.sh@63 -- # xargs 00:29:03.616 17:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.616 17:48:40 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:03.616 17:48:40 -- host/discovery.sh@104 -- # get_notification_count 00:29:03.616 17:48:40 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:03.616 17:48:40 -- host/discovery.sh@74 -- # jq '. | length' 00:29:03.616 17:48:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.616 17:48:40 -- common/autotest_common.sh@10 -- # set +x 00:29:03.616 17:48:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.616 17:48:40 -- host/discovery.sh@74 -- # notification_count=1 00:29:03.616 17:48:40 -- host/discovery.sh@75 -- # notify_id=1 00:29:03.616 17:48:40 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:03.616 17:48:41 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:03.616 17:48:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.616 17:48:41 -- common/autotest_common.sh@10 -- # set +x 00:29:03.616 17:48:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.616 17:48:41 -- host/discovery.sh@109 -- # sleep 1 00:29:04.553 17:48:42 -- host/discovery.sh@110 -- # get_bdev_list 00:29:04.553 17:48:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:04.553 17:48:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:04.553 17:48:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.553 17:48:42 -- host/discovery.sh@55 -- # sort 00:29:04.553 17:48:42 -- common/autotest_common.sh@10 -- # set +x 00:29:04.553 17:48:42 -- host/discovery.sh@55 -- # xargs 00:29:04.553 17:48:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 17:48:42 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:04.812 17:48:42 -- host/discovery.sh@111 -- # get_notification_count 00:29:04.812 17:48:42 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:04.812 17:48:42 -- host/discovery.sh@74 -- # jq '. | length' 00:29:04.812 17:48:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 17:48:42 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 17:48:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 17:48:42 -- host/discovery.sh@74 -- # notification_count=1 00:29:04.812 17:48:42 -- host/discovery.sh@75 -- # notify_id=2 00:29:04.812 17:48:42 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:04.812 17:48:42 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:04.812 17:48:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.812 17:48:42 -- common/autotest_common.sh@10 -- # set +x 00:29:04.812 [2024-11-16 17:48:42.107082] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:04.812 [2024-11-16 17:48:42.108085] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:04.812 [2024-11-16 17:48:42.108124] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:04.812 17:48:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.812 17:48:42 -- host/discovery.sh@117 -- # sleep 1 00:29:04.812 [2024-11-16 17:48:42.194341] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:05.071 [2024-11-16 17:48:42.492825] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:05.071 [2024-11-16 17:48:42.492849] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:05.071 [2024-11-16 17:48:42.492859] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:05.638 17:48:43 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:05.638 17:48:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:05.638 17:48:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:05.638 17:48:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.638 17:48:43 -- host/discovery.sh@59 -- # sort 00:29:05.638 17:48:43 -- common/autotest_common.sh@10 -- # set +x 00:29:05.638 17:48:43 -- host/discovery.sh@59 -- # xargs 00:29:05.638 17:48:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@119 -- # get_bdev_list 00:29:05.899 17:48:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:05.899 17:48:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.899 17:48:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:05.899 17:48:43 -- common/autotest_common.sh@10 -- # set +x 00:29:05.899 17:48:43 -- host/discovery.sh@55 -- # sort 00:29:05.899 17:48:43 -- host/discovery.sh@55 -- # xargs 00:29:05.899 17:48:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:05.899 17:48:43 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:05.899 17:48:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.899 17:48:43 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:05.899 17:48:43 -- common/autotest_common.sh@10 -- # set +x 00:29:05.899 17:48:43 -- host/discovery.sh@63 -- # sort -n 00:29:05.899 17:48:43 -- host/discovery.sh@63 -- # xargs 00:29:05.899 17:48:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@121 -- # get_notification_count 00:29:05.899 17:48:43 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:05.899 17:48:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.899 17:48:43 -- host/discovery.sh@74 -- # jq '. | length' 00:29:05.899 17:48:43 -- common/autotest_common.sh@10 -- # set +x 00:29:05.899 17:48:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@74 -- # notification_count=0 00:29:05.899 17:48:43 -- host/discovery.sh@75 -- # notify_id=2 00:29:05.899 17:48:43 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:05.899 17:48:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.899 17:48:43 -- common/autotest_common.sh@10 -- # set +x 00:29:05.899 [2024-11-16 17:48:43.282565] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:05.899 [2024-11-16 17:48:43.282600] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:05.899 17:48:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.899 17:48:43 -- host/discovery.sh@127 -- # sleep 1 00:29:05.899 [2024-11-16 17:48:43.289246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:05.899 [2024-11-16 17:48:43.289279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:05.899 [2024-11-16 17:48:43.289312] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:05.899 [2024-11-16 17:48:43.289327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:05.899 [2024-11-16 17:48:43.289341] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:05.899 [2024-11-16 17:48:43.289354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:05.899 [2024-11-16 17:48:43.289369] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:05.899 [2024-11-16 17:48:43.289382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:05.899 [2024-11-16 17:48:43.289395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1413410 is same with the state(5) to be set 00:29:05.899 [2024-11-16 17:48:43.299239] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1413410 (9): Bad file descriptor 00:29:05.899 [2024-11-16 17:48:43.309289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:05.899 [2024-11-16 17:48:43.309585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.899 [2024-11-16 17:48:43.309774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.899 [2024-11-16 17:48:43.309801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1413410 with addr=10.0.0.2, port=4420 00:29:05.899 [2024-11-16 17:48:43.309819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1413410 is same with the state(5) to be set 00:29:05.899 [2024-11-16 17:48:43.309842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1413410 (9): Bad file descriptor 00:29:05.899 [2024-11-16 17:48:43.309889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:05.899 [2024-11-16 17:48:43.309908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:05.899 [2024-11-16 17:48:43.309924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:05.899 [2024-11-16 17:48:43.309945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:05.900 [2024-11-16 17:48:43.319362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:05.900 [2024-11-16 17:48:43.319517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.319654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.319690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1413410 with addr=10.0.0.2, port=4420 00:29:05.900 [2024-11-16 17:48:43.319706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1413410 is same with the state(5) to be set 00:29:05.900 [2024-11-16 17:48:43.319737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1413410 (9): Bad file descriptor 00:29:05.900 [2024-11-16 17:48:43.319757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:05.900 [2024-11-16 17:48:43.319771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:05.900 [2024-11-16 17:48:43.319784] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:05.900 [2024-11-16 17:48:43.319804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:05.900 [2024-11-16 17:48:43.329431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:05.900 [2024-11-16 17:48:43.329630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.329783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.329810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1413410 with addr=10.0.0.2, port=4420 00:29:05.900 [2024-11-16 17:48:43.329825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1413410 is same with the state(5) to be set 00:29:05.900 [2024-11-16 17:48:43.329847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1413410 (9): Bad file descriptor 00:29:05.900 [2024-11-16 17:48:43.329866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:05.900 [2024-11-16 17:48:43.329879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:05.900 [2024-11-16 17:48:43.329892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:05.900 [2024-11-16 17:48:43.329912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:05.900 [2024-11-16 17:48:43.339500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:05.900 [2024-11-16 17:48:43.339630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.339776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.339801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1413410 with addr=10.0.0.2, port=4420 00:29:05.900 [2024-11-16 17:48:43.339818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1413410 is same with the state(5) to be set 00:29:05.900 [2024-11-16 17:48:43.339840] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1413410 (9): Bad file descriptor 00:29:05.900 [2024-11-16 17:48:43.339859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:05.900 [2024-11-16 17:48:43.339872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:05.900 [2024-11-16 17:48:43.339885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:05.900 [2024-11-16 17:48:43.339904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:05.900 [2024-11-16 17:48:43.349568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:05.900 [2024-11-16 17:48:43.349782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.349909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.349934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1413410 with addr=10.0.0.2, port=4420 00:29:05.900 [2024-11-16 17:48:43.349950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1413410 is same with the state(5) to be set 00:29:05.900 [2024-11-16 17:48:43.349972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1413410 (9): Bad file descriptor 00:29:05.900 [2024-11-16 17:48:43.349998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:05.900 [2024-11-16 17:48:43.350012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:05.900 [2024-11-16 17:48:43.350025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:05.900 [2024-11-16 17:48:43.350057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:05.900 [2024-11-16 17:48:43.359637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:05.900 [2024-11-16 17:48:43.359825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.359972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.900 [2024-11-16 17:48:43.359996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1413410 with addr=10.0.0.2, port=4420 00:29:05.900 [2024-11-16 17:48:43.360012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1413410 is same with the state(5) to be set 00:29:05.900 [2024-11-16 17:48:43.360034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1413410 (9): Bad file descriptor 00:29:05.900 [2024-11-16 17:48:43.360053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:05.900 [2024-11-16 17:48:43.360067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:05.900 [2024-11-16 17:48:43.360080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:05.900 [2024-11-16 17:48:43.360098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:05.900 [2024-11-16 17:48:43.369178] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:05.900 [2024-11-16 17:48:43.369207] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:06.838 17:48:44 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:06.838 17:48:44 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:06.838 17:48:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.838 17:48:44 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:06.838 17:48:44 -- common/autotest_common.sh@10 -- # set +x 00:29:06.838 17:48:44 -- host/discovery.sh@59 -- # sort 00:29:06.838 17:48:44 -- host/discovery.sh@59 -- # xargs 00:29:06.838 17:48:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@129 -- # get_bdev_list 00:29:07.097 17:48:44 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:07.097 17:48:44 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:07.097 17:48:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.097 17:48:44 -- host/discovery.sh@55 -- # sort 00:29:07.097 17:48:44 -- common/autotest_common.sh@10 -- # set +x 00:29:07.097 17:48:44 -- host/discovery.sh@55 -- # xargs 00:29:07.097 17:48:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:07.097 17:48:44 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:07.097 17:48:44 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:07.097 17:48:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.097 17:48:44 -- common/autotest_common.sh@10 -- # set +x 00:29:07.097 17:48:44 -- host/discovery.sh@63 -- # sort -n 00:29:07.097 17:48:44 -- host/discovery.sh@63 -- # xargs 00:29:07.097 17:48:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@131 -- # get_notification_count 00:29:07.097 17:48:44 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:07.097 17:48:44 -- host/discovery.sh@74 -- # jq '. | length' 00:29:07.097 17:48:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.097 17:48:44 -- common/autotest_common.sh@10 -- # set +x 00:29:07.097 17:48:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@74 -- # notification_count=0 00:29:07.097 17:48:44 -- host/discovery.sh@75 -- # notify_id=2 00:29:07.097 17:48:44 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:07.097 17:48:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.097 17:48:44 -- common/autotest_common.sh@10 -- # set +x 00:29:07.097 17:48:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.097 17:48:44 -- host/discovery.sh@135 -- # sleep 1 00:29:08.033 17:48:45 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:08.033 17:48:45 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:08.033 17:48:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.033 17:48:45 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:08.033 17:48:45 -- common/autotest_common.sh@10 -- # set +x 00:29:08.033 17:48:45 -- host/discovery.sh@59 -- # sort 00:29:08.033 17:48:45 -- host/discovery.sh@59 -- # xargs 00:29:08.033 17:48:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.033 17:48:45 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:08.033 17:48:45 -- host/discovery.sh@137 -- # get_bdev_list 00:29:08.033 17:48:45 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:08.033 17:48:45 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:08.033 17:48:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.033 17:48:45 -- host/discovery.sh@55 -- # sort 00:29:08.033 17:48:45 -- common/autotest_common.sh@10 -- # set +x 00:29:08.033 17:48:45 -- host/discovery.sh@55 -- # xargs 00:29:08.291 17:48:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.291 17:48:45 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:08.291 17:48:45 -- host/discovery.sh@138 -- # get_notification_count 00:29:08.291 17:48:45 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:08.291 17:48:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.291 17:48:45 -- common/autotest_common.sh@10 -- # set +x 00:29:08.291 17:48:45 -- host/discovery.sh@74 -- # jq '. | length' 00:29:08.291 17:48:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.291 17:48:45 -- host/discovery.sh@74 -- # notification_count=2 00:29:08.291 17:48:45 -- host/discovery.sh@75 -- # notify_id=4 00:29:08.291 17:48:45 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:08.291 17:48:45 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:08.291 17:48:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.291 17:48:45 -- common/autotest_common.sh@10 -- # set +x 00:29:09.221 [2024-11-16 17:48:46.651193] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:09.221 [2024-11-16 17:48:46.651224] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:09.221 [2024-11-16 17:48:46.651249] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:09.477 [2024-11-16 17:48:46.779657] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:09.477 [2024-11-16 17:48:46.886078] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:09.477 [2024-11-16 17:48:46.886119] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:09.477 17:48:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.477 17:48:46 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.477 17:48:46 -- common/autotest_common.sh@650 -- # local es=0 00:29:09.477 17:48:46 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.477 17:48:46 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:09.477 17:48:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.477 17:48:46 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:09.477 17:48:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.477 17:48:46 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.477 17:48:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.477 17:48:46 -- common/autotest_common.sh@10 -- # set +x 00:29:09.477 request: 00:29:09.477 { 00:29:09.477 "name": "nvme", 00:29:09.477 "trtype": "tcp", 00:29:09.477 "traddr": "10.0.0.2", 00:29:09.477 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:09.477 "adrfam": "ipv4", 00:29:09.477 "trsvcid": "8009", 00:29:09.477 "wait_for_attach": true, 00:29:09.477 "method": "bdev_nvme_start_discovery", 00:29:09.477 "req_id": 1 00:29:09.477 } 00:29:09.477 Got JSON-RPC error response 00:29:09.477 response: 00:29:09.477 { 00:29:09.477 "code": -17, 00:29:09.477 "message": "File exists" 00:29:09.477 } 00:29:09.477 17:48:46 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:09.477 17:48:46 -- common/autotest_common.sh@653 -- # es=1 00:29:09.477 17:48:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:09.477 17:48:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:09.477 17:48:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:09.477 17:48:46 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:09.477 17:48:46 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:09.477 17:48:46 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:09.477 17:48:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.477 17:48:46 -- host/discovery.sh@67 -- # sort 00:29:09.477 17:48:46 -- common/autotest_common.sh@10 -- # set +x 00:29:09.477 17:48:46 -- host/discovery.sh@67 -- # xargs 00:29:09.477 17:48:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.477 17:48:46 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:09.477 17:48:46 -- host/discovery.sh@147 -- # get_bdev_list 00:29:09.477 17:48:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.477 17:48:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.477 17:48:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:09.477 17:48:46 -- common/autotest_common.sh@10 -- # set +x 00:29:09.477 17:48:46 -- host/discovery.sh@55 -- # sort 00:29:09.477 17:48:46 -- host/discovery.sh@55 -- # xargs 00:29:09.477 17:48:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.734 17:48:46 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:09.734 17:48:46 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.734 17:48:46 -- common/autotest_common.sh@650 -- # local es=0 00:29:09.734 17:48:46 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.734 17:48:46 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:09.734 17:48:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.734 17:48:46 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:09.734 17:48:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.734 17:48:46 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:09.734 17:48:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.734 17:48:46 -- common/autotest_common.sh@10 -- # set +x 00:29:09.734 request: 00:29:09.734 { 00:29:09.734 "name": "nvme_second", 00:29:09.734 "trtype": "tcp", 00:29:09.734 "traddr": "10.0.0.2", 00:29:09.734 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:09.734 "adrfam": "ipv4", 00:29:09.734 "trsvcid": "8009", 00:29:09.734 "wait_for_attach": true, 00:29:09.734 "method": "bdev_nvme_start_discovery", 00:29:09.734 "req_id": 1 00:29:09.734 } 00:29:09.734 Got JSON-RPC error response 00:29:09.734 response: 00:29:09.734 { 00:29:09.734 "code": -17, 00:29:09.734 "message": "File exists" 00:29:09.734 } 00:29:09.734 17:48:46 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:09.734 17:48:46 -- common/autotest_common.sh@653 -- # es=1 00:29:09.734 17:48:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:09.734 17:48:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:09.735 17:48:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:09.735 17:48:46 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:09.735 17:48:46 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:09.735 17:48:46 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:09.735 17:48:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.735 17:48:46 -- common/autotest_common.sh@10 -- # set +x 00:29:09.735 17:48:46 -- host/discovery.sh@67 -- # sort 00:29:09.735 17:48:46 -- host/discovery.sh@67 -- # xargs 00:29:09.735 17:48:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.735 17:48:47 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:09.735 17:48:47 -- host/discovery.sh@153 -- # get_bdev_list 00:29:09.735 17:48:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:09.735 17:48:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:09.735 17:48:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.735 17:48:47 -- host/discovery.sh@55 -- # sort 00:29:09.735 17:48:47 -- common/autotest_common.sh@10 -- # set +x 00:29:09.735 17:48:47 -- host/discovery.sh@55 -- # xargs 00:29:09.735 17:48:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:09.735 17:48:47 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:09.735 17:48:47 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:09.735 17:48:47 -- common/autotest_common.sh@650 -- # local es=0 00:29:09.735 17:48:47 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:09.735 17:48:47 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:09.735 17:48:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.735 17:48:47 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:09.735 17:48:47 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:09.735 17:48:47 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:09.735 17:48:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:09.735 17:48:47 -- common/autotest_common.sh@10 -- # set +x 00:29:10.667 [2024-11-16 17:48:48.090224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.667 [2024-11-16 17:48:48.090418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:10.667 [2024-11-16 17:48:48.090447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138a2e0 with addr=10.0.0.2, port=8010 00:29:10.667 [2024-11-16 17:48:48.090480] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:10.667 [2024-11-16 17:48:48.090496] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:10.667 [2024-11-16 17:48:48.090511] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:11.639 [2024-11-16 17:48:49.092598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.639 [2024-11-16 17:48:49.092817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:11.639 [2024-11-16 17:48:49.092843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138a2e0 with addr=10.0.0.2, port=8010 00:29:11.639 [2024-11-16 17:48:49.092862] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:11.639 [2024-11-16 17:48:49.092875] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:11.639 [2024-11-16 17:48:49.092887] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:13.038 [2024-11-16 17:48:50.094823] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:13.038 request: 00:29:13.038 { 00:29:13.038 "name": "nvme_second", 00:29:13.038 "trtype": "tcp", 00:29:13.038 "traddr": "10.0.0.2", 00:29:13.038 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:13.038 "adrfam": "ipv4", 00:29:13.038 "trsvcid": "8010", 00:29:13.038 "attach_timeout_ms": 3000, 00:29:13.038 "method": "bdev_nvme_start_discovery", 00:29:13.038 "req_id": 1 00:29:13.038 } 00:29:13.038 Got JSON-RPC error response 00:29:13.038 response: 00:29:13.038 { 00:29:13.038 "code": -110, 00:29:13.038 "message": "Connection timed out" 00:29:13.039 } 00:29:13.039 17:48:50 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:13.039 17:48:50 -- common/autotest_common.sh@653 -- # es=1 00:29:13.039 17:48:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:13.039 17:48:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:13.039 17:48:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:13.039 17:48:50 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:13.039 17:48:50 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:13.039 17:48:50 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:13.039 17:48:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.039 17:48:50 -- host/discovery.sh@67 -- # sort 00:29:13.039 17:48:50 -- common/autotest_common.sh@10 -- # set +x 00:29:13.039 17:48:50 -- host/discovery.sh@67 -- # xargs 00:29:13.039 17:48:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.039 17:48:50 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:13.039 17:48:50 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:13.039 17:48:50 -- host/discovery.sh@162 -- # kill 1697508 00:29:13.039 17:48:50 -- host/discovery.sh@163 -- # nvmftestfini 00:29:13.039 17:48:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:13.039 17:48:50 -- nvmf/common.sh@116 -- # sync 00:29:13.039 17:48:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:13.039 17:48:50 -- nvmf/common.sh@119 -- # set +e 00:29:13.039 17:48:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:13.039 17:48:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:13.039 rmmod nvme_tcp 00:29:13.039 rmmod nvme_fabrics 00:29:13.039 rmmod nvme_keyring 00:29:13.039 17:48:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:13.039 17:48:50 -- nvmf/common.sh@123 -- # set -e 00:29:13.039 17:48:50 -- nvmf/common.sh@124 -- # return 0 00:29:13.039 17:48:50 -- nvmf/common.sh@477 -- # '[' -n 1697349 ']' 00:29:13.039 17:48:50 -- nvmf/common.sh@478 -- # killprocess 1697349 00:29:13.039 17:48:50 -- common/autotest_common.sh@936 -- # '[' -z 1697349 ']' 00:29:13.039 17:48:50 -- common/autotest_common.sh@940 -- # kill -0 1697349 00:29:13.039 17:48:50 -- common/autotest_common.sh@941 -- # uname 00:29:13.039 17:48:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:13.039 17:48:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1697349 00:29:13.039 17:48:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:13.039 17:48:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:13.039 17:48:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1697349' 00:29:13.039 killing process with pid 1697349 00:29:13.039 17:48:50 -- common/autotest_common.sh@955 -- # kill 1697349 00:29:13.039 17:48:50 -- common/autotest_common.sh@960 -- # wait 1697349 00:29:13.039 17:48:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:13.039 17:48:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:13.039 17:48:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:13.039 17:48:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:13.039 17:48:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:13.039 17:48:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:13.039 17:48:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:13.039 17:48:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:15.577 17:48:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:15.577 00:29:15.577 real 0m17.546s 00:29:15.577 user 0m27.417s 00:29:15.577 sys 0m2.918s 00:29:15.577 17:48:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:15.577 17:48:52 -- common/autotest_common.sh@10 -- # set +x 00:29:15.577 ************************************ 00:29:15.577 END TEST nvmf_discovery 00:29:15.577 ************************************ 00:29:15.577 17:48:52 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:15.577 17:48:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:15.577 17:48:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:15.577 17:48:52 -- common/autotest_common.sh@10 -- # set +x 00:29:15.577 ************************************ 00:29:15.577 START TEST nvmf_discovery_remove_ifc 00:29:15.577 ************************************ 00:29:15.577 17:48:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:15.577 * Looking for test storage... 00:29:15.577 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:15.577 17:48:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:15.577 17:48:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:15.577 17:48:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:15.577 17:48:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:15.577 17:48:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:15.577 17:48:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:15.577 17:48:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:15.577 17:48:52 -- scripts/common.sh@335 -- # IFS=.-: 00:29:15.577 17:48:52 -- scripts/common.sh@335 -- # read -ra ver1 00:29:15.577 17:48:52 -- scripts/common.sh@336 -- # IFS=.-: 00:29:15.577 17:48:52 -- scripts/common.sh@336 -- # read -ra ver2 00:29:15.577 17:48:52 -- scripts/common.sh@337 -- # local 'op=<' 00:29:15.577 17:48:52 -- scripts/common.sh@339 -- # ver1_l=2 00:29:15.577 17:48:52 -- scripts/common.sh@340 -- # ver2_l=1 00:29:15.577 17:48:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:15.577 17:48:52 -- scripts/common.sh@343 -- # case "$op" in 00:29:15.577 17:48:52 -- scripts/common.sh@344 -- # : 1 00:29:15.577 17:48:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:15.577 17:48:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:15.577 17:48:52 -- scripts/common.sh@364 -- # decimal 1 00:29:15.577 17:48:52 -- scripts/common.sh@352 -- # local d=1 00:29:15.577 17:48:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:15.577 17:48:52 -- scripts/common.sh@354 -- # echo 1 00:29:15.577 17:48:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:15.577 17:48:52 -- scripts/common.sh@365 -- # decimal 2 00:29:15.577 17:48:52 -- scripts/common.sh@352 -- # local d=2 00:29:15.577 17:48:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:15.577 17:48:52 -- scripts/common.sh@354 -- # echo 2 00:29:15.577 17:48:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:15.577 17:48:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:15.577 17:48:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:15.577 17:48:52 -- scripts/common.sh@367 -- # return 0 00:29:15.577 17:48:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:15.577 17:48:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:15.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.577 --rc genhtml_branch_coverage=1 00:29:15.577 --rc genhtml_function_coverage=1 00:29:15.577 --rc genhtml_legend=1 00:29:15.577 --rc geninfo_all_blocks=1 00:29:15.577 --rc geninfo_unexecuted_blocks=1 00:29:15.577 00:29:15.577 ' 00:29:15.577 17:48:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:15.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.577 --rc genhtml_branch_coverage=1 00:29:15.577 --rc genhtml_function_coverage=1 00:29:15.577 --rc genhtml_legend=1 00:29:15.577 --rc geninfo_all_blocks=1 00:29:15.577 --rc geninfo_unexecuted_blocks=1 00:29:15.577 00:29:15.577 ' 00:29:15.577 17:48:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:15.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.578 --rc genhtml_branch_coverage=1 00:29:15.578 --rc genhtml_function_coverage=1 00:29:15.578 --rc genhtml_legend=1 00:29:15.578 --rc geninfo_all_blocks=1 00:29:15.578 --rc geninfo_unexecuted_blocks=1 00:29:15.578 00:29:15.578 ' 00:29:15.578 17:48:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:15.578 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:15.578 --rc genhtml_branch_coverage=1 00:29:15.578 --rc genhtml_function_coverage=1 00:29:15.578 --rc genhtml_legend=1 00:29:15.578 --rc geninfo_all_blocks=1 00:29:15.578 --rc geninfo_unexecuted_blocks=1 00:29:15.578 00:29:15.578 ' 00:29:15.578 17:48:52 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:15.578 17:48:52 -- nvmf/common.sh@7 -- # uname -s 00:29:15.578 17:48:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:15.578 17:48:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:15.578 17:48:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:15.578 17:48:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:15.578 17:48:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:15.578 17:48:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:15.578 17:48:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:15.578 17:48:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:15.578 17:48:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:15.578 17:48:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:15.578 17:48:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:15.578 17:48:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:15.578 17:48:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:15.578 17:48:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:15.578 17:48:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:15.578 17:48:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:15.578 17:48:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:15.578 17:48:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:15.578 17:48:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:15.578 17:48:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.578 17:48:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.578 17:48:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.578 17:48:52 -- paths/export.sh@5 -- # export PATH 00:29:15.578 17:48:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:15.578 17:48:52 -- nvmf/common.sh@46 -- # : 0 00:29:15.578 17:48:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:15.578 17:48:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:15.578 17:48:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:15.578 17:48:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:15.578 17:48:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:15.578 17:48:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:15.578 17:48:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:15.578 17:48:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:15.578 17:48:52 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:15.578 17:48:52 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:15.578 17:48:52 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:15.578 17:48:52 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:15.578 17:48:52 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:15.578 17:48:52 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:15.578 17:48:52 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:15.578 17:48:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:15.578 17:48:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:15.578 17:48:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:15.578 17:48:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:15.578 17:48:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:15.578 17:48:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:15.578 17:48:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:15.578 17:48:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:15.578 17:48:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:15.578 17:48:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:15.578 17:48:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:15.578 17:48:52 -- common/autotest_common.sh@10 -- # set +x 00:29:17.480 17:48:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:17.480 17:48:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:17.480 17:48:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:17.480 17:48:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:17.480 17:48:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:17.480 17:48:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:17.480 17:48:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:17.480 17:48:54 -- nvmf/common.sh@294 -- # net_devs=() 00:29:17.481 17:48:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:17.481 17:48:54 -- nvmf/common.sh@295 -- # e810=() 00:29:17.481 17:48:54 -- nvmf/common.sh@295 -- # local -ga e810 00:29:17.481 17:48:54 -- nvmf/common.sh@296 -- # x722=() 00:29:17.481 17:48:54 -- nvmf/common.sh@296 -- # local -ga x722 00:29:17.481 17:48:54 -- nvmf/common.sh@297 -- # mlx=() 00:29:17.481 17:48:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:17.481 17:48:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:17.481 17:48:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:17.481 17:48:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:17.481 17:48:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:17.481 17:48:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:17.481 17:48:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:17.481 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:17.481 17:48:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:17.481 17:48:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:17.481 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:17.481 17:48:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:17.481 17:48:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:17.481 17:48:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:17.481 17:48:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:17.481 17:48:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:17.481 17:48:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:17.481 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:17.481 17:48:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:17.481 17:48:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:17.481 17:48:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:17.481 17:48:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:17.481 17:48:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:17.481 17:48:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:17.481 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:17.481 17:48:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:17.481 17:48:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:17.481 17:48:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:17.481 17:48:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:17.481 17:48:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:17.481 17:48:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:17.481 17:48:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:17.481 17:48:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:17.481 17:48:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:17.481 17:48:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:17.481 17:48:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:17.481 17:48:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:17.481 17:48:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:17.481 17:48:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:17.481 17:48:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:17.481 17:48:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:17.481 17:48:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:17.481 17:48:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:17.481 17:48:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:17.481 17:48:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:17.481 17:48:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:17.481 17:48:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:17.481 17:48:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:17.481 17:48:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:17.481 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:17.481 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:29:17.481 00:29:17.481 --- 10.0.0.2 ping statistics --- 00:29:17.481 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:17.481 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:29:17.481 17:48:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:17.481 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:17.481 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:29:17.481 00:29:17.481 --- 10.0.0.1 ping statistics --- 00:29:17.481 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:17.481 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:29:17.481 17:48:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:17.481 17:48:54 -- nvmf/common.sh@410 -- # return 0 00:29:17.481 17:48:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:17.481 17:48:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:17.481 17:48:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:17.481 17:48:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:17.481 17:48:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:17.481 17:48:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:17.481 17:48:54 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:17.481 17:48:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:17.481 17:48:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:17.481 17:48:54 -- common/autotest_common.sh@10 -- # set +x 00:29:17.481 17:48:54 -- nvmf/common.sh@469 -- # nvmfpid=1700992 00:29:17.481 17:48:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:17.481 17:48:54 -- nvmf/common.sh@470 -- # waitforlisten 1700992 00:29:17.481 17:48:54 -- common/autotest_common.sh@829 -- # '[' -z 1700992 ']' 00:29:17.481 17:48:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:17.481 17:48:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:17.481 17:48:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:17.481 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:17.481 17:48:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:17.481 17:48:54 -- common/autotest_common.sh@10 -- # set +x 00:29:17.740 [2024-11-16 17:48:54.989821] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:17.740 [2024-11-16 17:48:54.989909] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:17.740 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.740 [2024-11-16 17:48:55.056981] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:17.740 [2024-11-16 17:48:55.142219] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:17.740 [2024-11-16 17:48:55.142375] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:17.740 [2024-11-16 17:48:55.142406] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:17.740 [2024-11-16 17:48:55.142419] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:17.740 [2024-11-16 17:48:55.142446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:18.673 17:48:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:18.673 17:48:56 -- common/autotest_common.sh@862 -- # return 0 00:29:18.674 17:48:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:18.674 17:48:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:18.674 17:48:56 -- common/autotest_common.sh@10 -- # set +x 00:29:18.674 17:48:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:18.674 17:48:56 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:18.674 17:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.674 17:48:56 -- common/autotest_common.sh@10 -- # set +x 00:29:18.674 [2024-11-16 17:48:56.046116] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:18.674 [2024-11-16 17:48:56.054264] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:18.674 null0 00:29:18.674 [2024-11-16 17:48:56.086253] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:18.674 17:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.674 17:48:56 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1701149 00:29:18.674 17:48:56 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:18.674 17:48:56 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1701149 /tmp/host.sock 00:29:18.674 17:48:56 -- common/autotest_common.sh@829 -- # '[' -z 1701149 ']' 00:29:18.674 17:48:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:18.674 17:48:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:18.674 17:48:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:18.674 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:18.674 17:48:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:18.674 17:48:56 -- common/autotest_common.sh@10 -- # set +x 00:29:18.674 [2024-11-16 17:48:56.150082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:18.674 [2024-11-16 17:48:56.150147] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1701149 ] 00:29:18.932 EAL: No free 2048 kB hugepages reported on node 1 00:29:18.932 [2024-11-16 17:48:56.216021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:18.932 [2024-11-16 17:48:56.305738] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:18.932 [2024-11-16 17:48:56.305911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:18.932 17:48:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:18.932 17:48:56 -- common/autotest_common.sh@862 -- # return 0 00:29:18.932 17:48:56 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:18.932 17:48:56 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:18.932 17:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.932 17:48:56 -- common/autotest_common.sh@10 -- # set +x 00:29:18.932 17:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.932 17:48:56 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:18.932 17:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.932 17:48:56 -- common/autotest_common.sh@10 -- # set +x 00:29:19.191 17:48:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.191 17:48:56 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:19.191 17:48:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.191 17:48:56 -- common/autotest_common.sh@10 -- # set +x 00:29:20.125 [2024-11-16 17:48:57.555259] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:20.125 [2024-11-16 17:48:57.555308] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:20.125 [2024-11-16 17:48:57.555335] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:20.384 [2024-11-16 17:48:57.681776] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:20.384 [2024-11-16 17:48:57.784687] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:20.384 [2024-11-16 17:48:57.784739] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:20.384 [2024-11-16 17:48:57.784777] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:20.384 [2024-11-16 17:48:57.784799] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:20.384 [2024-11-16 17:48:57.784836] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:20.384 17:48:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:20.384 17:48:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:20.384 17:48:57 -- common/autotest_common.sh@10 -- # set +x 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:20.384 [2024-11-16 17:48:57.792217] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x18b1c50 was disconnected and freed. delete nvme_qpair. 00:29:20.384 17:48:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:20.384 17:48:57 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:20.642 17:48:57 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:20.642 17:48:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:20.642 17:48:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:20.642 17:48:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:20.642 17:48:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.642 17:48:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:20.642 17:48:57 -- common/autotest_common.sh@10 -- # set +x 00:29:20.642 17:48:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:20.642 17:48:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.642 17:48:57 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:20.642 17:48:57 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:21.575 17:48:58 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:21.575 17:48:58 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:21.575 17:48:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.575 17:48:58 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:21.575 17:48:58 -- common/autotest_common.sh@10 -- # set +x 00:29:21.575 17:48:58 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:21.575 17:48:58 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:21.575 17:48:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.575 17:48:58 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:21.575 17:48:58 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:22.510 17:48:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:22.510 17:48:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.510 17:48:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:22.510 17:48:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:22.510 17:48:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.510 17:48:59 -- common/autotest_common.sh@10 -- # set +x 00:29:22.510 17:48:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:22.510 17:48:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.768 17:49:00 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:22.768 17:49:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:23.702 17:49:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:23.702 17:49:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.702 17:49:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.702 17:49:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:23.702 17:49:01 -- common/autotest_common.sh@10 -- # set +x 00:29:23.702 17:49:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:23.702 17:49:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:23.702 17:49:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.702 17:49:01 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:23.702 17:49:01 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:24.636 17:49:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:24.636 17:49:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:24.636 17:49:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:24.636 17:49:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.636 17:49:02 -- common/autotest_common.sh@10 -- # set +x 00:29:24.636 17:49:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:24.636 17:49:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:24.636 17:49:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.636 17:49:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:24.636 17:49:02 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:26.009 17:49:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:26.009 17:49:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.009 17:49:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:26.009 17:49:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.009 17:49:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:26.009 17:49:03 -- common/autotest_common.sh@10 -- # set +x 00:29:26.009 17:49:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:26.009 17:49:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.009 17:49:03 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:26.009 17:49:03 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:26.009 [2024-11-16 17:49:03.225880] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:26.009 [2024-11-16 17:49:03.225964] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.009 [2024-11-16 17:49:03.225989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.009 [2024-11-16 17:49:03.226009] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.009 [2024-11-16 17:49:03.226024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.009 [2024-11-16 17:49:03.226039] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.009 [2024-11-16 17:49:03.226053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.009 [2024-11-16 17:49:03.226069] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.009 [2024-11-16 17:49:03.226083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.009 [2024-11-16 17:49:03.226107] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:26.009 [2024-11-16 17:49:03.226123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:26.009 [2024-11-16 17:49:03.226137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18780b0 is same with the state(5) to be set 00:29:26.009 [2024-11-16 17:49:03.235895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18780b0 (9): Bad file descriptor 00:29:26.009 [2024-11-16 17:49:03.245966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:26.942 17:49:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:26.942 17:49:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.942 17:49:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.942 17:49:04 -- common/autotest_common.sh@10 -- # set +x 00:29:26.942 17:49:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:26.942 17:49:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:26.942 17:49:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:26.942 [2024-11-16 17:49:04.303776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:27.875 [2024-11-16 17:49:05.327643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:27.875 [2024-11-16 17:49:05.327725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18780b0 with addr=10.0.0.2, port=4420 00:29:27.875 [2024-11-16 17:49:05.327751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18780b0 is same with the state(5) to be set 00:29:27.875 [2024-11-16 17:49:05.327787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:27.875 [2024-11-16 17:49:05.327803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:27.875 [2024-11-16 17:49:05.327816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:27.875 [2024-11-16 17:49:05.327830] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:27.875 [2024-11-16 17:49:05.328266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18780b0 (9): Bad file descriptor 00:29:27.875 [2024-11-16 17:49:05.328306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:27.875 [2024-11-16 17:49:05.328346] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:27.875 [2024-11-16 17:49:05.328381] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.875 [2024-11-16 17:49:05.328401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.875 [2024-11-16 17:49:05.328418] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.875 [2024-11-16 17:49:05.328431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.875 [2024-11-16 17:49:05.328445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.875 [2024-11-16 17:49:05.328457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.875 [2024-11-16 17:49:05.328471] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.875 [2024-11-16 17:49:05.328483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.875 [2024-11-16 17:49:05.328506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:27.875 [2024-11-16 17:49:05.328519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:27.875 [2024-11-16 17:49:05.328531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:27.875 [2024-11-16 17:49:05.328788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18784c0 (9): Bad file descriptor 00:29:27.875 [2024-11-16 17:49:05.329806] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:27.875 [2024-11-16 17:49:05.329828] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:27.875 17:49:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.875 17:49:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:27.875 17:49:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:29.248 17:49:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:29.248 17:49:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:29.248 17:49:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:29.248 17:49:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:29.248 17:49:06 -- common/autotest_common.sh@10 -- # set +x 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:29.248 17:49:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:29.248 17:49:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:30.181 [2024-11-16 17:49:07.380177] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:30.181 [2024-11-16 17:49:07.380202] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:30.181 [2024-11-16 17:49:07.380223] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:30.181 17:49:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:30.181 17:49:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:30.181 17:49:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:30.181 17:49:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.181 17:49:07 -- common/autotest_common.sh@10 -- # set +x 00:29:30.181 17:49:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:30.181 17:49:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:30.181 17:49:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.181 17:49:07 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:30.181 17:49:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:30.181 [2024-11-16 17:49:07.506643] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:30.439 [2024-11-16 17:49:07.734097] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:30.439 [2024-11-16 17:49:07.734151] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:30.439 [2024-11-16 17:49:07.734188] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:30.439 [2024-11-16 17:49:07.734224] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:30.439 [2024-11-16 17:49:07.734241] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:30.439 [2024-11-16 17:49:07.779332] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1886ac0 was disconnected and freed. delete nvme_qpair. 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:31.373 17:49:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.373 17:49:08 -- common/autotest_common.sh@10 -- # set +x 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:31.373 17:49:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1701149 00:29:31.373 17:49:08 -- common/autotest_common.sh@936 -- # '[' -z 1701149 ']' 00:29:31.373 17:49:08 -- common/autotest_common.sh@940 -- # kill -0 1701149 00:29:31.373 17:49:08 -- common/autotest_common.sh@941 -- # uname 00:29:31.373 17:49:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:31.373 17:49:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1701149 00:29:31.373 17:49:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:31.373 17:49:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:31.373 17:49:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1701149' 00:29:31.373 killing process with pid 1701149 00:29:31.373 17:49:08 -- common/autotest_common.sh@955 -- # kill 1701149 00:29:31.373 17:49:08 -- common/autotest_common.sh@960 -- # wait 1701149 00:29:31.373 17:49:08 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:31.373 17:49:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:31.373 17:49:08 -- nvmf/common.sh@116 -- # sync 00:29:31.373 17:49:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:31.373 17:49:08 -- nvmf/common.sh@119 -- # set +e 00:29:31.373 17:49:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:31.373 17:49:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:31.373 rmmod nvme_tcp 00:29:31.373 rmmod nvme_fabrics 00:29:31.373 rmmod nvme_keyring 00:29:31.373 17:49:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:31.373 17:49:08 -- nvmf/common.sh@123 -- # set -e 00:29:31.373 17:49:08 -- nvmf/common.sh@124 -- # return 0 00:29:31.373 17:49:08 -- nvmf/common.sh@477 -- # '[' -n 1700992 ']' 00:29:31.373 17:49:08 -- nvmf/common.sh@478 -- # killprocess 1700992 00:29:31.373 17:49:08 -- common/autotest_common.sh@936 -- # '[' -z 1700992 ']' 00:29:31.373 17:49:08 -- common/autotest_common.sh@940 -- # kill -0 1700992 00:29:31.373 17:49:08 -- common/autotest_common.sh@941 -- # uname 00:29:31.373 17:49:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:31.373 17:49:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1700992 00:29:31.632 17:49:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:31.632 17:49:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:31.632 17:49:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1700992' 00:29:31.632 killing process with pid 1700992 00:29:31.632 17:49:08 -- common/autotest_common.sh@955 -- # kill 1700992 00:29:31.632 17:49:08 -- common/autotest_common.sh@960 -- # wait 1700992 00:29:31.632 17:49:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:31.632 17:49:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:31.632 17:49:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:31.632 17:49:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:31.632 17:49:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:31.632 17:49:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:31.632 17:49:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:31.632 17:49:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:34.167 17:49:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:34.167 00:29:34.167 real 0m18.599s 00:29:34.167 user 0m25.758s 00:29:34.167 sys 0m2.936s 00:29:34.167 17:49:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:34.167 17:49:11 -- common/autotest_common.sh@10 -- # set +x 00:29:34.167 ************************************ 00:29:34.167 END TEST nvmf_discovery_remove_ifc 00:29:34.167 ************************************ 00:29:34.167 17:49:11 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:34.167 17:49:11 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:34.167 17:49:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:34.167 17:49:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:34.167 17:49:11 -- common/autotest_common.sh@10 -- # set +x 00:29:34.167 ************************************ 00:29:34.167 START TEST nvmf_digest 00:29:34.167 ************************************ 00:29:34.167 17:49:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:34.167 * Looking for test storage... 00:29:34.167 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:34.167 17:49:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:34.167 17:49:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:34.167 17:49:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:34.167 17:49:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:34.167 17:49:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:34.167 17:49:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:34.167 17:49:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:34.167 17:49:11 -- scripts/common.sh@335 -- # IFS=.-: 00:29:34.167 17:49:11 -- scripts/common.sh@335 -- # read -ra ver1 00:29:34.167 17:49:11 -- scripts/common.sh@336 -- # IFS=.-: 00:29:34.167 17:49:11 -- scripts/common.sh@336 -- # read -ra ver2 00:29:34.167 17:49:11 -- scripts/common.sh@337 -- # local 'op=<' 00:29:34.167 17:49:11 -- scripts/common.sh@339 -- # ver1_l=2 00:29:34.167 17:49:11 -- scripts/common.sh@340 -- # ver2_l=1 00:29:34.167 17:49:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:34.167 17:49:11 -- scripts/common.sh@343 -- # case "$op" in 00:29:34.167 17:49:11 -- scripts/common.sh@344 -- # : 1 00:29:34.167 17:49:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:34.167 17:49:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:34.167 17:49:11 -- scripts/common.sh@364 -- # decimal 1 00:29:34.167 17:49:11 -- scripts/common.sh@352 -- # local d=1 00:29:34.167 17:49:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:34.167 17:49:11 -- scripts/common.sh@354 -- # echo 1 00:29:34.167 17:49:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:34.167 17:49:11 -- scripts/common.sh@365 -- # decimal 2 00:29:34.167 17:49:11 -- scripts/common.sh@352 -- # local d=2 00:29:34.167 17:49:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:34.167 17:49:11 -- scripts/common.sh@354 -- # echo 2 00:29:34.167 17:49:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:34.167 17:49:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:34.167 17:49:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:34.167 17:49:11 -- scripts/common.sh@367 -- # return 0 00:29:34.167 17:49:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:34.167 17:49:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:34.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:34.167 --rc genhtml_branch_coverage=1 00:29:34.167 --rc genhtml_function_coverage=1 00:29:34.167 --rc genhtml_legend=1 00:29:34.167 --rc geninfo_all_blocks=1 00:29:34.167 --rc geninfo_unexecuted_blocks=1 00:29:34.167 00:29:34.167 ' 00:29:34.167 17:49:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:34.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:34.167 --rc genhtml_branch_coverage=1 00:29:34.167 --rc genhtml_function_coverage=1 00:29:34.167 --rc genhtml_legend=1 00:29:34.167 --rc geninfo_all_blocks=1 00:29:34.167 --rc geninfo_unexecuted_blocks=1 00:29:34.167 00:29:34.167 ' 00:29:34.167 17:49:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:34.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:34.167 --rc genhtml_branch_coverage=1 00:29:34.167 --rc genhtml_function_coverage=1 00:29:34.167 --rc genhtml_legend=1 00:29:34.167 --rc geninfo_all_blocks=1 00:29:34.167 --rc geninfo_unexecuted_blocks=1 00:29:34.167 00:29:34.167 ' 00:29:34.167 17:49:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:34.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:34.167 --rc genhtml_branch_coverage=1 00:29:34.167 --rc genhtml_function_coverage=1 00:29:34.167 --rc genhtml_legend=1 00:29:34.167 --rc geninfo_all_blocks=1 00:29:34.167 --rc geninfo_unexecuted_blocks=1 00:29:34.167 00:29:34.167 ' 00:29:34.167 17:49:11 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:34.167 17:49:11 -- nvmf/common.sh@7 -- # uname -s 00:29:34.167 17:49:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:34.167 17:49:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:34.167 17:49:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:34.167 17:49:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:34.167 17:49:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:34.167 17:49:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:34.167 17:49:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:34.167 17:49:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:34.167 17:49:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:34.167 17:49:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:34.167 17:49:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:34.167 17:49:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:34.167 17:49:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:34.167 17:49:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:34.167 17:49:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:34.167 17:49:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:34.167 17:49:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:34.167 17:49:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:34.167 17:49:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:34.167 17:49:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:34.167 17:49:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:34.167 17:49:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:34.167 17:49:11 -- paths/export.sh@5 -- # export PATH 00:29:34.168 17:49:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:34.168 17:49:11 -- nvmf/common.sh@46 -- # : 0 00:29:34.168 17:49:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:34.168 17:49:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:34.168 17:49:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:34.168 17:49:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:34.168 17:49:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:34.168 17:49:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:34.168 17:49:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:34.168 17:49:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:34.168 17:49:11 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:34.168 17:49:11 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:34.168 17:49:11 -- host/digest.sh@16 -- # runtime=2 00:29:34.168 17:49:11 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:34.168 17:49:11 -- host/digest.sh@132 -- # nvmftestinit 00:29:34.168 17:49:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:34.168 17:49:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:34.168 17:49:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:34.168 17:49:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:34.168 17:49:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:34.168 17:49:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:34.168 17:49:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:34.168 17:49:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:34.168 17:49:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:34.168 17:49:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:34.168 17:49:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:34.168 17:49:11 -- common/autotest_common.sh@10 -- # set +x 00:29:36.070 17:49:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:36.070 17:49:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:36.070 17:49:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:36.070 17:49:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:36.070 17:49:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:36.070 17:49:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:36.070 17:49:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:36.070 17:49:13 -- nvmf/common.sh@294 -- # net_devs=() 00:29:36.070 17:49:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:36.070 17:49:13 -- nvmf/common.sh@295 -- # e810=() 00:29:36.070 17:49:13 -- nvmf/common.sh@295 -- # local -ga e810 00:29:36.070 17:49:13 -- nvmf/common.sh@296 -- # x722=() 00:29:36.070 17:49:13 -- nvmf/common.sh@296 -- # local -ga x722 00:29:36.070 17:49:13 -- nvmf/common.sh@297 -- # mlx=() 00:29:36.070 17:49:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:36.070 17:49:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:36.070 17:49:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:36.070 17:49:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:36.070 17:49:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:36.070 17:49:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:36.070 17:49:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:36.070 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:36.070 17:49:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:36.070 17:49:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:36.070 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:36.070 17:49:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:36.070 17:49:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:36.070 17:49:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:36.070 17:49:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:36.070 17:49:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:36.070 17:49:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:36.070 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:36.070 17:49:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:36.070 17:49:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:36.070 17:49:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:36.070 17:49:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:36.070 17:49:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:36.070 17:49:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:36.070 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:36.070 17:49:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:36.070 17:49:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:36.070 17:49:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:36.070 17:49:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:36.070 17:49:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:36.070 17:49:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:36.070 17:49:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:36.070 17:49:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:36.070 17:49:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:36.070 17:49:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:36.070 17:49:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:36.070 17:49:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:36.070 17:49:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:36.070 17:49:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:36.070 17:49:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:36.070 17:49:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:36.070 17:49:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:36.070 17:49:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:36.070 17:49:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:36.070 17:49:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:36.070 17:49:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:36.070 17:49:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:36.070 17:49:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:36.070 17:49:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:36.070 17:49:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:36.070 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:36.070 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:29:36.070 00:29:36.070 --- 10.0.0.2 ping statistics --- 00:29:36.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:36.070 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:29:36.070 17:49:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:36.070 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:36.070 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.086 ms 00:29:36.070 00:29:36.070 --- 10.0.0.1 ping statistics --- 00:29:36.070 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:36.070 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:29:36.071 17:49:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:36.071 17:49:13 -- nvmf/common.sh@410 -- # return 0 00:29:36.071 17:49:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:36.071 17:49:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:36.071 17:49:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:36.071 17:49:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:36.071 17:49:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:36.071 17:49:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:36.071 17:49:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:36.071 17:49:13 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:36.071 17:49:13 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:36.071 17:49:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:36.071 17:49:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:36.071 17:49:13 -- common/autotest_common.sh@10 -- # set +x 00:29:36.071 ************************************ 00:29:36.071 START TEST nvmf_digest_clean 00:29:36.071 ************************************ 00:29:36.071 17:49:13 -- common/autotest_common.sh@1114 -- # run_digest 00:29:36.071 17:49:13 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:36.071 17:49:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:36.071 17:49:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:36.071 17:49:13 -- common/autotest_common.sh@10 -- # set +x 00:29:36.071 17:49:13 -- nvmf/common.sh@469 -- # nvmfpid=1704792 00:29:36.071 17:49:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:36.071 17:49:13 -- nvmf/common.sh@470 -- # waitforlisten 1704792 00:29:36.071 17:49:13 -- common/autotest_common.sh@829 -- # '[' -z 1704792 ']' 00:29:36.071 17:49:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:36.071 17:49:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:36.071 17:49:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:36.071 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:36.071 17:49:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:36.071 17:49:13 -- common/autotest_common.sh@10 -- # set +x 00:29:36.071 [2024-11-16 17:49:13.419128] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:36.071 [2024-11-16 17:49:13.419205] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:36.071 EAL: No free 2048 kB hugepages reported on node 1 00:29:36.071 [2024-11-16 17:49:13.488303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:36.329 [2024-11-16 17:49:13.576565] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:36.329 [2024-11-16 17:49:13.576736] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:36.329 [2024-11-16 17:49:13.576758] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:36.329 [2024-11-16 17:49:13.576774] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:36.329 [2024-11-16 17:49:13.576811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:36.329 17:49:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:36.329 17:49:13 -- common/autotest_common.sh@862 -- # return 0 00:29:36.329 17:49:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:36.329 17:49:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:36.329 17:49:13 -- common/autotest_common.sh@10 -- # set +x 00:29:36.329 17:49:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:36.329 17:49:13 -- host/digest.sh@120 -- # common_target_config 00:29:36.329 17:49:13 -- host/digest.sh@43 -- # rpc_cmd 00:29:36.329 17:49:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:36.329 17:49:13 -- common/autotest_common.sh@10 -- # set +x 00:29:36.329 null0 00:29:36.329 [2024-11-16 17:49:13.767554] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:36.329 [2024-11-16 17:49:13.791834] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:36.329 17:49:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:36.329 17:49:13 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:36.329 17:49:13 -- host/digest.sh@77 -- # local rw bs qd 00:29:36.329 17:49:13 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:36.329 17:49:13 -- host/digest.sh@80 -- # rw=randread 00:29:36.329 17:49:13 -- host/digest.sh@80 -- # bs=4096 00:29:36.329 17:49:13 -- host/digest.sh@80 -- # qd=128 00:29:36.329 17:49:13 -- host/digest.sh@82 -- # bperfpid=1704817 00:29:36.329 17:49:13 -- host/digest.sh@83 -- # waitforlisten 1704817 /var/tmp/bperf.sock 00:29:36.329 17:49:13 -- common/autotest_common.sh@829 -- # '[' -z 1704817 ']' 00:29:36.329 17:49:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:36.329 17:49:13 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:36.329 17:49:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:36.329 17:49:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:36.329 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:36.329 17:49:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:36.329 17:49:13 -- common/autotest_common.sh@10 -- # set +x 00:29:36.588 [2024-11-16 17:49:13.839593] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:36.588 [2024-11-16 17:49:13.839682] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1704817 ] 00:29:36.588 EAL: No free 2048 kB hugepages reported on node 1 00:29:36.588 [2024-11-16 17:49:13.898716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:36.588 [2024-11-16 17:49:13.982867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:36.588 17:49:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:36.588 17:49:14 -- common/autotest_common.sh@862 -- # return 0 00:29:36.588 17:49:14 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:36.588 17:49:14 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:36.588 17:49:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:37.154 17:49:14 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:37.154 17:49:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:37.413 nvme0n1 00:29:37.413 17:49:14 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:37.413 17:49:14 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:37.413 Running I/O for 2 seconds... 00:29:39.971 00:29:39.971 Latency(us) 00:29:39.971 [2024-11-16T16:49:17.463Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:39.971 [2024-11-16T16:49:17.463Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:39.971 nvme0n1 : 2.04 17716.46 69.20 0.00 0.00 7075.78 3106.89 47962.64 00:29:39.971 [2024-11-16T16:49:17.463Z] =================================================================================================================== 00:29:39.971 [2024-11-16T16:49:17.463Z] Total : 17716.46 69.20 0.00 0.00 7075.78 3106.89 47962.64 00:29:39.971 0 00:29:39.971 17:49:16 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:39.971 17:49:16 -- host/digest.sh@92 -- # get_accel_stats 00:29:39.971 17:49:16 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:39.971 17:49:16 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:39.971 | select(.opcode=="crc32c") 00:29:39.971 | "\(.module_name) \(.executed)"' 00:29:39.971 17:49:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:39.971 17:49:17 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:39.971 17:49:17 -- host/digest.sh@93 -- # exp_module=software 00:29:39.971 17:49:17 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:39.971 17:49:17 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:39.971 17:49:17 -- host/digest.sh@97 -- # killprocess 1704817 00:29:39.972 17:49:17 -- common/autotest_common.sh@936 -- # '[' -z 1704817 ']' 00:29:39.972 17:49:17 -- common/autotest_common.sh@940 -- # kill -0 1704817 00:29:39.972 17:49:17 -- common/autotest_common.sh@941 -- # uname 00:29:39.972 17:49:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:39.972 17:49:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1704817 00:29:39.972 17:49:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:39.972 17:49:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:39.972 17:49:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1704817' 00:29:39.972 killing process with pid 1704817 00:29:39.972 17:49:17 -- common/autotest_common.sh@955 -- # kill 1704817 00:29:39.972 Received shutdown signal, test time was about 2.000000 seconds 00:29:39.972 00:29:39.972 Latency(us) 00:29:39.972 [2024-11-16T16:49:17.464Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:39.972 [2024-11-16T16:49:17.464Z] =================================================================================================================== 00:29:39.972 [2024-11-16T16:49:17.464Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:39.972 17:49:17 -- common/autotest_common.sh@960 -- # wait 1704817 00:29:39.972 17:49:17 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:39.972 17:49:17 -- host/digest.sh@77 -- # local rw bs qd 00:29:39.972 17:49:17 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:39.972 17:49:17 -- host/digest.sh@80 -- # rw=randread 00:29:39.972 17:49:17 -- host/digest.sh@80 -- # bs=131072 00:29:39.972 17:49:17 -- host/digest.sh@80 -- # qd=16 00:29:39.972 17:49:17 -- host/digest.sh@82 -- # bperfpid=1705237 00:29:39.972 17:49:17 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:39.972 17:49:17 -- host/digest.sh@83 -- # waitforlisten 1705237 /var/tmp/bperf.sock 00:29:39.972 17:49:17 -- common/autotest_common.sh@829 -- # '[' -z 1705237 ']' 00:29:39.972 17:49:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:39.972 17:49:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:39.972 17:49:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:39.972 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:39.972 17:49:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:39.972 17:49:17 -- common/autotest_common.sh@10 -- # set +x 00:29:39.972 [2024-11-16 17:49:17.462076] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:39.972 [2024-11-16 17:49:17.462149] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1705237 ] 00:29:39.972 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:39.972 Zero copy mechanism will not be used. 00:29:40.230 EAL: No free 2048 kB hugepages reported on node 1 00:29:40.230 [2024-11-16 17:49:17.523893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:40.230 [2024-11-16 17:49:17.607770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:40.230 17:49:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:40.230 17:49:17 -- common/autotest_common.sh@862 -- # return 0 00:29:40.230 17:49:17 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:40.230 17:49:17 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:40.230 17:49:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:40.798 17:49:18 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:40.798 17:49:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:41.056 nvme0n1 00:29:41.056 17:49:18 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:41.056 17:49:18 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:41.314 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:41.314 Zero copy mechanism will not be used. 00:29:41.314 Running I/O for 2 seconds... 00:29:43.213 00:29:43.213 Latency(us) 00:29:43.213 [2024-11-16T16:49:20.705Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:43.213 [2024-11-16T16:49:20.705Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:43.213 nvme0n1 : 2.00 6103.35 762.92 0.00 0.00 2617.53 1031.59 6941.96 00:29:43.213 [2024-11-16T16:49:20.705Z] =================================================================================================================== 00:29:43.213 [2024-11-16T16:49:20.705Z] Total : 6103.35 762.92 0.00 0.00 2617.53 1031.59 6941.96 00:29:43.213 0 00:29:43.213 17:49:20 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:43.213 17:49:20 -- host/digest.sh@92 -- # get_accel_stats 00:29:43.213 17:49:20 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:43.213 17:49:20 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:43.213 | select(.opcode=="crc32c") 00:29:43.213 | "\(.module_name) \(.executed)"' 00:29:43.213 17:49:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:43.471 17:49:20 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:43.471 17:49:20 -- host/digest.sh@93 -- # exp_module=software 00:29:43.471 17:49:20 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:43.471 17:49:20 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:43.471 17:49:20 -- host/digest.sh@97 -- # killprocess 1705237 00:29:43.471 17:49:20 -- common/autotest_common.sh@936 -- # '[' -z 1705237 ']' 00:29:43.471 17:49:20 -- common/autotest_common.sh@940 -- # kill -0 1705237 00:29:43.471 17:49:20 -- common/autotest_common.sh@941 -- # uname 00:29:43.471 17:49:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:43.471 17:49:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1705237 00:29:43.471 17:49:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:43.471 17:49:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:43.471 17:49:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1705237' 00:29:43.471 killing process with pid 1705237 00:29:43.471 17:49:20 -- common/autotest_common.sh@955 -- # kill 1705237 00:29:43.471 Received shutdown signal, test time was about 2.000000 seconds 00:29:43.471 00:29:43.471 Latency(us) 00:29:43.471 [2024-11-16T16:49:20.963Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:43.471 [2024-11-16T16:49:20.963Z] =================================================================================================================== 00:29:43.471 [2024-11-16T16:49:20.963Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:43.471 17:49:20 -- common/autotest_common.sh@960 -- # wait 1705237 00:29:43.729 17:49:21 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:43.729 17:49:21 -- host/digest.sh@77 -- # local rw bs qd 00:29:43.729 17:49:21 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:43.729 17:49:21 -- host/digest.sh@80 -- # rw=randwrite 00:29:43.729 17:49:21 -- host/digest.sh@80 -- # bs=4096 00:29:43.729 17:49:21 -- host/digest.sh@80 -- # qd=128 00:29:43.729 17:49:21 -- host/digest.sh@82 -- # bperfpid=1705700 00:29:43.729 17:49:21 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:43.729 17:49:21 -- host/digest.sh@83 -- # waitforlisten 1705700 /var/tmp/bperf.sock 00:29:43.729 17:49:21 -- common/autotest_common.sh@829 -- # '[' -z 1705700 ']' 00:29:43.729 17:49:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:43.729 17:49:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:43.729 17:49:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:43.729 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:43.729 17:49:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:43.729 17:49:21 -- common/autotest_common.sh@10 -- # set +x 00:29:43.729 [2024-11-16 17:49:21.200789] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:43.729 [2024-11-16 17:49:21.200865] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1705700 ] 00:29:43.987 EAL: No free 2048 kB hugepages reported on node 1 00:29:43.987 [2024-11-16 17:49:21.264986] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:43.987 [2024-11-16 17:49:21.353125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:43.987 17:49:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:43.987 17:49:21 -- common/autotest_common.sh@862 -- # return 0 00:29:43.987 17:49:21 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:43.987 17:49:21 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:43.987 17:49:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:44.553 17:49:21 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.553 17:49:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.811 nvme0n1 00:29:44.811 17:49:22 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:44.811 17:49:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:45.069 Running I/O for 2 seconds... 00:29:46.968 00:29:46.968 Latency(us) 00:29:46.968 [2024-11-16T16:49:24.460Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:46.968 [2024-11-16T16:49:24.460Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:46.968 nvme0n1 : 2.00 21037.87 82.18 0.00 0.00 6077.44 3046.21 11699.39 00:29:46.968 [2024-11-16T16:49:24.460Z] =================================================================================================================== 00:29:46.968 [2024-11-16T16:49:24.460Z] Total : 21037.87 82.18 0.00 0.00 6077.44 3046.21 11699.39 00:29:46.968 0 00:29:46.968 17:49:24 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:46.968 17:49:24 -- host/digest.sh@92 -- # get_accel_stats 00:29:46.968 17:49:24 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:46.968 17:49:24 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:46.968 | select(.opcode=="crc32c") 00:29:46.968 | "\(.module_name) \(.executed)"' 00:29:46.968 17:49:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:47.226 17:49:24 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:47.226 17:49:24 -- host/digest.sh@93 -- # exp_module=software 00:29:47.226 17:49:24 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:47.226 17:49:24 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:47.226 17:49:24 -- host/digest.sh@97 -- # killprocess 1705700 00:29:47.226 17:49:24 -- common/autotest_common.sh@936 -- # '[' -z 1705700 ']' 00:29:47.226 17:49:24 -- common/autotest_common.sh@940 -- # kill -0 1705700 00:29:47.226 17:49:24 -- common/autotest_common.sh@941 -- # uname 00:29:47.226 17:49:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:47.226 17:49:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1705700 00:29:47.226 17:49:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:47.226 17:49:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:47.226 17:49:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1705700' 00:29:47.226 killing process with pid 1705700 00:29:47.226 17:49:24 -- common/autotest_common.sh@955 -- # kill 1705700 00:29:47.226 Received shutdown signal, test time was about 2.000000 seconds 00:29:47.226 00:29:47.226 Latency(us) 00:29:47.226 [2024-11-16T16:49:24.718Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:47.226 [2024-11-16T16:49:24.718Z] =================================================================================================================== 00:29:47.226 [2024-11-16T16:49:24.718Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:47.226 17:49:24 -- common/autotest_common.sh@960 -- # wait 1705700 00:29:47.484 17:49:24 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:47.484 17:49:24 -- host/digest.sh@77 -- # local rw bs qd 00:29:47.484 17:49:24 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:47.484 17:49:24 -- host/digest.sh@80 -- # rw=randwrite 00:29:47.484 17:49:24 -- host/digest.sh@80 -- # bs=131072 00:29:47.484 17:49:24 -- host/digest.sh@80 -- # qd=16 00:29:47.484 17:49:24 -- host/digest.sh@82 -- # bperfpid=1706200 00:29:47.484 17:49:24 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:47.484 17:49:24 -- host/digest.sh@83 -- # waitforlisten 1706200 /var/tmp/bperf.sock 00:29:47.484 17:49:24 -- common/autotest_common.sh@829 -- # '[' -z 1706200 ']' 00:29:47.484 17:49:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:47.484 17:49:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:47.484 17:49:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:47.484 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:47.484 17:49:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:47.484 17:49:24 -- common/autotest_common.sh@10 -- # set +x 00:29:47.484 [2024-11-16 17:49:24.929546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:47.484 [2024-11-16 17:49:24.929625] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1706200 ] 00:29:47.484 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:47.484 Zero copy mechanism will not be used. 00:29:47.484 EAL: No free 2048 kB hugepages reported on node 1 00:29:47.742 [2024-11-16 17:49:24.990670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:47.742 [2024-11-16 17:49:25.077347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:47.742 17:49:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:47.742 17:49:25 -- common/autotest_common.sh@862 -- # return 0 00:29:47.742 17:49:25 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:47.742 17:49:25 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:47.742 17:49:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:48.001 17:49:25 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:48.001 17:49:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:48.572 nvme0n1 00:29:48.572 17:49:25 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:48.572 17:49:25 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:48.572 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:48.572 Zero copy mechanism will not be used. 00:29:48.572 Running I/O for 2 seconds... 00:29:50.476 00:29:50.476 Latency(us) 00:29:50.476 [2024-11-16T16:49:27.968Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:50.476 [2024-11-16T16:49:27.968Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:50.476 nvme0n1 : 2.00 6605.47 825.68 0.00 0.00 2411.86 1565.58 10291.58 00:29:50.476 [2024-11-16T16:49:27.968Z] =================================================================================================================== 00:29:50.476 [2024-11-16T16:49:27.968Z] Total : 6605.47 825.68 0.00 0.00 2411.86 1565.58 10291.58 00:29:50.476 0 00:29:50.476 17:49:27 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:50.476 17:49:27 -- host/digest.sh@92 -- # get_accel_stats 00:29:50.476 17:49:27 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:50.476 17:49:27 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:50.477 | select(.opcode=="crc32c") 00:29:50.477 | "\(.module_name) \(.executed)"' 00:29:50.477 17:49:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:51.043 17:49:28 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:51.043 17:49:28 -- host/digest.sh@93 -- # exp_module=software 00:29:51.043 17:49:28 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:51.043 17:49:28 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:51.043 17:49:28 -- host/digest.sh@97 -- # killprocess 1706200 00:29:51.043 17:49:28 -- common/autotest_common.sh@936 -- # '[' -z 1706200 ']' 00:29:51.043 17:49:28 -- common/autotest_common.sh@940 -- # kill -0 1706200 00:29:51.043 17:49:28 -- common/autotest_common.sh@941 -- # uname 00:29:51.043 17:49:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:51.043 17:49:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1706200 00:29:51.043 17:49:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:51.043 17:49:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:51.043 17:49:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1706200' 00:29:51.043 killing process with pid 1706200 00:29:51.043 17:49:28 -- common/autotest_common.sh@955 -- # kill 1706200 00:29:51.043 Received shutdown signal, test time was about 2.000000 seconds 00:29:51.043 00:29:51.043 Latency(us) 00:29:51.043 [2024-11-16T16:49:28.535Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:51.043 [2024-11-16T16:49:28.535Z] =================================================================================================================== 00:29:51.043 [2024-11-16T16:49:28.535Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:51.043 17:49:28 -- common/autotest_common.sh@960 -- # wait 1706200 00:29:51.043 17:49:28 -- host/digest.sh@126 -- # killprocess 1704792 00:29:51.043 17:49:28 -- common/autotest_common.sh@936 -- # '[' -z 1704792 ']' 00:29:51.043 17:49:28 -- common/autotest_common.sh@940 -- # kill -0 1704792 00:29:51.043 17:49:28 -- common/autotest_common.sh@941 -- # uname 00:29:51.043 17:49:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:51.043 17:49:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1704792 00:29:51.301 17:49:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:51.301 17:49:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:51.301 17:49:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1704792' 00:29:51.301 killing process with pid 1704792 00:29:51.301 17:49:28 -- common/autotest_common.sh@955 -- # kill 1704792 00:29:51.301 17:49:28 -- common/autotest_common.sh@960 -- # wait 1704792 00:29:51.561 00:29:51.561 real 0m15.433s 00:29:51.561 user 0m29.410s 00:29:51.561 sys 0m4.619s 00:29:51.561 17:49:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:51.561 17:49:28 -- common/autotest_common.sh@10 -- # set +x 00:29:51.561 ************************************ 00:29:51.561 END TEST nvmf_digest_clean 00:29:51.561 ************************************ 00:29:51.561 17:49:28 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:51.561 17:49:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:51.561 17:49:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:51.561 17:49:28 -- common/autotest_common.sh@10 -- # set +x 00:29:51.561 ************************************ 00:29:51.561 START TEST nvmf_digest_error 00:29:51.561 ************************************ 00:29:51.561 17:49:28 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:51.561 17:49:28 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:51.561 17:49:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:51.561 17:49:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:51.561 17:49:28 -- common/autotest_common.sh@10 -- # set +x 00:29:51.561 17:49:28 -- nvmf/common.sh@469 -- # nvmfpid=1706651 00:29:51.561 17:49:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:51.561 17:49:28 -- nvmf/common.sh@470 -- # waitforlisten 1706651 00:29:51.561 17:49:28 -- common/autotest_common.sh@829 -- # '[' -z 1706651 ']' 00:29:51.561 17:49:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:51.561 17:49:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:51.561 17:49:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:51.561 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:51.561 17:49:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:51.561 17:49:28 -- common/autotest_common.sh@10 -- # set +x 00:29:51.561 [2024-11-16 17:49:28.878172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:51.561 [2024-11-16 17:49:28.878264] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:51.561 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.561 [2024-11-16 17:49:28.940976] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:51.561 [2024-11-16 17:49:29.024493] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:51.561 [2024-11-16 17:49:29.024680] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:51.561 [2024-11-16 17:49:29.024700] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:51.561 [2024-11-16 17:49:29.024715] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:51.561 [2024-11-16 17:49:29.024748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:51.819 17:49:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:51.819 17:49:29 -- common/autotest_common.sh@862 -- # return 0 00:29:51.819 17:49:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:51.819 17:49:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:51.819 17:49:29 -- common/autotest_common.sh@10 -- # set +x 00:29:51.819 17:49:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:51.819 17:49:29 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:51.819 17:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.819 17:49:29 -- common/autotest_common.sh@10 -- # set +x 00:29:51.819 [2024-11-16 17:49:29.129404] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:51.819 17:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.819 17:49:29 -- host/digest.sh@104 -- # common_target_config 00:29:51.819 17:49:29 -- host/digest.sh@43 -- # rpc_cmd 00:29:51.819 17:49:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.819 17:49:29 -- common/autotest_common.sh@10 -- # set +x 00:29:51.819 null0 00:29:51.819 [2024-11-16 17:49:29.240946] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:51.819 [2024-11-16 17:49:29.265205] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:51.819 17:49:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.819 17:49:29 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:51.819 17:49:29 -- host/digest.sh@54 -- # local rw bs qd 00:29:51.819 17:49:29 -- host/digest.sh@56 -- # rw=randread 00:29:51.819 17:49:29 -- host/digest.sh@56 -- # bs=4096 00:29:51.819 17:49:29 -- host/digest.sh@56 -- # qd=128 00:29:51.819 17:49:29 -- host/digest.sh@58 -- # bperfpid=1706797 00:29:51.819 17:49:29 -- host/digest.sh@60 -- # waitforlisten 1706797 /var/tmp/bperf.sock 00:29:51.819 17:49:29 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:51.819 17:49:29 -- common/autotest_common.sh@829 -- # '[' -z 1706797 ']' 00:29:51.819 17:49:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:51.819 17:49:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:51.819 17:49:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:51.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:51.819 17:49:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:51.819 17:49:29 -- common/autotest_common.sh@10 -- # set +x 00:29:51.819 [2024-11-16 17:49:29.310779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:51.819 [2024-11-16 17:49:29.310845] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1706797 ] 00:29:52.077 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.077 [2024-11-16 17:49:29.374008] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:52.077 [2024-11-16 17:49:29.463977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:53.011 17:49:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:53.011 17:49:30 -- common/autotest_common.sh@862 -- # return 0 00:29:53.011 17:49:30 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:53.011 17:49:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:53.268 17:49:30 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:53.268 17:49:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:53.268 17:49:30 -- common/autotest_common.sh@10 -- # set +x 00:29:53.268 17:49:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:53.268 17:49:30 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:53.268 17:49:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:53.832 nvme0n1 00:29:53.832 17:49:31 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:53.832 17:49:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:53.832 17:49:31 -- common/autotest_common.sh@10 -- # set +x 00:29:53.832 17:49:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:53.832 17:49:31 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:53.832 17:49:31 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:53.832 Running I/O for 2 seconds... 00:29:53.832 [2024-11-16 17:49:31.231639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:53.832 [2024-11-16 17:49:31.231698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.832 [2024-11-16 17:49:31.231718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.832 [2024-11-16 17:49:31.249202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:53.832 [2024-11-16 17:49:31.249238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13856 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.832 [2024-11-16 17:49:31.249257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.832 [2024-11-16 17:49:31.266540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:53.832 [2024-11-16 17:49:31.266575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.832 [2024-11-16 17:49:31.266595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.832 [2024-11-16 17:49:31.284336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:53.832 [2024-11-16 17:49:31.284378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:32 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.832 [2024-11-16 17:49:31.284397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.832 [2024-11-16 17:49:31.301554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:53.832 [2024-11-16 17:49:31.301596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18074 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.832 [2024-11-16 17:49:31.301636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.832 [2024-11-16 17:49:31.317384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:53.832 [2024-11-16 17:49:31.317418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9318 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.832 [2024-11-16 17:49:31.317438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.329585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.329628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8337 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.329664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.346983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.347018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15734 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.347037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.364036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.364070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.364090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.381926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.381954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:18417 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.381989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.397818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.397846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:24933 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.397878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.414884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.414919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:9344 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.414952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.432328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.432361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:22547 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.432380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.449675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.449704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:13513 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.449736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.467701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.467729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:1656 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.467765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.479056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.479091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21341 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.479110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.495195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.495230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:8100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.495249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.511246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.511281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.511300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.524942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.090 [2024-11-16 17:49:31.524991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22044 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.090 [2024-11-16 17:49:31.525010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.090 [2024-11-16 17:49:31.536580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.091 [2024-11-16 17:49:31.536613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.091 [2024-11-16 17:49:31.536643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.091 [2024-11-16 17:49:31.549231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.091 [2024-11-16 17:49:31.549266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22852 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.091 [2024-11-16 17:49:31.549287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.091 [2024-11-16 17:49:31.563118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.091 [2024-11-16 17:49:31.563152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.091 [2024-11-16 17:49:31.563171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.091 [2024-11-16 17:49:31.575905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.091 [2024-11-16 17:49:31.575951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:5589 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.091 [2024-11-16 17:49:31.575970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.347 [2024-11-16 17:49:31.587121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.347 [2024-11-16 17:49:31.587155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:22650 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.347 [2024-11-16 17:49:31.587174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.347 [2024-11-16 17:49:31.603184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.347 [2024-11-16 17:49:31.603218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:22860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.603238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.619829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.619856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7865 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.619886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.636605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.636663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:24663 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.636680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.653443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.653477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:20587 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.653497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.670298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.670334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:72 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.670353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.687902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.687946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:18639 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.687966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.701923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.701953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:10116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.701985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.718826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.718856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:7053 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.718878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.730759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.730792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9461 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.730811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.748475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.748509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:15272 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.748528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.764533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.764567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:23154 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.764586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.776392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.776425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13679 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.776444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.792234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.792268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:16956 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.792288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.809816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.809844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:25450 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.809875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.821409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.821443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:14179 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.821463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.348 [2024-11-16 17:49:31.839062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.348 [2024-11-16 17:49:31.839097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8783 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.348 [2024-11-16 17:49:31.839115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.856179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.856220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:18747 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.856240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.872685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.872714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:14318 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.872731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.890760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.890789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:12747 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.890821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.907573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.907607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:12576 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.907634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.924477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.924511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17212 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.924530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.935724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.935752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:3770 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.935783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.952558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.952592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:7244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.952611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.970119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.970154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:19838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.970173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:31.986997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:31.987031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:15291 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:31.987050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.606 [2024-11-16 17:49:32.003702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.606 [2024-11-16 17:49:32.003735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:24839 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.606 [2024-11-16 17:49:32.003754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.607 [2024-11-16 17:49:32.021104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.607 [2024-11-16 17:49:32.021138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:5820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.607 [2024-11-16 17:49:32.021158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.607 [2024-11-16 17:49:32.037859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.607 [2024-11-16 17:49:32.037887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:23995 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.607 [2024-11-16 17:49:32.037918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.607 [2024-11-16 17:49:32.054784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.607 [2024-11-16 17:49:32.054812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:3683 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.607 [2024-11-16 17:49:32.054829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.607 [2024-11-16 17:49:32.070085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.607 [2024-11-16 17:49:32.070124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:12731 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.607 [2024-11-16 17:49:32.070143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.607 [2024-11-16 17:49:32.081806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.607 [2024-11-16 17:49:32.081834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:10268 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.607 [2024-11-16 17:49:32.081865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.098855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.098886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:19669 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.098903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.116280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.116314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:18705 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.116334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.134148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.134181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23407 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.134208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.150950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.150993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:2209 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.151013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.167952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.167986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:7292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.168006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.179294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.179328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:17871 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.179348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.195492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.195525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4714 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.195548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.213005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.213040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:14255 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.213060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.230704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.230733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:10000 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.230764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.242613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.242657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:15577 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.242676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.258269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.258303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:24226 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.258322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.275441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.275476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:24023 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.275494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.292524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.292558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:22944 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.292578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.309452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.309487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:5786 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.309507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.865 [2024-11-16 17:49:32.326375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.865 [2024-11-16 17:49:32.326409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:17857 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.865 [2024-11-16 17:49:32.326428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:54.866 [2024-11-16 17:49:32.343268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:54.866 [2024-11-16 17:49:32.343302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:3807 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:54.866 [2024-11-16 17:49:32.343321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.360222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.360256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:25067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.360275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.376933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.376968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:17838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.376988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.393991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.394026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:14621 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.394045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.410852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.410881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:16314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.410916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.427502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.427537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:8290 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.427556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.444260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.444295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:20704 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.444315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.461000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.461035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:19390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.461054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.477945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.477981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:7307 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.478001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.494188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.494219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:14882 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.494250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.511132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.511167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:1325 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.511186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.528242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.528277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:7259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.528296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.124 [2024-11-16 17:49:32.544951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.124 [2024-11-16 17:49:32.544985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.124 [2024-11-16 17:49:32.545004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.125 [2024-11-16 17:49:32.561965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.125 [2024-11-16 17:49:32.562005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:766 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.125 [2024-11-16 17:49:32.562025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.125 [2024-11-16 17:49:32.578767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.125 [2024-11-16 17:49:32.578794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:12223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.125 [2024-11-16 17:49:32.578825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.125 [2024-11-16 17:49:32.595469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.125 [2024-11-16 17:49:32.595504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:23387 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.125 [2024-11-16 17:49:32.595523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.125 [2024-11-16 17:49:32.612312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.125 [2024-11-16 17:49:32.612345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:14991 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.125 [2024-11-16 17:49:32.612364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.629422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.629456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:2930 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.629475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.646249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.646282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:24561 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.646301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.662944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.662978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:24792 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.662997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.679826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.679854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:24055 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.679871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.696758] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.696786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:2735 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.696817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.720379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.720414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:8529 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.720434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.737350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.737385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:24215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.737404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.754035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.754069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15812 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.754088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.770809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.770837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:2198 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.770868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.787988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.788022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:4504 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.788042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.804817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.804847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:9745 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.804879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.821510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.821542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23560 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.821561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.383 [2024-11-16 17:49:32.838269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.383 [2024-11-16 17:49:32.838305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:8116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.383 [2024-11-16 17:49:32.838324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.384 [2024-11-16 17:49:32.855430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.384 [2024-11-16 17:49:32.855464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:20146 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.384 [2024-11-16 17:49:32.855490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.384 [2024-11-16 17:49:32.872545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.384 [2024-11-16 17:49:32.872579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:12908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.384 [2024-11-16 17:49:32.872598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:32.889580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:32.889614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:19975 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:32.889644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:32.906332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:32.906366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10058 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:32.906385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:32.923325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:32.923358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:19644 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:32.923378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:32.940118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:32.940152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:3712 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:32.940170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:32.956848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:32.956876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:9782 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:32.956906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:32.973611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:32.973654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:23879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:32.973674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:32.990176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:32.990209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:9215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:32.990228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:33.006972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:33.007007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:7893 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:33.007027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:33.024005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:33.024038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:17974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:33.024057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:33.041003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:33.041038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:33.041057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:33.057767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:33.057794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:15097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:33.057824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:33.074451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:33.074486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5026 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:33.074505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:33.091290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:33.091324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:4316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:33.091343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:33.107994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:33.108028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:18852 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:33.108046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.642 [2024-11-16 17:49:33.124690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.642 [2024-11-16 17:49:33.124717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:14420 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.642 [2024-11-16 17:49:33.124747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.900 [2024-11-16 17:49:33.141599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.900 [2024-11-16 17:49:33.141641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18127 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.900 [2024-11-16 17:49:33.141683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.901 [2024-11-16 17:49:33.158540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.901 [2024-11-16 17:49:33.158573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:18476 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.901 [2024-11-16 17:49:33.158593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.901 [2024-11-16 17:49:33.175208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.901 [2024-11-16 17:49:33.175242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:18259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.901 [2024-11-16 17:49:33.175261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.901 [2024-11-16 17:49:33.192127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.901 [2024-11-16 17:49:33.192161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:237 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.901 [2024-11-16 17:49:33.192180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.901 [2024-11-16 17:49:33.208822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1ae9300) 00:29:55.901 [2024-11-16 17:49:33.208849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:25076 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.901 [2024-11-16 17:49:33.208879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.901 00:29:55.901 Latency(us) 00:29:55.901 [2024-11-16T16:49:33.393Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:55.901 [2024-11-16T16:49:33.393Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:55.901 nvme0n1 : 2.01 15579.50 60.86 0.00 0.00 8208.73 3810.80 31651.46 00:29:55.901 [2024-11-16T16:49:33.393Z] =================================================================================================================== 00:29:55.901 [2024-11-16T16:49:33.393Z] Total : 15579.50 60.86 0.00 0.00 8208.73 3810.80 31651.46 00:29:55.901 0 00:29:55.901 17:49:33 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:55.901 17:49:33 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:55.901 17:49:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:55.901 17:49:33 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:55.901 | .driver_specific 00:29:55.901 | .nvme_error 00:29:55.901 | .status_code 00:29:55.901 | .command_transient_transport_error' 00:29:56.159 17:49:33 -- host/digest.sh@71 -- # (( 122 > 0 )) 00:29:56.159 17:49:33 -- host/digest.sh@73 -- # killprocess 1706797 00:29:56.159 17:49:33 -- common/autotest_common.sh@936 -- # '[' -z 1706797 ']' 00:29:56.159 17:49:33 -- common/autotest_common.sh@940 -- # kill -0 1706797 00:29:56.159 17:49:33 -- common/autotest_common.sh@941 -- # uname 00:29:56.159 17:49:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:56.159 17:49:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1706797 00:29:56.159 17:49:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:56.159 17:49:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:56.159 17:49:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1706797' 00:29:56.159 killing process with pid 1706797 00:29:56.159 17:49:33 -- common/autotest_common.sh@955 -- # kill 1706797 00:29:56.159 Received shutdown signal, test time was about 2.000000 seconds 00:29:56.159 00:29:56.159 Latency(us) 00:29:56.159 [2024-11-16T16:49:33.651Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:56.159 [2024-11-16T16:49:33.651Z] =================================================================================================================== 00:29:56.159 [2024-11-16T16:49:33.651Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:56.159 17:49:33 -- common/autotest_common.sh@960 -- # wait 1706797 00:29:56.417 17:49:33 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:56.417 17:49:33 -- host/digest.sh@54 -- # local rw bs qd 00:29:56.418 17:49:33 -- host/digest.sh@56 -- # rw=randread 00:29:56.418 17:49:33 -- host/digest.sh@56 -- # bs=131072 00:29:56.418 17:49:33 -- host/digest.sh@56 -- # qd=16 00:29:56.418 17:49:33 -- host/digest.sh@58 -- # bperfpid=1707345 00:29:56.418 17:49:33 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:56.418 17:49:33 -- host/digest.sh@60 -- # waitforlisten 1707345 /var/tmp/bperf.sock 00:29:56.418 17:49:33 -- common/autotest_common.sh@829 -- # '[' -z 1707345 ']' 00:29:56.418 17:49:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:56.418 17:49:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:56.418 17:49:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:56.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:56.418 17:49:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:56.418 17:49:33 -- common/autotest_common.sh@10 -- # set +x 00:29:56.418 [2024-11-16 17:49:33.778564] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:56.418 [2024-11-16 17:49:33.778647] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1707345 ] 00:29:56.418 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:56.418 Zero copy mechanism will not be used. 00:29:56.418 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.418 [2024-11-16 17:49:33.840068] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:56.676 [2024-11-16 17:49:33.927445] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:57.609 17:49:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:57.609 17:49:34 -- common/autotest_common.sh@862 -- # return 0 00:29:57.609 17:49:34 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:57.609 17:49:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:57.609 17:49:35 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:57.609 17:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.609 17:49:35 -- common/autotest_common.sh@10 -- # set +x 00:29:57.609 17:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.609 17:49:35 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:57.609 17:49:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:58.176 nvme0n1 00:29:58.176 17:49:35 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:58.176 17:49:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.176 17:49:35 -- common/autotest_common.sh@10 -- # set +x 00:29:58.176 17:49:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.176 17:49:35 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:58.176 17:49:35 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:58.176 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:58.176 Zero copy mechanism will not be used. 00:29:58.176 Running I/O for 2 seconds... 00:29:58.176 [2024-11-16 17:49:35.613826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.613898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.613922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.618684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.618723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.618744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.624052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.624080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.624111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.629536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.629565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.629598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.634901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.634946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.634963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.640258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.640288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.640320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.645577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.645607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.645653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.651968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.652017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.652038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.657052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.657087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.657106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.176 [2024-11-16 17:49:35.662807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.176 [2024-11-16 17:49:35.662836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.176 [2024-11-16 17:49:35.662869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.435 [2024-11-16 17:49:35.668655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.435 [2024-11-16 17:49:35.668685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.435 [2024-11-16 17:49:35.668718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.435 [2024-11-16 17:49:35.674264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.435 [2024-11-16 17:49:35.674298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.435 [2024-11-16 17:49:35.674318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.435 [2024-11-16 17:49:35.679936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.435 [2024-11-16 17:49:35.679965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.435 [2024-11-16 17:49:35.679997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.435 [2024-11-16 17:49:35.685494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.435 [2024-11-16 17:49:35.685529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.435 [2024-11-16 17:49:35.685548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.435 [2024-11-16 17:49:35.690893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.435 [2024-11-16 17:49:35.690922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.435 [2024-11-16 17:49:35.690953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.696484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.696518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.696539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.702128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.702163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.702182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.707670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.707699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.707738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.713457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.713491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.713511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.719068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.719102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.719123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.724664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.724708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.724725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.730069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.730103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.730124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.735649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.735698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.735715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.742077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.742111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.742131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.749459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.749494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.749514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.755279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.755328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.755348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.761159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.761194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.761214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.767180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.767211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.767244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.772336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.772371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.772390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.778691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.778721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.778756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.785814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.785845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.785877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.791636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.791693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.791715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.798400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.798436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.798456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.805550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.805586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.805607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.813562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.813598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.813662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.820366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.820395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.820427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.828014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.828050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.828070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.835524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.835561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.835594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.842924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.842971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.842992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.849984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.850035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.850055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.856997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.857047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.436 [2024-11-16 17:49:35.857066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.436 [2024-11-16 17:49:35.866215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.436 [2024-11-16 17:49:35.866246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.866301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.437 [2024-11-16 17:49:35.872534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.437 [2024-11-16 17:49:35.872569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.872589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.437 [2024-11-16 17:49:35.880226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.437 [2024-11-16 17:49:35.880263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.880300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.437 [2024-11-16 17:49:35.887521] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.437 [2024-11-16 17:49:35.887567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.887590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.437 [2024-11-16 17:49:35.895021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.437 [2024-11-16 17:49:35.895066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.895083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.437 [2024-11-16 17:49:35.902512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.437 [2024-11-16 17:49:35.902542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.902574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.437 [2024-11-16 17:49:35.909638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.437 [2024-11-16 17:49:35.909669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.909702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.437 [2024-11-16 17:49:35.916661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.437 [2024-11-16 17:49:35.916708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.916726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.437 [2024-11-16 17:49:35.924202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.437 [2024-11-16 17:49:35.924233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.437 [2024-11-16 17:49:35.924252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.932043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.932075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.932111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.939120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.939151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.939184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.946260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.946291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.946324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.953801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.953831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.953864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.962101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.962130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.962162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.969580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.969610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.969653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.976066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.976096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.976128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.981649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.981679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.981713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.987489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.987520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.987537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.993491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.993521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.993554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:35.999694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:35.999725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:35.999764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:36.005714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:36.005745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:36.005763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:36.011886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:36.011932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:36.011950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:36.017814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.696 [2024-11-16 17:49:36.017844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.696 [2024-11-16 17:49:36.017877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.696 [2024-11-16 17:49:36.023950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.023985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.024005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.029789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.029819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.029852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.035663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.035693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.035726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.041362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.041392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.041426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.047982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.048017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.048037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.055591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.055659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.055679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.061590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.061643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.061663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.067516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.067551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.067584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.073522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.073552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.073585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.079509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.079538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.079571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.085324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.085353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.085387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.091867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.091902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.091922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.099361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.099411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.099428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.105498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.105529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.105568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.111558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.111588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.111628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.117386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.117416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.117449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.123273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.123304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.123338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.129422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.129452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.129470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.135499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.135529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.135547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.142191] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.142226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.142246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.147774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.147805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.147837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.153261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.153292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.153310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.158565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.158622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.158668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.163958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.163989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.164022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.169900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.169947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.169968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.177101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.177135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.177169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.697 [2024-11-16 17:49:36.184429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.697 [2024-11-16 17:49:36.184459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.697 [2024-11-16 17:49:36.184495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.191867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.191898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.191917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.199540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.199574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.199592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.206333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.206369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.206389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.212806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.212837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.212856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.218925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.218956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.218975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.225182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.225227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.225245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.231287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.231318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.231337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.237477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.237525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.237542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.243766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.243798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.243816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.249644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.249684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.249702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.255383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.255416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.255452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.262742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.262773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.262791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.270152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.270199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.270225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.277121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.277152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.277169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.284192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.284240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.284260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.291613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.957 [2024-11-16 17:49:36.291653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.957 [2024-11-16 17:49:36.291687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.957 [2024-11-16 17:49:36.298831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.298862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.298880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.304859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.304891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.304928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.309063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.309099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.309119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.316702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.316733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.316751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.322831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.322861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.322877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.330422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.330470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.330490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.338746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.338780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.338801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.346252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.346288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.346308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.353330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.353365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.353385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.359275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.359305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.359322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.364660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.364707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.364725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.370146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.370179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.370199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.375733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.375764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.375783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.381750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.381781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.381799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.388610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.388652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.388673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.394695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.394724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.394742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.400442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.400476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.400496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.406305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.406340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.406359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.412020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.412050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.412067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.417433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.417467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.417486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.422733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.422763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.422780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.427988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.428018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.428036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.433436] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.433472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.433507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.438768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.438798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.438815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:58.958 [2024-11-16 17:49:36.444167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:58.958 [2024-11-16 17:49:36.444198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:58.958 [2024-11-16 17:49:36.444216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.449504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.449539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.449560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.455745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.455776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.455794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.460499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.460534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.460555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.465866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.465897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.465929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.471279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.471313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.471334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.476941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.476970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.476987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.482424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.482460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.482480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.487871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.487904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.487922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.493461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.493496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.493516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.499046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.218 [2024-11-16 17:49:36.499081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.218 [2024-11-16 17:49:36.499101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.218 [2024-11-16 17:49:36.505002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.505033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.505051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.512163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.512195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.512213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.518905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.518938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.518956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.524587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.524629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.524651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.530883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.530933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.530964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.536843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.536873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.536904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.544102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.544137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.544158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.550934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.550969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.550990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.556860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.556906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.556927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.562769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.562799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.562816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.569027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.569065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.569091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.575089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.575119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.575136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.582204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.582252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.582270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.589356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.589393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.589411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.596293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.596323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.596341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.603421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.603457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.603478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.610438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.610474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.610495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.616501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.616537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.616556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.621985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.622016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.622034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.627290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.627322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.627340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.632878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.632928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.632948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.638728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.638759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.638776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.644504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.644540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.644560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.650771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.650801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.650819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.657735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.657764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.657782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.664013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.664048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.664069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.219 [2024-11-16 17:49:36.670133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.219 [2024-11-16 17:49:36.670181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.219 [2024-11-16 17:49:36.670201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.220 [2024-11-16 17:49:36.676051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.220 [2024-11-16 17:49:36.676085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.220 [2024-11-16 17:49:36.676105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.220 [2024-11-16 17:49:36.682257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.220 [2024-11-16 17:49:36.682301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.220 [2024-11-16 17:49:36.682318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.220 [2024-11-16 17:49:36.688300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.220 [2024-11-16 17:49:36.688334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.220 [2024-11-16 17:49:36.688354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.220 [2024-11-16 17:49:36.694579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.220 [2024-11-16 17:49:36.694613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.220 [2024-11-16 17:49:36.694651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.220 [2024-11-16 17:49:36.701745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.220 [2024-11-16 17:49:36.701777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.220 [2024-11-16 17:49:36.701795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.220 [2024-11-16 17:49:36.708960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.220 [2024-11-16 17:49:36.709009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.220 [2024-11-16 17:49:36.709030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.479 [2024-11-16 17:49:36.715233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.715268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.715288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.721303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.721352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.721373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.727340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.727389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.727442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.732237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.732272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.732292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.737000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.737031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.737049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.742731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.742790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.742813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.748911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.748969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.748989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.754452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.754486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.754506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.760325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.760370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.760392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.766387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.766422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.766443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.773363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.773398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.773419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.780544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.780576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.780594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.786606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.786657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.786693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.793003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.793032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.793049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.799355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.799401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.799418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.805980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.806012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.806030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.812848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.812879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.812912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.820467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.820498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.820516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.827518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.827548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.827565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.834454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.834485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.834503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.840973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.841008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.841043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.846155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.846190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.846210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.853576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.853629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.853649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.860773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.860804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.860845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.868505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.868538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.868556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.876095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.480 [2024-11-16 17:49:36.876130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.480 [2024-11-16 17:49:36.876150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.480 [2024-11-16 17:49:36.883636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.883687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.883706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.889713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.889744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.889762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.895384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.895416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.895434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.901394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.901429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.901449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.907338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.907384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.907402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.913286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.913316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.913333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.919657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.919689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.919708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.926055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.926086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.926103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.932764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.932795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.932812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.938548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.938583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.938604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.944426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.944457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.944489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.950184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.950231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.950248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.955550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.955582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.955601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.960925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.960974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.960992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.481 [2024-11-16 17:49:36.966440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.481 [2024-11-16 17:49:36.966476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.481 [2024-11-16 17:49:36.966505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:36.971855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:36.971887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:36.971905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:36.977707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:36.977753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:36.977772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:36.983250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:36.983285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:36.983306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:36.988790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:36.988821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:36.988838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:36.994294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:36.994330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:36.994350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:36.999868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:36.999900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:36.999932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.005840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.005871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.005889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.011374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.011424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.011444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.016791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.016844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.016863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.022260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.022291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.022308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.027652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.027704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.027723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.033358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.033390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.033426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.038917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.038953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.038973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.044359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.044389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.044407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.049916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.049961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.049978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.056162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.056194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.056213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.062398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.062430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.062463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.069143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.069189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.069207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.075364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.075411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.075429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.081287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.081327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.081347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.087249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.087295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.087312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.741 [2024-11-16 17:49:37.093287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.741 [2024-11-16 17:49:37.093322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.741 [2024-11-16 17:49:37.093342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.099185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.099222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.099242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.105182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.105217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.105238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.110772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.110804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.110822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.116359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.116395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.116428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.121916] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.121964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.121984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.128076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.128125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.128145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.135452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.135484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.135501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.142256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.142291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.142311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.148433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.148463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.148481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.154608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.154650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.154684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.160452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.160487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.160507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.166448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.166497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.166517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.173705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.173745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.173764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.180422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.180457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.180478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.186311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.186358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.186376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.192093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.192139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.192156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.198678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.198710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.198729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.204337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.204374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.204395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.209921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.209953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.209970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.215210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.215240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.215258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.220711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.220743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.220761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:59.742 [2024-11-16 17:49:37.226712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:29:59.742 [2024-11-16 17:49:37.226743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:59.742 [2024-11-16 17:49:37.226761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.232783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.232816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.232854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.237510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.237557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.237578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.242431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.242487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.242511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.247309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.247341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.247358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.253100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.253146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.253164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.259110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.259140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.259157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.265185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.265221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.265241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.271049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.271085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.271113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.276903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.276950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.276969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.282809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.282840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.282858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.288415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.288459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.288476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.294507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.294538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.294572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.301990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.302020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.302037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.308523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.308567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.308584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.314639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.314677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.002 [2024-11-16 17:49:37.314694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.002 [2024-11-16 17:49:37.320880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.002 [2024-11-16 17:49:37.320937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.320958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.327003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.327038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.327058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.333066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.333110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.333127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.338818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.338849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.338867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.344639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.344669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.344687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.352008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.352038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.352057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.358423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.358467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.358486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.364899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.364941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.364959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.371388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.371418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.371436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.378641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.378672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.378695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.386211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.386241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.386257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.393871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.393918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.393935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.401377] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.401408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.401426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.408289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.408324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.408345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.414837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.414868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.414885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.422486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.422517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.422535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.429327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.429363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.429383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.435597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.435652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.435672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.441427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.441463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.441497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.447064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.447099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.447119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.452774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.452821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.452841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.459605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.459664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.459685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.465747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.465793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.465811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.472121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.472165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.472181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.479495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.479531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.479551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.003 [2024-11-16 17:49:37.487026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.003 [2024-11-16 17:49:37.487056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.003 [2024-11-16 17:49:37.487074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.494477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.494513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.494533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.500482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.500527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.500543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.506412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.506447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.506467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.512693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.512722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.512740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.518031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.518061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.518078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.523583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.523614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.523640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.528967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.529017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.529037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.534522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.534552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.534585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.540042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.540089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.540110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.545380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.545424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.545446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.262 [2024-11-16 17:49:37.550663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.262 [2024-11-16 17:49:37.550694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.262 [2024-11-16 17:49:37.550712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.555937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.555967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.555999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.561250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.561281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.561298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.566771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.566803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.566821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.572244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.572274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.572291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.577584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.577614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.577653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.582949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.582995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.583015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.588389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.588419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.588436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.593771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.593801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.593819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.599431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.599460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.599477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.263 [2024-11-16 17:49:37.604704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x19f1190) 00:30:00.263 [2024-11-16 17:49:37.604734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.263 [2024-11-16 17:49:37.604751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.263 00:30:00.263 Latency(us) 00:30:00.263 [2024-11-16T16:49:37.755Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:00.263 [2024-11-16T16:49:37.755Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:30:00.263 nvme0n1 : 2.00 4999.17 624.90 0.00 0.00 3196.46 649.29 9563.40 00:30:00.263 [2024-11-16T16:49:37.755Z] =================================================================================================================== 00:30:00.263 [2024-11-16T16:49:37.755Z] Total : 4999.17 624.90 0.00 0.00 3196.46 649.29 9563.40 00:30:00.263 0 00:30:00.263 17:49:37 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:00.263 17:49:37 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:00.263 17:49:37 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:00.263 | .driver_specific 00:30:00.263 | .nvme_error 00:30:00.263 | .status_code 00:30:00.263 | .command_transient_transport_error' 00:30:00.263 17:49:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:00.521 17:49:37 -- host/digest.sh@71 -- # (( 322 > 0 )) 00:30:00.521 17:49:37 -- host/digest.sh@73 -- # killprocess 1707345 00:30:00.521 17:49:37 -- common/autotest_common.sh@936 -- # '[' -z 1707345 ']' 00:30:00.521 17:49:37 -- common/autotest_common.sh@940 -- # kill -0 1707345 00:30:00.521 17:49:37 -- common/autotest_common.sh@941 -- # uname 00:30:00.521 17:49:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:00.521 17:49:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1707345 00:30:00.521 17:49:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:00.521 17:49:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:00.521 17:49:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1707345' 00:30:00.521 killing process with pid 1707345 00:30:00.521 17:49:37 -- common/autotest_common.sh@955 -- # kill 1707345 00:30:00.521 Received shutdown signal, test time was about 2.000000 seconds 00:30:00.521 00:30:00.521 Latency(us) 00:30:00.521 [2024-11-16T16:49:38.013Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:00.521 [2024-11-16T16:49:38.013Z] =================================================================================================================== 00:30:00.521 [2024-11-16T16:49:38.013Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:00.521 17:49:37 -- common/autotest_common.sh@960 -- # wait 1707345 00:30:00.779 17:49:38 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:30:00.779 17:49:38 -- host/digest.sh@54 -- # local rw bs qd 00:30:00.779 17:49:38 -- host/digest.sh@56 -- # rw=randwrite 00:30:00.779 17:49:38 -- host/digest.sh@56 -- # bs=4096 00:30:00.779 17:49:38 -- host/digest.sh@56 -- # qd=128 00:30:00.779 17:49:38 -- host/digest.sh@58 -- # bperfpid=1707814 00:30:00.779 17:49:38 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:30:00.779 17:49:38 -- host/digest.sh@60 -- # waitforlisten 1707814 /var/tmp/bperf.sock 00:30:00.779 17:49:38 -- common/autotest_common.sh@829 -- # '[' -z 1707814 ']' 00:30:00.779 17:49:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:00.779 17:49:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:00.779 17:49:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:00.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:00.779 17:49:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:00.779 17:49:38 -- common/autotest_common.sh@10 -- # set +x 00:30:00.779 [2024-11-16 17:49:38.182406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:00.779 [2024-11-16 17:49:38.182496] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1707814 ] 00:30:00.779 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.779 [2024-11-16 17:49:38.244011] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:01.037 [2024-11-16 17:49:38.336812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:01.037 17:49:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:01.037 17:49:38 -- common/autotest_common.sh@862 -- # return 0 00:30:01.037 17:49:38 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:01.037 17:49:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:01.295 17:49:38 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:01.295 17:49:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.295 17:49:38 -- common/autotest_common.sh@10 -- # set +x 00:30:01.295 17:49:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.295 17:49:38 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:01.295 17:49:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:01.870 nvme0n1 00:30:01.870 17:49:39 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:30:01.870 17:49:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.870 17:49:39 -- common/autotest_common.sh@10 -- # set +x 00:30:01.870 17:49:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.870 17:49:39 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:01.870 17:49:39 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:01.870 Running I/O for 2 seconds... 00:30:01.870 [2024-11-16 17:49:39.341741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f6890 00:30:01.870 [2024-11-16 17:49:39.342191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.870 [2024-11-16 17:49:39.342227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:30:01.870 [2024-11-16 17:49:39.354676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190fc128 00:30:01.870 [2024-11-16 17:49:39.356087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25037 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.870 [2024-11-16 17:49:39.356122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.366847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f6cc8 00:30:02.136 [2024-11-16 17:49:39.368251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:4676 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.368285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.379245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190fc998 00:30:02.136 [2024-11-16 17:49:39.380714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:20388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.380744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.391111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f57b0 00:30:02.136 [2024-11-16 17:49:39.392569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:4111 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.392602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.402895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190fef90 00:30:02.136 [2024-11-16 17:49:39.404388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:22965 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.404418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.415088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f7538 00:30:02.136 [2024-11-16 17:49:39.416666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:22508 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.416697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.427302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f35f0 00:30:02.136 [2024-11-16 17:49:39.428923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:4281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.428954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.439786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f0350 00:30:02.136 [2024-11-16 17:49:39.440495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:449 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.440527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.451878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190fdeb0 00:30:02.136 [2024-11-16 17:49:39.452841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:20076 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.452870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.463936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190eb328 00:30:02.136 [2024-11-16 17:49:39.464906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:12331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.136 [2024-11-16 17:49:39.464935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:02.136 [2024-11-16 17:49:39.475991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190ed0b0 00:30:02.137 [2024-11-16 17:49:39.476921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:1208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.476949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.488233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190fa3a0 00:30:02.137 [2024-11-16 17:49:39.489141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:17709 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.489174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.500212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190ed4e8 00:30:02.137 [2024-11-16 17:49:39.501039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:4069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.501074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.511643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f7970 00:30:02.137 [2024-11-16 17:49:39.513016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:23010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.513046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.524852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.137 [2024-11-16 17:49:39.525085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:4042 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.525114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.538409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.137 [2024-11-16 17:49:39.538669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:7466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.538698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.551934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.137 [2024-11-16 17:49:39.552180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:21504 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.552209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.565545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.137 [2024-11-16 17:49:39.565817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:19805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.565850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.579174] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.137 [2024-11-16 17:49:39.579424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:25354 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.579457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.592807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.137 [2024-11-16 17:49:39.593043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24827 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.593073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.606439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.137 [2024-11-16 17:49:39.606708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:12430 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.606738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.137 [2024-11-16 17:49:39.620237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.137 [2024-11-16 17:49:39.620469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:6746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.137 [2024-11-16 17:49:39.620498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.633777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.634015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:19072 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.634044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.647245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.647490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:18007 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.647520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.660878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.661139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:14675 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.661168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.674432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.674694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:16902 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.674724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.688101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.688349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1830 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.688377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.701717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.701999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:7011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.702027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.715301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.715522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:9725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.715551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.729013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.729270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:10495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.729299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.742603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.742878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:11494 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.742906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.756257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.756502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:1204 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.756530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.769788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.769996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:16433 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.395 [2024-11-16 17:49:39.770024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.395 [2024-11-16 17:49:39.783304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.395 [2024-11-16 17:49:39.783543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13650 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.396 [2024-11-16 17:49:39.783571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.396 [2024-11-16 17:49:39.796818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.396 [2024-11-16 17:49:39.797081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:154 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.396 [2024-11-16 17:49:39.797110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.396 [2024-11-16 17:49:39.810375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.396 [2024-11-16 17:49:39.810665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:19280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.396 [2024-11-16 17:49:39.810693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.396 [2024-11-16 17:49:39.823948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.396 [2024-11-16 17:49:39.824187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:12669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.396 [2024-11-16 17:49:39.824216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.396 [2024-11-16 17:49:39.837405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.396 [2024-11-16 17:49:39.837659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:20604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.396 [2024-11-16 17:49:39.837688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.396 [2024-11-16 17:49:39.850963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.396 [2024-11-16 17:49:39.851235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:25097 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.396 [2024-11-16 17:49:39.851266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.396 [2024-11-16 17:49:39.864760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.396 [2024-11-16 17:49:39.864997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:2733 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.396 [2024-11-16 17:49:39.865025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.396 [2024-11-16 17:49:39.878333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.396 [2024-11-16 17:49:39.878582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.396 [2024-11-16 17:49:39.878611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:39.891933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:39.892176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:19821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:39.892203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:39.905577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:39.905825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:18927 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:39.905855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:39.919320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:39.919558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:39.919587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:39.932893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:39.933113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:18268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:39.933147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:39.946474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:39.946730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:11903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:39.946759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:39.960017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:39.960261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19444 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:39.960290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:39.973608] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:39.973898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5549 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:39.973941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:39.987265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:39.987485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:191 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:39.987513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.000908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.001212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:898 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.001260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.014626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.014896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:11443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.014938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.028002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.028274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:2669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.028311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.041843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.042133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:14051 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.042167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.055524] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.055784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:7090 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.055828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.069410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.069680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1971 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.069710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.083313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.083576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:14882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.083605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.097120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.097346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:24839 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.097379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.110931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.111189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:15294 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.111219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.124470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.124730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:8561 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.124760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.655 [2024-11-16 17:49:40.138301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.655 [2024-11-16 17:49:40.138561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:17012 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.655 [2024-11-16 17:49:40.138591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.151812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.152027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:23135 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.152056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.165086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.165323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18371 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.165351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.178668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.178910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:9555 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.178954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.192316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.192568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:1911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.192612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.205936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.206188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:5131 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.206217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.219491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.219760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.219790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.233162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.233410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:1974 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.233438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.246849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.247081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:4528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.247109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.260434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.260708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.260737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.274090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.914 [2024-11-16 17:49:40.274357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:17757 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.914 [2024-11-16 17:49:40.274385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.914 [2024-11-16 17:49:40.287849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.288138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:15328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.288166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.915 [2024-11-16 17:49:40.301444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.301728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:14359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.301758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.915 [2024-11-16 17:49:40.315170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.315436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.315469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.915 [2024-11-16 17:49:40.328976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.329226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:16988 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.329254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.915 [2024-11-16 17:49:40.342836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.343101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:22029 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.343128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.915 [2024-11-16 17:49:40.356694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.356924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22031 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.356954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.915 [2024-11-16 17:49:40.370404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.370608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:3433 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.370645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.915 [2024-11-16 17:49:40.383864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.384099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:22058 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.384132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:02.915 [2024-11-16 17:49:40.397404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:02.915 [2024-11-16 17:49:40.397641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:18789 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:02.915 [2024-11-16 17:49:40.397671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.173 [2024-11-16 17:49:40.410856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.173 [2024-11-16 17:49:40.411140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:24943 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.173 [2024-11-16 17:49:40.411184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.173 [2024-11-16 17:49:40.424639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.173 [2024-11-16 17:49:40.424896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:24694 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.173 [2024-11-16 17:49:40.424934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.173 [2024-11-16 17:49:40.438398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.173 [2024-11-16 17:49:40.438675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:18454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.173 [2024-11-16 17:49:40.438706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.173 [2024-11-16 17:49:40.452241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.173 [2024-11-16 17:49:40.452507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.173 [2024-11-16 17:49:40.452540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.173 [2024-11-16 17:49:40.465961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.173 [2024-11-16 17:49:40.466224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:20605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.173 [2024-11-16 17:49:40.466256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.173 [2024-11-16 17:49:40.479760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.173 [2024-11-16 17:49:40.479993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:14479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.173 [2024-11-16 17:49:40.480024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.173 [2024-11-16 17:49:40.493457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.173 [2024-11-16 17:49:40.493724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:21210 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.173 [2024-11-16 17:49:40.493753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.507035] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.507270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:23278 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.507297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.520529] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.520800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:3052 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.520829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.534134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.534376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:3188 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.534405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.547692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.547941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3750 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.547970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.561252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.561490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:21538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.561519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.574895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.575120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:3299 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.575148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.588331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.588565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:16088 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.588592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.601911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.602155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:17175 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.602183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.615525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.615776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:10376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.615804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.629148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.629414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:8952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.629460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.642818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.643047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.643075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.174 [2024-11-16 17:49:40.656375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.174 [2024-11-16 17:49:40.656659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:17721 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.174 [2024-11-16 17:49:40.656687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.432 [2024-11-16 17:49:40.669834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.432 [2024-11-16 17:49:40.670077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.432 [2024-11-16 17:49:40.670106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.432 [2024-11-16 17:49:40.683394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.432 [2024-11-16 17:49:40.683652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:18992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.432 [2024-11-16 17:49:40.683694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.432 [2024-11-16 17:49:40.697202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.432 [2024-11-16 17:49:40.697442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:1428 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.432 [2024-11-16 17:49:40.697470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.432 [2024-11-16 17:49:40.710739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.432 [2024-11-16 17:49:40.711010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:1419 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.432 [2024-11-16 17:49:40.711038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.432 [2024-11-16 17:49:40.724220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.432 [2024-11-16 17:49:40.724490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:5438 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.724519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.737909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.738187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18689 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.738214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.751486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.751785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:7423 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.751815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.765208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.765456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:25083 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.765489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.778846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.779099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:18449 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.779127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.792506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.792769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:12879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.792799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.806005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.806261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:19726 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.806290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.819643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.819896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:22501 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.819924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.833315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.833559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.833588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.846948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.847197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.847225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.860506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.860761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:14883 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.860790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.874063] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.874306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:19992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.874334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.887627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.887938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:14841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.887968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.901200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.901431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:16940 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.901473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.433 [2024-11-16 17:49:40.914830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.433 [2024-11-16 17:49:40.915059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:11409 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.433 [2024-11-16 17:49:40.915087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:40.928459] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:40.928719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15057 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:40.928749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:40.942017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:40.942258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:40.942286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:40.955643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:40.955879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:20148 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:40.955921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:40.969272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:40.969530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20119 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:40.969559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:40.982848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:40.983075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:17852 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:40.983107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:40.996437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:40.996692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:7738 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:40.996722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:41.009924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:41.010171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:5554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:41.010200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:41.023566] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:41.023835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2665 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:41.023863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:41.037239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:41.037480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:2552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.691 [2024-11-16 17:49:41.037509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.691 [2024-11-16 17:49:41.050956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.691 [2024-11-16 17:49:41.051189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:1411 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.051217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.064440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.064684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:9785 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.064714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.077977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.078216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.078246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.091551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.091916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:3091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.091960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.105209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.105478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:5218 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.105507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.118846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.119064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3022 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.119093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.132214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.132484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:23522 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.132517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.145899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.146148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.146177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.159312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.159552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:4387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.159580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.692 [2024-11-16 17:49:41.172954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.692 [2024-11-16 17:49:41.173198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:14441 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.692 [2024-11-16 17:49:41.173227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.186592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.186922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:14238 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.186952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.200201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.200446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:15177 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.200474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.213814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.214026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16125 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.214053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.227447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.227715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:25197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.227743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.241288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.241516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.241554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.254868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.255166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:7856 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.255194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.268392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.268633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:21531 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.268679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.281893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.282183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:11953 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.282212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.295493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.950 [2024-11-16 17:49:41.295712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:4296 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.950 [2024-11-16 17:49:41.295741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.950 [2024-11-16 17:49:41.308904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.951 [2024-11-16 17:49:41.309184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9354 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.951 [2024-11-16 17:49:41.309212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.951 [2024-11-16 17:49:41.322278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.951 [2024-11-16 17:49:41.322521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:19350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.951 [2024-11-16 17:49:41.322553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.951 [2024-11-16 17:49:41.335994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5783f0) with pdu=0x2000190f2510 00:30:03.951 [2024-11-16 17:49:41.336187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:24185 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:03.951 [2024-11-16 17:49:41.336214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:30:03.951 00:30:03.951 Latency(us) 00:30:03.951 [2024-11-16T16:49:41.443Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:03.951 [2024-11-16T16:49:41.443Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:03.951 nvme0n1 : 2.01 18958.28 74.06 0.00 0.00 6736.57 2997.67 14466.47 00:30:03.951 [2024-11-16T16:49:41.443Z] =================================================================================================================== 00:30:03.951 [2024-11-16T16:49:41.443Z] Total : 18958.28 74.06 0.00 0.00 6736.57 2997.67 14466.47 00:30:03.951 0 00:30:03.951 17:49:41 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:03.951 17:49:41 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:03.951 17:49:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:03.951 17:49:41 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:03.951 | .driver_specific 00:30:03.951 | .nvme_error 00:30:03.951 | .status_code 00:30:03.951 | .command_transient_transport_error' 00:30:04.209 17:49:41 -- host/digest.sh@71 -- # (( 149 > 0 )) 00:30:04.209 17:49:41 -- host/digest.sh@73 -- # killprocess 1707814 00:30:04.209 17:49:41 -- common/autotest_common.sh@936 -- # '[' -z 1707814 ']' 00:30:04.209 17:49:41 -- common/autotest_common.sh@940 -- # kill -0 1707814 00:30:04.209 17:49:41 -- common/autotest_common.sh@941 -- # uname 00:30:04.209 17:49:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:04.209 17:49:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1707814 00:30:04.209 17:49:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:04.209 17:49:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:04.209 17:49:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1707814' 00:30:04.209 killing process with pid 1707814 00:30:04.209 17:49:41 -- common/autotest_common.sh@955 -- # kill 1707814 00:30:04.209 Received shutdown signal, test time was about 2.000000 seconds 00:30:04.209 00:30:04.209 Latency(us) 00:30:04.209 [2024-11-16T16:49:41.701Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:04.209 [2024-11-16T16:49:41.701Z] =================================================================================================================== 00:30:04.209 [2024-11-16T16:49:41.701Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:04.209 17:49:41 -- common/autotest_common.sh@960 -- # wait 1707814 00:30:04.506 17:49:41 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:04.506 17:49:41 -- host/digest.sh@54 -- # local rw bs qd 00:30:04.506 17:49:41 -- host/digest.sh@56 -- # rw=randwrite 00:30:04.506 17:49:41 -- host/digest.sh@56 -- # bs=131072 00:30:04.506 17:49:41 -- host/digest.sh@56 -- # qd=16 00:30:04.506 17:49:41 -- host/digest.sh@58 -- # bperfpid=1708319 00:30:04.506 17:49:41 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:04.506 17:49:41 -- host/digest.sh@60 -- # waitforlisten 1708319 /var/tmp/bperf.sock 00:30:04.506 17:49:41 -- common/autotest_common.sh@829 -- # '[' -z 1708319 ']' 00:30:04.506 17:49:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:04.506 17:49:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:04.506 17:49:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:04.506 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:04.506 17:49:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:04.506 17:49:41 -- common/autotest_common.sh@10 -- # set +x 00:30:04.507 [2024-11-16 17:49:41.935963] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:04.507 [2024-11-16 17:49:41.936049] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1708319 ] 00:30:04.507 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:04.507 Zero copy mechanism will not be used. 00:30:04.507 EAL: No free 2048 kB hugepages reported on node 1 00:30:04.788 [2024-11-16 17:49:41.997393] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:04.788 [2024-11-16 17:49:42.087239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:05.723 17:49:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:05.723 17:49:42 -- common/autotest_common.sh@862 -- # return 0 00:30:05.723 17:49:42 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:05.723 17:49:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:05.723 17:49:43 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:05.723 17:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:05.723 17:49:43 -- common/autotest_common.sh@10 -- # set +x 00:30:05.723 17:49:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:05.723 17:49:43 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:05.723 17:49:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:06.289 nvme0n1 00:30:06.289 17:49:43 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:06.289 17:49:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:06.289 17:49:43 -- common/autotest_common.sh@10 -- # set +x 00:30:06.289 17:49:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:06.289 17:49:43 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:06.289 17:49:43 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:06.289 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:06.289 Zero copy mechanism will not be used. 00:30:06.289 Running I/O for 2 seconds... 00:30:06.289 [2024-11-16 17:49:43.779863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.289 [2024-11-16 17:49:43.780174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.289 [2024-11-16 17:49:43.780220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.784734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.784977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.785014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.789941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.790144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.790181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.795037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.795219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.795253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.800232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.800398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.800435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.805467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.805645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.805691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.811222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.811346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.811378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.817385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.817664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.817695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.823119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.823371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.823409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.828762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.828997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.829027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.834037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.834152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.834185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.838938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.839109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.839147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.844075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.844262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.844293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.849541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.849790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.849823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.854868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.855118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.855153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.860341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.860662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.860699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.865343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.865586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.865629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.869898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.870028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.870057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.875263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.875419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.875451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.880445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.880632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.880682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.886793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.886913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.886946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.891723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.891882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.891916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.896294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.896483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.896515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.901046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.901267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.901299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.905820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.906101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.906131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.910271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.910400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.550 [2024-11-16 17:49:43.910433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.550 [2024-11-16 17:49:43.914879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.550 [2024-11-16 17:49:43.915027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.915056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.919575] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.919719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.919754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.924866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.925039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.925070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.930394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.930634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.930682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.936646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.936823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.936852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.941001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.941126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.941170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.945687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.945834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.945868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.950394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.950536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.950574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.955103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.955289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.955329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.959642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.959794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.959823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.964064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.964218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.964249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.968827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.969029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.969058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.974126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.974241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.974273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.979086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.979322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.979354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.983895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.984139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.984178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.989238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.989398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.989426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:43.994604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:43.994784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:43.994812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:44.000599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:44.000761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:44.000791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:44.006234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:44.006343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:44.006374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:44.011491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:44.011683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:44.011712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:44.016928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:44.017141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:44.017174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:44.022270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:44.022345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:44.022374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:44.028342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:44.028550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:44.028582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:44.033971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:44.034119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:44.034150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.551 [2024-11-16 17:49:44.040197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.551 [2024-11-16 17:49:44.040350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.551 [2024-11-16 17:49:44.040380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.810 [2024-11-16 17:49:44.045549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.810 [2024-11-16 17:49:44.045791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.810 [2024-11-16 17:49:44.045821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.810 [2024-11-16 17:49:44.050946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.051212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.051244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.055449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.055670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.055706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.060485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.060732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.060762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.065517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.065681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.065710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.070722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.070874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.070903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.075760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.075989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.076023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.080948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.081194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.081233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.087340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.087587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.087627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.092142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.092317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.092356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.096662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.096883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.096912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.101303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.101423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.101454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.105774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.105927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.105957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.110404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.110547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.110578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.115806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.116039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.116075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.121028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.121196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.121234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.126565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.126890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.126924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.132884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.133177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.133210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.137612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.137753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.137781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.142057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.142184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.142217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.146783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.146869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.146898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.152416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.152519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.152550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.157079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.157249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.157281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.162010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.162213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.162261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.167405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.167720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.167749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.811 [2024-11-16 17:49:44.173336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.811 [2024-11-16 17:49:44.173465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.811 [2024-11-16 17:49:44.173497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.179513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.179689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.179719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.184039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.184172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.184212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.188607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.188778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.188808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.193737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.193820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.193849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.198814] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.198925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.198955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.203214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.203371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.203404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.207722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.207911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.207945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.212203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.212439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.212471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.216676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.216812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.216841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.221056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.221183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.221215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.225457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.225567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.225600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.229829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.229923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.229952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.234184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.234286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.234317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.238811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.238939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.238968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.243261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.243506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.243539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.247702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.247919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.247953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.252086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.252248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.252280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.256487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.256632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.256678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.260871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.260975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.261009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.265206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.265321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.265353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.269627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.269778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.269806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.273987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.274125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.274163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.278486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.812 [2024-11-16 17:49:44.278736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.812 [2024-11-16 17:49:44.278765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.812 [2024-11-16 17:49:44.282833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.813 [2024-11-16 17:49:44.283052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.813 [2024-11-16 17:49:44.283081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:06.813 [2024-11-16 17:49:44.287320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.813 [2024-11-16 17:49:44.287474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.813 [2024-11-16 17:49:44.287506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:06.813 [2024-11-16 17:49:44.291708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.813 [2024-11-16 17:49:44.291807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.813 [2024-11-16 17:49:44.291835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:06.813 [2024-11-16 17:49:44.295963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.813 [2024-11-16 17:49:44.296065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.813 [2024-11-16 17:49:44.296102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:06.813 [2024-11-16 17:49:44.300424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:06.813 [2024-11-16 17:49:44.300532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:06.813 [2024-11-16 17:49:44.300564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.305363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.305479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.305511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.310271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.310385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.310418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.315392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.315639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.315687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.320502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.320717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.320747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.325400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.325504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.325549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.330144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.330257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.330295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.335022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.335135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.335168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.340009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.340126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.340158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.345012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.345172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.345204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.350057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.350230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.350262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.355086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.355300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.355340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.359940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.360094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.360127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.365398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.365583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.365625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.072 [2024-11-16 17:49:44.370253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.072 [2024-11-16 17:49:44.370401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.072 [2024-11-16 17:49:44.370443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.375318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.375409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.375439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.380255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.380329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.380365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.385146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.385317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.385348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.390266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.390406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.390445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.395466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.395692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.395722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.400526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.400706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.400743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.405588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.405748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.405778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.410679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.410761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.410790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.415910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.416026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.416056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.420847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.420955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.420984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.426249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.426506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.426545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.431946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.432092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.432125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.437910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.438132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.438188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.443298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.443601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.443643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.448559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.448710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.448747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.453415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.453569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.453601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.458435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.458678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.458708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.463885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.464094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.464122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.469943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.470100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.470131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.474774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.474912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.474941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.479280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.479425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.479464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.484356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.484464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.484496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.489426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.489545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.489578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.493799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.493905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.493934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.498234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.498357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.498389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.502950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.503092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.503130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.073 [2024-11-16 17:49:44.508409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.073 [2024-11-16 17:49:44.508683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.073 [2024-11-16 17:49:44.508713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.514122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.514402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.514434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.520031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.520274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.520307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.524831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.524973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.525002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.529378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.529551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.529583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.534661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.534816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.534845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.539810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.539919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.539948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.544482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.544672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.544701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.549797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.549994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.550022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.555320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.555524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.555553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.074 [2024-11-16 17:49:44.561323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.074 [2024-11-16 17:49:44.561517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.074 [2024-11-16 17:49:44.561549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.565904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.566043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.333 [2024-11-16 17:49:44.566075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.570361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.570522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.333 [2024-11-16 17:49:44.570560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.575610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.575715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.333 [2024-11-16 17:49:44.575742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.581089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.581218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.333 [2024-11-16 17:49:44.581246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.585598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.585744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.333 [2024-11-16 17:49:44.585779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.590162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.590407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.333 [2024-11-16 17:49:44.590439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.595407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.595705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.333 [2024-11-16 17:49:44.595734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.601140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.601378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.333 [2024-11-16 17:49:44.601411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.333 [2024-11-16 17:49:44.607558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.333 [2024-11-16 17:49:44.607727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.607756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.613277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.613426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.613458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.619693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.619891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.619919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.626232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.626378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.626410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.632495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.632673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.632702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.639034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.639275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.639307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.644664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.644779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.644813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.649441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.649721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.649752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.654043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.654277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.654316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.658643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.658806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.658835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.663122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.663305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.663342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.667592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.667741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.667771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.672068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.672190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.672222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.677066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.677185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.677216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.682308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.682471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.682503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.687793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.688025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.688054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.693210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.693421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.693453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.698479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.698688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.698718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.703751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.703927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.703955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.709224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.709379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.709419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.714183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.714360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.714391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.718844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.718966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.718995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.723419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.723672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.723702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.728928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.729165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.729194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.734015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.734268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.734300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.738499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.738711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.334 [2024-11-16 17:49:44.738741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.334 [2024-11-16 17:49:44.742907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.334 [2024-11-16 17:49:44.743054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.743086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.747327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.747438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.747487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.751739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.751853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.751888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.756096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.756266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.756303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.760449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.760676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.760705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.764954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.765197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.765229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.769361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.769596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.769658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.773879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.774065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.774103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.778358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.778465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.778505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.783353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.783440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.783469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.788107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.788227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.788259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.793143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.793313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.793345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.798087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.798198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.798228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.803729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.803969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.803998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.809550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.809718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.809753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.815120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.815311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.815340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.335 [2024-11-16 17:49:44.819989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.335 [2024-11-16 17:49:44.820172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.335 [2024-11-16 17:49:44.820203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.824935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.825135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.825166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.830092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.830267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.830299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.836254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.836542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.836580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.841419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.841609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.841664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.845928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.846094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.846135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.850759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.850925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.850954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.855328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.855518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.855550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.859963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.860103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.860136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.864658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.864894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.864923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.869328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.869542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.869574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.873924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.874149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.595 [2024-11-16 17:49:44.874180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.595 [2024-11-16 17:49:44.878512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.595 [2024-11-16 17:49:44.878720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.878748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.883088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.883182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.883211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.887938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.888152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.888190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.892585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.892747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.892776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.897119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.897249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.897286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.901786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.901972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.902001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.906530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.906754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.906789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.911765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.911886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.911914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.916965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.917150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.917182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.922751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.922942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.922970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.928339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.928602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.928645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.933017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.933146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.933178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.937564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.937698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.937733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.942972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.943211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.943244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.947724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.947917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.947946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.952188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.952401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.952433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.956588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.956770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.956799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.960894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.961026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.961058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.965326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.965439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.965470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.969746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.969880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.969909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.974085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.974197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.974229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.978588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.978810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.978839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.982954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.983176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.983208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.987381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.987614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.987669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.991783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.991948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.991977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:44.996118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:44.996235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:44.996267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:45.000723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:45.000903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:45.000932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.596 [2024-11-16 17:49:45.005069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.596 [2024-11-16 17:49:45.005234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.596 [2024-11-16 17:49:45.005267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.009420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.009533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.009566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.013925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.014151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.014183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.018306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.018519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.018558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.022865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.023103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.023135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.027256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.027438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.027470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.031607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.031747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.031776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.036045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.036240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.036272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.040414] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.040551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.040583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.044770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.044911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.044940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.049316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.049538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.049570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.053771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.053950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.053979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.058223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.058451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.058489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.062713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.062849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.062878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.068252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.068338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.068367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.073413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.073575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.073606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.078025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.078165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.078197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.597 [2024-11-16 17:49:45.082762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.597 [2024-11-16 17:49:45.082919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.597 [2024-11-16 17:49:45.082948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.087351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.087587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.087629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.091946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.092125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.092158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.096478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.096729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.096759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.101078] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.101289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.101321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.106269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.106419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.106451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.111665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.111961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.111990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.117785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.117943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.117972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.122326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.122505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.122541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.126816] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.127001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.127029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.131489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.131677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.131706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.136110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.136265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.136303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.140632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.140786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.140815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.145752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.145915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.145944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.151009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.151129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.151161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.156778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.156949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.857 [2024-11-16 17:49:45.156978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.857 [2024-11-16 17:49:45.162894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.857 [2024-11-16 17:49:45.163132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.163160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.168274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.168481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.168513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.173688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.173925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.173959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.178887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.179139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.179170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.184021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.184189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.184221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.189482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.189693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.189736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.194604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.194746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.194775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.199956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.200126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.200155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.205303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.205501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.205532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.210693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.210854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.210887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.215970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.216203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.216235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.221292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.221506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.221534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.226614] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.226802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.226831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.232034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.232215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.232246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.237483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.237683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.237717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.242955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.243205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.243236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.248396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.248648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.248697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.253885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.254038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.254069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.258750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.258900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.258929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.263363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.263537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.263570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.268000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.268148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.268185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.273500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.273703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.273732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.278098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.278303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.278336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.282612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.282860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.282895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.286974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.287159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.287190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.291324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.291437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.291469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.295838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.296008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.858 [2024-11-16 17:49:45.296043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.858 [2024-11-16 17:49:45.300168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.858 [2024-11-16 17:49:45.300304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.300335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.304349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.304451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.304479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.308969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.309178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.309215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.313598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.313816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.313851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.318312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.318500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.318542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.323036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.323169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.323201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.327947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.328054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.328083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.333056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.333251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.333283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.338082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.338189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.338221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.342791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.342864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.342895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:07.859 [2024-11-16 17:49:45.347987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:07.859 [2024-11-16 17:49:45.348173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:07.859 [2024-11-16 17:49:45.348205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.353100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.353285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.353326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.358086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.358275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.358308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.362974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.363149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.363182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.367933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.368026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.368056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.372766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.372930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.372959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.377730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.377845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.377874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.382731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.382804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.382831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.388234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.388449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.388481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.393839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.394019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.394048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.399910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.400083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.400114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.405147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.405298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.405330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.409763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.409856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.409893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.414239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.414355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.414383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.419268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.419366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.419397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.424822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.424985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.119 [2024-11-16 17:49:45.425015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.119 [2024-11-16 17:49:45.429830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.119 [2024-11-16 17:49:45.429976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.430010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.434859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.434989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.435018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.439565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.439646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.439688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.444663] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.444813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.444842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.449756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.449882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.449915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.455033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.455138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.455171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.460024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.460153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.460193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.464983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.465127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.465159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.470079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.470270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.470302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.475090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.475228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.475258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.479836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.479970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.479999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.484376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.484573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.484604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.489327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.489430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.489461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.494366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.494553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.494585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.499500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.499766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.499796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.504826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.505022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.505051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.510180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.510360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.510391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.515471] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.515710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.515738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.520721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.520935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.520964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.525998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.526158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.526190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.531301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.531437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.531468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.536739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.536967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.536996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.541909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.542199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.542232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.547282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.547540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.547571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.552832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.553062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.553098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.557955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.558126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.558158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.562994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.563195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.120 [2024-11-16 17:49:45.563227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.120 [2024-11-16 17:49:45.568054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.120 [2024-11-16 17:49:45.568286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.568325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.121 [2024-11-16 17:49:45.573073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.121 [2024-11-16 17:49:45.573240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.573271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.121 [2024-11-16 17:49:45.578120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.121 [2024-11-16 17:49:45.578393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.578426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.121 [2024-11-16 17:49:45.583072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.121 [2024-11-16 17:49:45.583278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.583326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.121 [2024-11-16 17:49:45.587605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.121 [2024-11-16 17:49:45.587854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.587883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.121 [2024-11-16 17:49:45.592859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.121 [2024-11-16 17:49:45.593012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.593041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.121 [2024-11-16 17:49:45.597772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.121 [2024-11-16 17:49:45.597893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.597921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.121 [2024-11-16 17:49:45.603852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.121 [2024-11-16 17:49:45.604065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.604093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.121 [2024-11-16 17:49:45.609266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.121 [2024-11-16 17:49:45.609405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.121 [2024-11-16 17:49:45.609438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.613721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.613835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.613864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.618425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.618610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.618670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.624289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.624491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.624524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.629114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.629324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.629356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.633887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.634062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.634100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.638526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.638716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.638750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.643284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.643488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.643520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.647842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.647949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.647982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.652527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.652704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.652733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.380 [2024-11-16 17:49:45.657217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.380 [2024-11-16 17:49:45.657401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.380 [2024-11-16 17:49:45.657434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.661880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.662080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.662112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.666542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.666755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.666785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.671274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.671438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.671470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.675811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.675952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.675981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.680348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.680569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.680600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.685079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.685234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.685265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.689751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.689911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.689939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.694527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.694776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.694806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.699236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.699408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.699439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.703717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.703847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.703875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.708203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.708356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.708393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.713150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.713308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.713346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.718416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.718636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.718683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.723684] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.723849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.723878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.729214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.729302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.729331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.735298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.735517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.735563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.739877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.740058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.740090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.744326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.744492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.744524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.748974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.749126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.749158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.753855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.753924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.753961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.759148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.759247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.759278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.763667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.763808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.763837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.768012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.768131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.768163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:08.381 [2024-11-16 17:49:45.772555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x578730) with pdu=0x2000190fef90 00:30:08.381 [2024-11-16 17:49:45.772692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:08.381 [2024-11-16 17:49:45.772721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:08.381 00:30:08.381 Latency(us) 00:30:08.381 [2024-11-16T16:49:45.873Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:08.381 [2024-11-16T16:49:45.873Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:08.381 nvme0n1 : 2.00 6211.53 776.44 0.00 0.00 2568.31 1917.53 11019.76 00:30:08.381 [2024-11-16T16:49:45.873Z] =================================================================================================================== 00:30:08.381 [2024-11-16T16:49:45.873Z] Total : 6211.53 776.44 0.00 0.00 2568.31 1917.53 11019.76 00:30:08.381 0 00:30:08.381 17:49:45 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:08.381 17:49:45 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:08.381 17:49:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:08.381 17:49:45 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:08.381 | .driver_specific 00:30:08.381 | .nvme_error 00:30:08.381 | .status_code 00:30:08.382 | .command_transient_transport_error' 00:30:08.640 17:49:46 -- host/digest.sh@71 -- # (( 401 > 0 )) 00:30:08.640 17:49:46 -- host/digest.sh@73 -- # killprocess 1708319 00:30:08.640 17:49:46 -- common/autotest_common.sh@936 -- # '[' -z 1708319 ']' 00:30:08.640 17:49:46 -- common/autotest_common.sh@940 -- # kill -0 1708319 00:30:08.640 17:49:46 -- common/autotest_common.sh@941 -- # uname 00:30:08.640 17:49:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:08.640 17:49:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1708319 00:30:08.640 17:49:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:08.640 17:49:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:08.640 17:49:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1708319' 00:30:08.640 killing process with pid 1708319 00:30:08.640 17:49:46 -- common/autotest_common.sh@955 -- # kill 1708319 00:30:08.640 Received shutdown signal, test time was about 2.000000 seconds 00:30:08.640 00:30:08.640 Latency(us) 00:30:08.640 [2024-11-16T16:49:46.132Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:08.640 [2024-11-16T16:49:46.132Z] =================================================================================================================== 00:30:08.640 [2024-11-16T16:49:46.132Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:08.640 17:49:46 -- common/autotest_common.sh@960 -- # wait 1708319 00:30:08.898 17:49:46 -- host/digest.sh@115 -- # killprocess 1706651 00:30:08.898 17:49:46 -- common/autotest_common.sh@936 -- # '[' -z 1706651 ']' 00:30:08.898 17:49:46 -- common/autotest_common.sh@940 -- # kill -0 1706651 00:30:08.898 17:49:46 -- common/autotest_common.sh@941 -- # uname 00:30:08.898 17:49:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:08.898 17:49:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1706651 00:30:08.898 17:49:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:08.898 17:49:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:08.898 17:49:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1706651' 00:30:08.898 killing process with pid 1706651 00:30:08.898 17:49:46 -- common/autotest_common.sh@955 -- # kill 1706651 00:30:08.898 17:49:46 -- common/autotest_common.sh@960 -- # wait 1706651 00:30:09.156 00:30:09.156 real 0m17.753s 00:30:09.156 user 0m35.274s 00:30:09.156 sys 0m4.763s 00:30:09.156 17:49:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:09.156 17:49:46 -- common/autotest_common.sh@10 -- # set +x 00:30:09.156 ************************************ 00:30:09.156 END TEST nvmf_digest_error 00:30:09.156 ************************************ 00:30:09.156 17:49:46 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:09.156 17:49:46 -- host/digest.sh@139 -- # nvmftestfini 00:30:09.156 17:49:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:09.156 17:49:46 -- nvmf/common.sh@116 -- # sync 00:30:09.156 17:49:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:09.156 17:49:46 -- nvmf/common.sh@119 -- # set +e 00:30:09.156 17:49:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:09.156 17:49:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:09.156 rmmod nvme_tcp 00:30:09.156 rmmod nvme_fabrics 00:30:09.414 rmmod nvme_keyring 00:30:09.414 17:49:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:09.414 17:49:46 -- nvmf/common.sh@123 -- # set -e 00:30:09.414 17:49:46 -- nvmf/common.sh@124 -- # return 0 00:30:09.414 17:49:46 -- nvmf/common.sh@477 -- # '[' -n 1706651 ']' 00:30:09.414 17:49:46 -- nvmf/common.sh@478 -- # killprocess 1706651 00:30:09.414 17:49:46 -- common/autotest_common.sh@936 -- # '[' -z 1706651 ']' 00:30:09.414 17:49:46 -- common/autotest_common.sh@940 -- # kill -0 1706651 00:30:09.414 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1706651) - No such process 00:30:09.414 17:49:46 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1706651 is not found' 00:30:09.414 Process with pid 1706651 is not found 00:30:09.414 17:49:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:09.414 17:49:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:09.414 17:49:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:09.414 17:49:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:09.414 17:49:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:09.414 17:49:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:09.414 17:49:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:09.414 17:49:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:11.317 17:49:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:11.317 00:30:11.317 real 0m37.539s 00:30:11.317 user 1m5.523s 00:30:11.317 sys 0m10.870s 00:30:11.317 17:49:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:11.317 17:49:48 -- common/autotest_common.sh@10 -- # set +x 00:30:11.317 ************************************ 00:30:11.317 END TEST nvmf_digest 00:30:11.317 ************************************ 00:30:11.317 17:49:48 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:11.317 17:49:48 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:11.317 17:49:48 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:11.317 17:49:48 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:11.317 17:49:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:11.317 17:49:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:11.317 17:49:48 -- common/autotest_common.sh@10 -- # set +x 00:30:11.317 ************************************ 00:30:11.317 START TEST nvmf_bdevperf 00:30:11.317 ************************************ 00:30:11.317 17:49:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:11.317 * Looking for test storage... 00:30:11.317 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:11.317 17:49:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:11.317 17:49:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:11.317 17:49:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:11.576 17:49:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:11.576 17:49:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:11.576 17:49:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:11.576 17:49:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:11.576 17:49:48 -- scripts/common.sh@335 -- # IFS=.-: 00:30:11.576 17:49:48 -- scripts/common.sh@335 -- # read -ra ver1 00:30:11.576 17:49:48 -- scripts/common.sh@336 -- # IFS=.-: 00:30:11.576 17:49:48 -- scripts/common.sh@336 -- # read -ra ver2 00:30:11.576 17:49:48 -- scripts/common.sh@337 -- # local 'op=<' 00:30:11.576 17:49:48 -- scripts/common.sh@339 -- # ver1_l=2 00:30:11.576 17:49:48 -- scripts/common.sh@340 -- # ver2_l=1 00:30:11.576 17:49:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:11.576 17:49:48 -- scripts/common.sh@343 -- # case "$op" in 00:30:11.576 17:49:48 -- scripts/common.sh@344 -- # : 1 00:30:11.576 17:49:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:11.576 17:49:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:11.576 17:49:48 -- scripts/common.sh@364 -- # decimal 1 00:30:11.576 17:49:48 -- scripts/common.sh@352 -- # local d=1 00:30:11.576 17:49:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:11.576 17:49:48 -- scripts/common.sh@354 -- # echo 1 00:30:11.576 17:49:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:11.576 17:49:48 -- scripts/common.sh@365 -- # decimal 2 00:30:11.576 17:49:48 -- scripts/common.sh@352 -- # local d=2 00:30:11.576 17:49:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:11.576 17:49:48 -- scripts/common.sh@354 -- # echo 2 00:30:11.576 17:49:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:11.576 17:49:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:11.576 17:49:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:11.576 17:49:48 -- scripts/common.sh@367 -- # return 0 00:30:11.576 17:49:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:11.576 17:49:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:11.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:11.576 --rc genhtml_branch_coverage=1 00:30:11.576 --rc genhtml_function_coverage=1 00:30:11.576 --rc genhtml_legend=1 00:30:11.576 --rc geninfo_all_blocks=1 00:30:11.576 --rc geninfo_unexecuted_blocks=1 00:30:11.576 00:30:11.576 ' 00:30:11.576 17:49:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:11.576 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:11.576 --rc genhtml_branch_coverage=1 00:30:11.576 --rc genhtml_function_coverage=1 00:30:11.576 --rc genhtml_legend=1 00:30:11.576 --rc geninfo_all_blocks=1 00:30:11.576 --rc geninfo_unexecuted_blocks=1 00:30:11.576 00:30:11.576 ' 00:30:11.577 17:49:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:11.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:11.577 --rc genhtml_branch_coverage=1 00:30:11.577 --rc genhtml_function_coverage=1 00:30:11.577 --rc genhtml_legend=1 00:30:11.577 --rc geninfo_all_blocks=1 00:30:11.577 --rc geninfo_unexecuted_blocks=1 00:30:11.577 00:30:11.577 ' 00:30:11.577 17:49:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:11.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:11.577 --rc genhtml_branch_coverage=1 00:30:11.577 --rc genhtml_function_coverage=1 00:30:11.577 --rc genhtml_legend=1 00:30:11.577 --rc geninfo_all_blocks=1 00:30:11.577 --rc geninfo_unexecuted_blocks=1 00:30:11.577 00:30:11.577 ' 00:30:11.577 17:49:48 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:11.577 17:49:48 -- nvmf/common.sh@7 -- # uname -s 00:30:11.577 17:49:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:11.577 17:49:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:11.577 17:49:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:11.577 17:49:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:11.577 17:49:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:11.577 17:49:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:11.577 17:49:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:11.577 17:49:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:11.577 17:49:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:11.577 17:49:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:11.577 17:49:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:11.577 17:49:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:11.577 17:49:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:11.577 17:49:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:11.577 17:49:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:11.577 17:49:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:11.577 17:49:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:11.577 17:49:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:11.577 17:49:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:11.577 17:49:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.577 17:49:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.577 17:49:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.577 17:49:48 -- paths/export.sh@5 -- # export PATH 00:30:11.577 17:49:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.577 17:49:48 -- nvmf/common.sh@46 -- # : 0 00:30:11.577 17:49:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:11.577 17:49:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:11.577 17:49:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:11.577 17:49:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:11.577 17:49:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:11.577 17:49:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:11.577 17:49:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:11.577 17:49:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:11.577 17:49:48 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:11.577 17:49:48 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:11.577 17:49:48 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:11.577 17:49:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:11.577 17:49:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:11.577 17:49:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:11.577 17:49:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:11.577 17:49:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:11.577 17:49:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:11.577 17:49:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:11.577 17:49:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:11.577 17:49:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:11.577 17:49:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:11.577 17:49:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:11.577 17:49:48 -- common/autotest_common.sh@10 -- # set +x 00:30:13.491 17:49:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:13.491 17:49:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:13.491 17:49:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:13.491 17:49:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:13.491 17:49:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:13.491 17:49:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:13.491 17:49:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:13.491 17:49:50 -- nvmf/common.sh@294 -- # net_devs=() 00:30:13.491 17:49:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:13.491 17:49:50 -- nvmf/common.sh@295 -- # e810=() 00:30:13.491 17:49:50 -- nvmf/common.sh@295 -- # local -ga e810 00:30:13.491 17:49:50 -- nvmf/common.sh@296 -- # x722=() 00:30:13.491 17:49:50 -- nvmf/common.sh@296 -- # local -ga x722 00:30:13.491 17:49:50 -- nvmf/common.sh@297 -- # mlx=() 00:30:13.491 17:49:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:13.491 17:49:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:13.491 17:49:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:13.491 17:49:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:13.491 17:49:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:13.491 17:49:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:13.491 17:49:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:13.491 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:13.491 17:49:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:13.491 17:49:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:13.491 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:13.491 17:49:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:13.491 17:49:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:13.491 17:49:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:13.491 17:49:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:13.491 17:49:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:13.491 17:49:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:13.491 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:13.491 17:49:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:13.491 17:49:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:13.491 17:49:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:13.491 17:49:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:13.491 17:49:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:13.491 17:49:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:13.491 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:13.491 17:49:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:13.491 17:49:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:13.491 17:49:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:13.491 17:49:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:13.491 17:49:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:13.491 17:49:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:13.491 17:49:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:13.491 17:49:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:13.491 17:49:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:13.491 17:49:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:13.491 17:49:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:13.491 17:49:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:13.491 17:49:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:13.491 17:49:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:13.491 17:49:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:13.491 17:49:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:13.491 17:49:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:13.491 17:49:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:13.491 17:49:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:13.491 17:49:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:13.491 17:49:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:13.491 17:49:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:13.491 17:49:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:13.491 17:49:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:13.491 17:49:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:13.491 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:13.491 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:30:13.491 00:30:13.491 --- 10.0.0.2 ping statistics --- 00:30:13.491 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:13.491 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:30:13.492 17:49:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:13.492 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:13.492 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.045 ms 00:30:13.492 00:30:13.492 --- 10.0.0.1 ping statistics --- 00:30:13.492 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:13.492 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:30:13.492 17:49:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:13.492 17:49:50 -- nvmf/common.sh@410 -- # return 0 00:30:13.492 17:49:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:13.492 17:49:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:13.492 17:49:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:13.492 17:49:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:13.492 17:49:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:13.492 17:49:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:13.492 17:49:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:13.750 17:49:50 -- host/bdevperf.sh@25 -- # tgt_init 00:30:13.750 17:49:50 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:13.750 17:49:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:13.750 17:49:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:13.750 17:49:50 -- common/autotest_common.sh@10 -- # set +x 00:30:13.750 17:49:50 -- nvmf/common.sh@469 -- # nvmfpid=1710832 00:30:13.750 17:49:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:13.750 17:49:50 -- nvmf/common.sh@470 -- # waitforlisten 1710832 00:30:13.750 17:49:50 -- common/autotest_common.sh@829 -- # '[' -z 1710832 ']' 00:30:13.750 17:49:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:13.750 17:49:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:13.750 17:49:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:13.750 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:13.750 17:49:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:13.750 17:49:50 -- common/autotest_common.sh@10 -- # set +x 00:30:13.750 [2024-11-16 17:49:51.038428] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:13.750 [2024-11-16 17:49:51.038495] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:13.750 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.750 [2024-11-16 17:49:51.106212] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:13.750 [2024-11-16 17:49:51.202487] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:13.750 [2024-11-16 17:49:51.202693] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:13.750 [2024-11-16 17:49:51.202711] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:13.750 [2024-11-16 17:49:51.202723] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:13.750 [2024-11-16 17:49:51.202778] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:13.750 [2024-11-16 17:49:51.202837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:13.750 [2024-11-16 17:49:51.202840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:14.683 17:49:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:14.683 17:49:52 -- common/autotest_common.sh@862 -- # return 0 00:30:14.683 17:49:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:14.683 17:49:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:14.683 17:49:52 -- common/autotest_common.sh@10 -- # set +x 00:30:14.683 17:49:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:14.683 17:49:52 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:14.683 17:49:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.683 17:49:52 -- common/autotest_common.sh@10 -- # set +x 00:30:14.683 [2024-11-16 17:49:52.115486] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:14.683 17:49:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.683 17:49:52 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:14.683 17:49:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.683 17:49:52 -- common/autotest_common.sh@10 -- # set +x 00:30:14.683 Malloc0 00:30:14.683 17:49:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.683 17:49:52 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:14.683 17:49:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.683 17:49:52 -- common/autotest_common.sh@10 -- # set +x 00:30:14.683 17:49:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.683 17:49:52 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:14.683 17:49:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.683 17:49:52 -- common/autotest_common.sh@10 -- # set +x 00:30:14.683 17:49:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.683 17:49:52 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:14.683 17:49:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.683 17:49:52 -- common/autotest_common.sh@10 -- # set +x 00:30:14.683 [2024-11-16 17:49:52.170418] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:14.683 17:49:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.941 17:49:52 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:14.941 17:49:52 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:14.941 17:49:52 -- nvmf/common.sh@520 -- # config=() 00:30:14.941 17:49:52 -- nvmf/common.sh@520 -- # local subsystem config 00:30:14.941 17:49:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:14.941 17:49:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:14.941 { 00:30:14.941 "params": { 00:30:14.941 "name": "Nvme$subsystem", 00:30:14.941 "trtype": "$TEST_TRANSPORT", 00:30:14.941 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:14.941 "adrfam": "ipv4", 00:30:14.941 "trsvcid": "$NVMF_PORT", 00:30:14.941 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:14.941 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:14.941 "hdgst": ${hdgst:-false}, 00:30:14.941 "ddgst": ${ddgst:-false} 00:30:14.941 }, 00:30:14.941 "method": "bdev_nvme_attach_controller" 00:30:14.941 } 00:30:14.941 EOF 00:30:14.941 )") 00:30:14.941 17:49:52 -- nvmf/common.sh@542 -- # cat 00:30:14.941 17:49:52 -- nvmf/common.sh@544 -- # jq . 00:30:14.941 17:49:52 -- nvmf/common.sh@545 -- # IFS=, 00:30:14.941 17:49:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:14.941 "params": { 00:30:14.941 "name": "Nvme1", 00:30:14.941 "trtype": "tcp", 00:30:14.941 "traddr": "10.0.0.2", 00:30:14.941 "adrfam": "ipv4", 00:30:14.941 "trsvcid": "4420", 00:30:14.941 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:14.941 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:14.941 "hdgst": false, 00:30:14.941 "ddgst": false 00:30:14.941 }, 00:30:14.941 "method": "bdev_nvme_attach_controller" 00:30:14.942 }' 00:30:14.942 [2024-11-16 17:49:52.214191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:14.942 [2024-11-16 17:49:52.214269] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1710994 ] 00:30:14.942 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.942 [2024-11-16 17:49:52.275338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:14.942 [2024-11-16 17:49:52.359681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:15.200 Running I/O for 1 seconds... 00:30:16.574 00:30:16.574 Latency(us) 00:30:16.574 [2024-11-16T16:49:54.066Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:16.574 [2024-11-16T16:49:54.066Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:16.574 Verification LBA range: start 0x0 length 0x4000 00:30:16.574 Nvme1n1 : 1.01 12738.95 49.76 0.00 0.00 10003.22 1498.83 16214.09 00:30:16.574 [2024-11-16T16:49:54.066Z] =================================================================================================================== 00:30:16.574 [2024-11-16T16:49:54.066Z] Total : 12738.95 49.76 0.00 0.00 10003.22 1498.83 16214.09 00:30:16.574 17:49:53 -- host/bdevperf.sh@30 -- # bdevperfpid=1711159 00:30:16.574 17:49:53 -- host/bdevperf.sh@32 -- # sleep 3 00:30:16.574 17:49:53 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:16.574 17:49:53 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:16.574 17:49:53 -- nvmf/common.sh@520 -- # config=() 00:30:16.574 17:49:53 -- nvmf/common.sh@520 -- # local subsystem config 00:30:16.574 17:49:53 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:16.574 17:49:53 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:16.574 { 00:30:16.574 "params": { 00:30:16.574 "name": "Nvme$subsystem", 00:30:16.574 "trtype": "$TEST_TRANSPORT", 00:30:16.574 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:16.574 "adrfam": "ipv4", 00:30:16.574 "trsvcid": "$NVMF_PORT", 00:30:16.574 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:16.574 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:16.574 "hdgst": ${hdgst:-false}, 00:30:16.574 "ddgst": ${ddgst:-false} 00:30:16.574 }, 00:30:16.574 "method": "bdev_nvme_attach_controller" 00:30:16.574 } 00:30:16.574 EOF 00:30:16.574 )") 00:30:16.574 17:49:53 -- nvmf/common.sh@542 -- # cat 00:30:16.574 17:49:53 -- nvmf/common.sh@544 -- # jq . 00:30:16.574 17:49:53 -- nvmf/common.sh@545 -- # IFS=, 00:30:16.574 17:49:53 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:16.574 "params": { 00:30:16.574 "name": "Nvme1", 00:30:16.574 "trtype": "tcp", 00:30:16.574 "traddr": "10.0.0.2", 00:30:16.574 "adrfam": "ipv4", 00:30:16.574 "trsvcid": "4420", 00:30:16.574 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:16.574 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:16.574 "hdgst": false, 00:30:16.574 "ddgst": false 00:30:16.574 }, 00:30:16.574 "method": "bdev_nvme_attach_controller" 00:30:16.574 }' 00:30:16.574 [2024-11-16 17:49:53.967191] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:16.574 [2024-11-16 17:49:53.967262] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1711159 ] 00:30:16.574 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.574 [2024-11-16 17:49:54.029878] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:16.832 [2024-11-16 17:49:54.117945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:17.090 Running I/O for 15 seconds... 00:30:19.623 17:49:56 -- host/bdevperf.sh@33 -- # kill -9 1710832 00:30:19.623 17:49:56 -- host/bdevperf.sh@35 -- # sleep 3 00:30:19.623 [2024-11-16 17:49:56.938353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:123056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.623 [2024-11-16 17:49:56.938417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.623 [2024-11-16 17:49:56.938454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:123072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.623 [2024-11-16 17:49:56.938475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.623 [2024-11-16 17:49:56.938496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:123080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.623 [2024-11-16 17:49:56.938513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.623 [2024-11-16 17:49:56.938533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:123088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.623 [2024-11-16 17:49:56.938552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.623 [2024-11-16 17:49:56.938573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:123096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.623 [2024-11-16 17:49:56.938590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.623 [2024-11-16 17:49:56.938608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:123104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.623 [2024-11-16 17:49:56.938638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.623 [2024-11-16 17:49:56.938674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:123120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.623 [2024-11-16 17:49:56.938689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.623 [2024-11-16 17:49:56.938705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:123144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.623 [2024-11-16 17:49:56.938720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.623 [2024-11-16 17:49:56.938737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:123200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.623 [2024-11-16 17:49:56.938753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.938770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:123208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.938785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.938801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:123216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.938816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.938831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:123224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.938857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.938873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:123232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.938887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.938920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:123240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.938936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.938954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:123248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.938985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:123256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:123264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:123272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:123280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:123288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:123296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:123304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:123312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:123320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:123328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:123336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:123344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:123352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:123360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:123368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:123376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:123384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:123392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:123400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:123408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:123416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.624 [2024-11-16 17:49:56.939624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:122592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:122616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:122624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:122640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:122648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:122680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:122688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:122696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:122712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:122728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:122752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.624 [2024-11-16 17:49:56.939985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:122768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.624 [2024-11-16 17:49:56.939997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:122784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:122816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:122832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:123424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:123432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:123440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:123448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:123456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:123464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:123472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:122856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:122864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:122872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:122896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:122928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:122952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:122960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:123000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:123480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:123488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:123496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:123504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:123512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:123520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:123528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:123536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:123544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:123552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:123560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:123568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:123576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:123584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.940970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.940984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.940996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.941018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:123600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.625 [2024-11-16 17:49:56.941031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.941044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:123608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.941062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.941076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:123616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.941088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.941102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:123008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.941114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.941128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:123016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.941140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.625 [2024-11-16 17:49:56.941157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:123024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.625 [2024-11-16 17:49:56.941170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:123032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:123040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:123048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:123064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:123112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:123624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.941326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:123632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.941352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:123640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:123648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.941403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:123656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:123664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.941455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:123672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:123680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:123688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.941541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:123696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:123704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.941593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:123712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:123720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:123728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.941715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:123736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:123744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.941774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:123752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:123760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:123768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:123776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:123784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:123792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.941979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.941994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:123800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.942006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:123808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.942032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:123816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.942059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:123824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.942086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:123832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:19.626 [2024-11-16 17:49:56.942112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:123128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.942138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:123136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.942164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:123152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.942190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:123160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.942216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:123168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.942242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:123176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.942271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:123184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:19.626 [2024-11-16 17:49:56.942297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.626 [2024-11-16 17:49:56.942310] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x112e900 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:56.942325] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:19.627 [2024-11-16 17:49:56.942335] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:19.627 [2024-11-16 17:49:56.942345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123192 len:8 PRP1 0x0 PRP2 0x0 00:30:19.627 [2024-11-16 17:49:56.942357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.627 [2024-11-16 17:49:56.942414] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x112e900 was disconnected and freed. reset controller. 00:30:19.627 [2024-11-16 17:49:56.942481] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:30:19.627 [2024-11-16 17:49:56.942517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.627 [2024-11-16 17:49:56.942531] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:30:19.627 [2024-11-16 17:49:56.942544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.627 [2024-11-16 17:49:56.942573] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:30:19.627 [2024-11-16 17:49:56.942586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.627 [2024-11-16 17:49:56.942599] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:30:19.627 [2024-11-16 17:49:56.942612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:19.627 [2024-11-16 17:49:56.942648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:56.944633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.627 [2024-11-16 17:49:56.944679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:56.945255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.945371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.945396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.627 [2024-11-16 17:49:56.945412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:56.945546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:56.945917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.627 [2024-11-16 17:49:56.945952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.627 [2024-11-16 17:49:56.945987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.627 [2024-11-16 17:49:56.947987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.627 [2024-11-16 17:49:56.957410] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.627 [2024-11-16 17:49:56.957803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.957905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.957934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.627 [2024-11-16 17:49:56.957952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:56.958153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:56.958340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.627 [2024-11-16 17:49:56.958363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.627 [2024-11-16 17:49:56.958378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.627 [2024-11-16 17:49:56.960668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.627 [2024-11-16 17:49:56.970081] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.627 [2024-11-16 17:49:56.970422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.970586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.970612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.627 [2024-11-16 17:49:56.970639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:56.970788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:56.970923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.627 [2024-11-16 17:49:56.970943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.627 [2024-11-16 17:49:56.970956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.627 [2024-11-16 17:49:56.973225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.627 [2024-11-16 17:49:56.982686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.627 [2024-11-16 17:49:56.982971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.983111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.983141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.627 [2024-11-16 17:49:56.983159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:56.983343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:56.983476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.627 [2024-11-16 17:49:56.983499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.627 [2024-11-16 17:49:56.983520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.627 [2024-11-16 17:49:56.985787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.627 [2024-11-16 17:49:56.995419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.627 [2024-11-16 17:49:56.995754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.995887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:56.995916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.627 [2024-11-16 17:49:56.995933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:56.996098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:56.996268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.627 [2024-11-16 17:49:56.996291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.627 [2024-11-16 17:49:56.996306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.627 [2024-11-16 17:49:56.998645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.627 [2024-11-16 17:49:57.007968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.627 [2024-11-16 17:49:57.008492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:57.008673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:57.008700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.627 [2024-11-16 17:49:57.008716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:57.008848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:57.009069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.627 [2024-11-16 17:49:57.009087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.627 [2024-11-16 17:49:57.009099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.627 [2024-11-16 17:49:57.011297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.627 [2024-11-16 17:49:57.020540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.627 [2024-11-16 17:49:57.020855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:57.021105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:57.021134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.627 [2024-11-16 17:49:57.021152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:57.021299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:57.021468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.627 [2024-11-16 17:49:57.021491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.627 [2024-11-16 17:49:57.021506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.627 [2024-11-16 17:49:57.023704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.627 [2024-11-16 17:49:57.033094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.627 [2024-11-16 17:49:57.033376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:57.033507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.627 [2024-11-16 17:49:57.033535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.627 [2024-11-16 17:49:57.033553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.627 [2024-11-16 17:49:57.033765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.627 [2024-11-16 17:49:57.033934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.628 [2024-11-16 17:49:57.033958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.628 [2024-11-16 17:49:57.033973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.628 [2024-11-16 17:49:57.036571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.628 [2024-11-16 17:49:57.045751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.628 [2024-11-16 17:49:57.046077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.046277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.046330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.628 [2024-11-16 17:49:57.046348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.628 [2024-11-16 17:49:57.046530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.628 [2024-11-16 17:49:57.046746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.628 [2024-11-16 17:49:57.046770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.628 [2024-11-16 17:49:57.046785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.628 [2024-11-16 17:49:57.049108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.628 [2024-11-16 17:49:57.058315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.628 [2024-11-16 17:49:57.058642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.058773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.058801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.628 [2024-11-16 17:49:57.058819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.628 [2024-11-16 17:49:57.059002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.628 [2024-11-16 17:49:57.059207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.628 [2024-11-16 17:49:57.059230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.628 [2024-11-16 17:49:57.059246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.628 [2024-11-16 17:49:57.061446] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.628 [2024-11-16 17:49:57.070961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.628 [2024-11-16 17:49:57.071315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.071451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.071480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.628 [2024-11-16 17:49:57.071497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.628 [2024-11-16 17:49:57.071655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.628 [2024-11-16 17:49:57.071825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.628 [2024-11-16 17:49:57.071848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.628 [2024-11-16 17:49:57.071863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.628 [2024-11-16 17:49:57.074405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.628 [2024-11-16 17:49:57.083505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.628 [2024-11-16 17:49:57.083805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.083939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.083968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.628 [2024-11-16 17:49:57.083986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.628 [2024-11-16 17:49:57.084133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.628 [2024-11-16 17:49:57.084283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.628 [2024-11-16 17:49:57.084306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.628 [2024-11-16 17:49:57.084321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.628 [2024-11-16 17:49:57.086596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.628 [2024-11-16 17:49:57.095899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.628 [2024-11-16 17:49:57.096198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.096328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.096356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.628 [2024-11-16 17:49:57.096374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.628 [2024-11-16 17:49:57.096520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.628 [2024-11-16 17:49:57.096717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.628 [2024-11-16 17:49:57.096742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.628 [2024-11-16 17:49:57.096757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.628 [2024-11-16 17:49:57.099066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.628 [2024-11-16 17:49:57.108550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.628 [2024-11-16 17:49:57.108858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.108993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.628 [2024-11-16 17:49:57.109022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.628 [2024-11-16 17:49:57.109039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.628 [2024-11-16 17:49:57.109187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.628 [2024-11-16 17:49:57.109319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.628 [2024-11-16 17:49:57.109343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.628 [2024-11-16 17:49:57.109358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.628 [2024-11-16 17:49:57.111542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.888 [2024-11-16 17:49:57.121167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.888 [2024-11-16 17:49:57.121472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.121601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.121641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.888 [2024-11-16 17:49:57.121660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.888 [2024-11-16 17:49:57.121862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.888 [2024-11-16 17:49:57.122012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.888 [2024-11-16 17:49:57.122035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.888 [2024-11-16 17:49:57.122050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.888 [2024-11-16 17:49:57.124450] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.888 [2024-11-16 17:49:57.133742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.888 [2024-11-16 17:49:57.134019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.134160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.134185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.888 [2024-11-16 17:49:57.134202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.888 [2024-11-16 17:49:57.134366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.888 [2024-11-16 17:49:57.134565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.888 [2024-11-16 17:49:57.134583] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.888 [2024-11-16 17:49:57.134596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.888 [2024-11-16 17:49:57.137015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.888 [2024-11-16 17:49:57.146297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.888 [2024-11-16 17:49:57.146632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.146740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.146787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.888 [2024-11-16 17:49:57.146804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.888 [2024-11-16 17:49:57.146965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.888 [2024-11-16 17:49:57.147115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.888 [2024-11-16 17:49:57.147134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.888 [2024-11-16 17:49:57.147146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.888 [2024-11-16 17:49:57.149451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.888 [2024-11-16 17:49:57.158772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.888 [2024-11-16 17:49:57.159061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.159203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.159228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.888 [2024-11-16 17:49:57.159244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.888 [2024-11-16 17:49:57.159391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.888 [2024-11-16 17:49:57.159605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.888 [2024-11-16 17:49:57.159647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.888 [2024-11-16 17:49:57.159661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.888 [2024-11-16 17:49:57.162036] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.888 [2024-11-16 17:49:57.171543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.888 [2024-11-16 17:49:57.171874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.172081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.172107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.888 [2024-11-16 17:49:57.172123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.888 [2024-11-16 17:49:57.172250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.888 [2024-11-16 17:49:57.172437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.888 [2024-11-16 17:49:57.172455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.888 [2024-11-16 17:49:57.172467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.888 [2024-11-16 17:49:57.174851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.888 [2024-11-16 17:49:57.184200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.888 [2024-11-16 17:49:57.184589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.184750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-11-16 17:49:57.184776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.888 [2024-11-16 17:49:57.184797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.888 [2024-11-16 17:49:57.184961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.888 [2024-11-16 17:49:57.185118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.888 [2024-11-16 17:49:57.185137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.888 [2024-11-16 17:49:57.185149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.888 [2024-11-16 17:49:57.187462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.196554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.196839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.196972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.197000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.197018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.197147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.197351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.197374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.197389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.199691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.209178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.209535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.209653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.209679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.209695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.209826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.209991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.210011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.210024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.212256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.221650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.221917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.222086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.222114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.222132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.222285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.222472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.222495] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.222510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.224929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.234117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.234469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.234631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.234660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.234678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.234807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.234994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.235017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.235032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.237390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.246804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.247130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.247244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.247269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.247285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.247431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.247573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.247591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.247603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.249682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.259434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.259751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.259928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.259975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.259993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.260157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.260331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.260355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.260370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.262781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.272073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.272418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.272524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.272550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.272566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.272740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.272902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.272936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.272949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.275093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.284694] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.285044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.285198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.285226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.285244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.285427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.285595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.285628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.285646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.287863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.297247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.297543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.297654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.297691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.889 [2024-11-16 17:49:57.297717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.889 [2024-11-16 17:49:57.297899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.889 [2024-11-16 17:49:57.298126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.889 [2024-11-16 17:49:57.298159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.889 [2024-11-16 17:49:57.298176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.889 [2024-11-16 17:49:57.300394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.889 [2024-11-16 17:49:57.309883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.889 [2024-11-16 17:49:57.310215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.310373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-11-16 17:49:57.310401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.890 [2024-11-16 17:49:57.310419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.890 [2024-11-16 17:49:57.310652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.890 [2024-11-16 17:49:57.310875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.890 [2024-11-16 17:49:57.310899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.890 [2024-11-16 17:49:57.310914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.890 [2024-11-16 17:49:57.313185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.890 [2024-11-16 17:49:57.322501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.890 [2024-11-16 17:49:57.322797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.322914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.322939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.890 [2024-11-16 17:49:57.322955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.890 [2024-11-16 17:49:57.323118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.890 [2024-11-16 17:49:57.323272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.890 [2024-11-16 17:49:57.323290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.890 [2024-11-16 17:49:57.323302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.890 [2024-11-16 17:49:57.325586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.890 [2024-11-16 17:49:57.335116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.890 [2024-11-16 17:49:57.335456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.335626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.335660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.890 [2024-11-16 17:49:57.335696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.890 [2024-11-16 17:49:57.335861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.890 [2024-11-16 17:49:57.336048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.890 [2024-11-16 17:49:57.336071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.890 [2024-11-16 17:49:57.336092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.890 [2024-11-16 17:49:57.338471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.890 [2024-11-16 17:49:57.347594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.890 [2024-11-16 17:49:57.347897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.348059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.348088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.890 [2024-11-16 17:49:57.348106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.890 [2024-11-16 17:49:57.348217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.890 [2024-11-16 17:49:57.348404] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.890 [2024-11-16 17:49:57.348427] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.890 [2024-11-16 17:49:57.348442] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.890 [2024-11-16 17:49:57.350765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.890 [2024-11-16 17:49:57.360208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.890 [2024-11-16 17:49:57.360484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.360625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.360654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.890 [2024-11-16 17:49:57.360672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.890 [2024-11-16 17:49:57.360801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.890 [2024-11-16 17:49:57.361006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.890 [2024-11-16 17:49:57.361030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.890 [2024-11-16 17:49:57.361045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.890 [2024-11-16 17:49:57.363318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.890 [2024-11-16 17:49:57.372651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.890 [2024-11-16 17:49:57.372994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.373125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-11-16 17:49:57.373150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:19.890 [2024-11-16 17:49:57.373166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:19.890 [2024-11-16 17:49:57.373329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:19.890 [2024-11-16 17:49:57.373490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.890 [2024-11-16 17:49:57.373508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.890 [2024-11-16 17:49:57.373520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.890 [2024-11-16 17:49:57.375849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.150 [2024-11-16 17:49:57.385416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.150 [2024-11-16 17:49:57.385759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-11-16 17:49:57.385923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-11-16 17:49:57.385951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.150 [2024-11-16 17:49:57.385969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.150 [2024-11-16 17:49:57.386153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.150 [2024-11-16 17:49:57.386303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.150 [2024-11-16 17:49:57.386326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.150 [2024-11-16 17:49:57.386341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.150 [2024-11-16 17:49:57.388662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.150 [2024-11-16 17:49:57.398069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.150 [2024-11-16 17:49:57.398411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-11-16 17:49:57.398555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-11-16 17:49:57.398580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.150 [2024-11-16 17:49:57.398596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.150 [2024-11-16 17:49:57.398752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.150 [2024-11-16 17:49:57.398927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.150 [2024-11-16 17:49:57.398961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.150 [2024-11-16 17:49:57.398973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.150 [2024-11-16 17:49:57.401320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.150 [2024-11-16 17:49:57.410677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.150 [2024-11-16 17:49:57.410902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-11-16 17:49:57.411053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.150 [2024-11-16 17:49:57.411080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.150 [2024-11-16 17:49:57.411096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.411288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.411439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.411458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.411470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.413734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.423217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.424035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.424217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.424247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.424265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.424378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.424547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.424570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.424585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.426713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.435606] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.435890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.435978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.436003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.436019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.436169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.436375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.436398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.436414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.438818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.448139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.448500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.448633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.448677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.448694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.448827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.449006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.449026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.449038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.451269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.460476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.460853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.460963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.461002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.461018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.461211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.461364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.461383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.461395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.463539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.473098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.473331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.473538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.473563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.473579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.473735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.473881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.473900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.473912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.476166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.485448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.485797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.485951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.485976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.485992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.486172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.486357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.486376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.486388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.488751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.498122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.498439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.498570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.498604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.498632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.498817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.498949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.498972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.498987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.501282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.510764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.511121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.511277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.511305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.511322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.511523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.511741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.511765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.151 [2024-11-16 17:49:57.511781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.151 [2024-11-16 17:49:57.514058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.151 [2024-11-16 17:49:57.523326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.151 [2024-11-16 17:49:57.523659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.523791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.151 [2024-11-16 17:49:57.523819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.151 [2024-11-16 17:49:57.523836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.151 [2024-11-16 17:49:57.524054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.151 [2024-11-16 17:49:57.524223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.151 [2024-11-16 17:49:57.524247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.524262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.526557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.535915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.536155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.536312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.536340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.536364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.536530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.536729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.536753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.536768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.538935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.548463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.548811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.548979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.549026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.549045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.549227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.549377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.549400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.549416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.551761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.560801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.561130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.561305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.561333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.561350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.561514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.561694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.561718] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.561734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.564223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.573440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.573801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.573950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.573997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.574015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.574157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.574343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.574367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.574382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.576578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.586142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.586480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.586613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.586668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.586685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.586849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.587036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.587054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.587066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.589377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.598709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.599066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.599233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.599273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.599289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.599401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.599596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.599614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.599652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.601848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.611336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.611693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.611828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.611856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.611873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.612020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.612229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.612253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.612269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.614531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.623949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.624256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.624381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.624422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.624438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.624598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.624734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.624754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.624767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.626948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.152 [2024-11-16 17:49:57.636497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.152 [2024-11-16 17:49:57.636773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.636923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.152 [2024-11-16 17:49:57.636949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.152 [2024-11-16 17:49:57.636964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.152 [2024-11-16 17:49:57.637096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.152 [2024-11-16 17:49:57.637262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.152 [2024-11-16 17:49:57.637283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.152 [2024-11-16 17:49:57.637310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.152 [2024-11-16 17:49:57.639687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.413 [2024-11-16 17:49:57.649135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.413 [2024-11-16 17:49:57.649496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.649629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.649655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.413 [2024-11-16 17:49:57.649671] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.413 [2024-11-16 17:49:57.649867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.413 [2024-11-16 17:49:57.649990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.413 [2024-11-16 17:49:57.650013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.413 [2024-11-16 17:49:57.650026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.413 [2024-11-16 17:49:57.652297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.413 [2024-11-16 17:49:57.661387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.413 [2024-11-16 17:49:57.661682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.661888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.661913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.413 [2024-11-16 17:49:57.661929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.413 [2024-11-16 17:49:57.662131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.413 [2024-11-16 17:49:57.662299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.413 [2024-11-16 17:49:57.662318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.413 [2024-11-16 17:49:57.662330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.413 [2024-11-16 17:49:57.664562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.413 [2024-11-16 17:49:57.674110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.413 [2024-11-16 17:49:57.674415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.674551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.674579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.413 [2024-11-16 17:49:57.674597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.413 [2024-11-16 17:49:57.674718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.413 [2024-11-16 17:49:57.674923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.413 [2024-11-16 17:49:57.674947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.413 [2024-11-16 17:49:57.674962] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.413 [2024-11-16 17:49:57.677275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.413 [2024-11-16 17:49:57.686692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.413 [2024-11-16 17:49:57.686984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.687132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.687158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.413 [2024-11-16 17:49:57.687173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.413 [2024-11-16 17:49:57.687365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.413 [2024-11-16 17:49:57.687519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.413 [2024-11-16 17:49:57.687538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.413 [2024-11-16 17:49:57.687554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.413 [2024-11-16 17:49:57.689766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.413 [2024-11-16 17:49:57.699276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.413 [2024-11-16 17:49:57.699591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.699732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.699761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.413 [2024-11-16 17:49:57.699779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.413 [2024-11-16 17:49:57.699925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.413 [2024-11-16 17:49:57.700076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.413 [2024-11-16 17:49:57.700099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.413 [2024-11-16 17:49:57.700115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.413 [2024-11-16 17:49:57.702313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.413 [2024-11-16 17:49:57.711753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.413 [2024-11-16 17:49:57.712095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.712254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.712281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.413 [2024-11-16 17:49:57.712299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.413 [2024-11-16 17:49:57.712482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.413 [2024-11-16 17:49:57.712680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.413 [2024-11-16 17:49:57.712704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.413 [2024-11-16 17:49:57.712719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.413 [2024-11-16 17:49:57.714954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.413 [2024-11-16 17:49:57.724487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.413 [2024-11-16 17:49:57.724813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.724976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.725002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.413 [2024-11-16 17:49:57.725017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.413 [2024-11-16 17:49:57.725175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.413 [2024-11-16 17:49:57.725371] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.413 [2024-11-16 17:49:57.725389] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.413 [2024-11-16 17:49:57.725401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.413 [2024-11-16 17:49:57.727798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.413 [2024-11-16 17:49:57.736932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.413 [2024-11-16 17:49:57.737344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.737521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.413 [2024-11-16 17:49:57.737548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.413 [2024-11-16 17:49:57.737566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.413 [2024-11-16 17:49:57.737761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.737966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.737989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.738004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.740275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.749421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.749670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.749794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.749819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.749835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.750011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.750177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.750196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.750208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.752319] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.761873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.762177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.762332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.762356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.762372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.762519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.762727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.762747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.762760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.765084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.774451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.774758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.774889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.774917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.774934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.775081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.775268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.775291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.775306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.777566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.786949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.787266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.787400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.787428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.787446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.787592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.787771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.787795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.787810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.790172] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.799468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.799773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.799900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.799928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.799946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.800074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.800242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.800264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.800279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.802650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.812013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.812349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.812508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.812535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.812554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.812749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.812882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.812905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.812920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.815248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.824586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.824893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.825049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.825077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.825095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.825259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.825445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.825468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.825483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.827730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.837189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.837495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.837633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.837661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.837679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.837807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.837993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.838016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.838031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.840413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.414 [2024-11-16 17:49:57.849957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.414 [2024-11-16 17:49:57.850235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.850339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.414 [2024-11-16 17:49:57.850372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.414 [2024-11-16 17:49:57.850388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.414 [2024-11-16 17:49:57.850531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.414 [2024-11-16 17:49:57.850761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.414 [2024-11-16 17:49:57.850781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.414 [2024-11-16 17:49:57.850793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.414 [2024-11-16 17:49:57.852962] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.415 [2024-11-16 17:49:57.862575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.415 [2024-11-16 17:49:57.862871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.415 [2024-11-16 17:49:57.862995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.415 [2024-11-16 17:49:57.863019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.415 [2024-11-16 17:49:57.863034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.415 [2024-11-16 17:49:57.863175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.415 [2024-11-16 17:49:57.863329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.415 [2024-11-16 17:49:57.863348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.415 [2024-11-16 17:49:57.863360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.415 [2024-11-16 17:49:57.865548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.415 [2024-11-16 17:49:57.875106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.415 [2024-11-16 17:49:57.875409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.415 [2024-11-16 17:49:57.875494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.415 [2024-11-16 17:49:57.875522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.415 [2024-11-16 17:49:57.875540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.415 [2024-11-16 17:49:57.875701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.415 [2024-11-16 17:49:57.875870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.415 [2024-11-16 17:49:57.875893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.415 [2024-11-16 17:49:57.875909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.415 [2024-11-16 17:49:57.878218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.415 [2024-11-16 17:49:57.887750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.415 [2024-11-16 17:49:57.888033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.415 [2024-11-16 17:49:57.888134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.415 [2024-11-16 17:49:57.888162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.415 [2024-11-16 17:49:57.888185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.415 [2024-11-16 17:49:57.888350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.415 [2024-11-16 17:49:57.888518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.415 [2024-11-16 17:49:57.888542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.415 [2024-11-16 17:49:57.888557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.415 [2024-11-16 17:49:57.890804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.415 [2024-11-16 17:49:57.900343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.415 [2024-11-16 17:49:57.900633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.415 [2024-11-16 17:49:57.900797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.415 [2024-11-16 17:49:57.900823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.415 [2024-11-16 17:49:57.900839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.415 [2024-11-16 17:49:57.901003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.415 [2024-11-16 17:49:57.901187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.415 [2024-11-16 17:49:57.901206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.415 [2024-11-16 17:49:57.901219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.415 [2024-11-16 17:49:57.903707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.675 [2024-11-16 17:49:57.913051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.675 [2024-11-16 17:49:57.913394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.913528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.913557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.675 [2024-11-16 17:49:57.913575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.675 [2024-11-16 17:49:57.913733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.675 [2024-11-16 17:49:57.913883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.675 [2024-11-16 17:49:57.913907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.675 [2024-11-16 17:49:57.913923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.675 [2024-11-16 17:49:57.916282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.675 [2024-11-16 17:49:57.925441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.675 [2024-11-16 17:49:57.925727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.925857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.925888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.675 [2024-11-16 17:49:57.925906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.675 [2024-11-16 17:49:57.926059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.675 [2024-11-16 17:49:57.926209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.675 [2024-11-16 17:49:57.926233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.675 [2024-11-16 17:49:57.926248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.675 [2024-11-16 17:49:57.928462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.675 [2024-11-16 17:49:57.937902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.675 [2024-11-16 17:49:57.938194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.938324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.938353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.675 [2024-11-16 17:49:57.938371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.675 [2024-11-16 17:49:57.938536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.675 [2024-11-16 17:49:57.938768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.675 [2024-11-16 17:49:57.938791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.675 [2024-11-16 17:49:57.938805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.675 [2024-11-16 17:49:57.940893] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.675 [2024-11-16 17:49:57.950534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.675 [2024-11-16 17:49:57.950875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.950990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.951032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.675 [2024-11-16 17:49:57.951048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.675 [2024-11-16 17:49:57.951147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.675 [2024-11-16 17:49:57.951296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.675 [2024-11-16 17:49:57.951316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.675 [2024-11-16 17:49:57.951329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.675 [2024-11-16 17:49:57.953735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.675 [2024-11-16 17:49:57.963167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.675 [2024-11-16 17:49:57.963515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.963669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.963695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.675 [2024-11-16 17:49:57.963711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.675 [2024-11-16 17:49:57.963875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.675 [2024-11-16 17:49:57.964098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.675 [2024-11-16 17:49:57.964118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.675 [2024-11-16 17:49:57.964130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.675 [2024-11-16 17:49:57.966402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.675 [2024-11-16 17:49:57.975489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.675 [2024-11-16 17:49:57.975783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.975910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.975942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.675 [2024-11-16 17:49:57.975959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.675 [2024-11-16 17:49:57.976153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.675 [2024-11-16 17:49:57.976306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.675 [2024-11-16 17:49:57.976325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.675 [2024-11-16 17:49:57.976338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.675 [2024-11-16 17:49:57.978567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.675 [2024-11-16 17:49:57.988091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.675 [2024-11-16 17:49:57.988413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.988565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:57.988589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.675 [2024-11-16 17:49:57.988606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.675 [2024-11-16 17:49:57.988763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.675 [2024-11-16 17:49:57.988947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.675 [2024-11-16 17:49:57.988982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.675 [2024-11-16 17:49:57.988995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.675 [2024-11-16 17:49:57.991232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.675 [2024-11-16 17:49:58.000276] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.675 [2024-11-16 17:49:58.000543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.675 [2024-11-16 17:49:58.000705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.000731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.000748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.000897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.001106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.001130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.001144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.003302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.012427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.012823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.012916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.012940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.012956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.013136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.013305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.013325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.013338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.015341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.024678] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.025092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.025269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.025294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.025311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.025458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.025639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.025659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.025672] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.027794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.036815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.037151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.037272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.037297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.037313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.037522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.037708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.037729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.037747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.039976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.049012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.049360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.049456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.049481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.049497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.049640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.049792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.049812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.049826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.051944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.061176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.061520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.061638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.061664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.061680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.061796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.061949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.061984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.061997] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.063982] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.073498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.073846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.073966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.073991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.074006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.074153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.074325] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.074344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.074357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.076313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.085641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.085920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.086063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.086088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.086104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.086236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.086443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.086462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.086475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.088271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.097806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.098168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.098272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.098297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.098313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.098462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.098660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.676 [2024-11-16 17:49:58.098681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.676 [2024-11-16 17:49:58.098694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.676 [2024-11-16 17:49:58.100645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.676 [2024-11-16 17:49:58.110030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.676 [2024-11-16 17:49:58.110436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.110587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.676 [2024-11-16 17:49:58.110612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.676 [2024-11-16 17:49:58.110639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.676 [2024-11-16 17:49:58.110788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.676 [2024-11-16 17:49:58.110938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.677 [2024-11-16 17:49:58.110972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.677 [2024-11-16 17:49:58.110985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.677 [2024-11-16 17:49:58.112849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.677 [2024-11-16 17:49:58.122117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.677 [2024-11-16 17:49:58.122419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.677 [2024-11-16 17:49:58.122570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.677 [2024-11-16 17:49:58.122594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.677 [2024-11-16 17:49:58.122610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.677 [2024-11-16 17:49:58.122802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.677 [2024-11-16 17:49:58.122965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.677 [2024-11-16 17:49:58.122998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.677 [2024-11-16 17:49:58.123010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.677 [2024-11-16 17:49:58.125039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.677 [2024-11-16 17:49:58.134370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.677 [2024-11-16 17:49:58.134691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.677 [2024-11-16 17:49:58.134796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.677 [2024-11-16 17:49:58.134821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.677 [2024-11-16 17:49:58.134837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.677 [2024-11-16 17:49:58.135016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.677 [2024-11-16 17:49:58.135173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.677 [2024-11-16 17:49:58.135192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.677 [2024-11-16 17:49:58.135205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.677 [2024-11-16 17:49:58.137209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.677 [2024-11-16 17:49:58.146480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.677 [2024-11-16 17:49:58.146814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.677 [2024-11-16 17:49:58.146937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.677 [2024-11-16 17:49:58.146962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.677 [2024-11-16 17:49:58.146977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.677 [2024-11-16 17:49:58.147109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.677 [2024-11-16 17:49:58.147283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.677 [2024-11-16 17:49:58.147302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.677 [2024-11-16 17:49:58.147314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.677 [2024-11-16 17:49:58.149238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.677 [2024-11-16 17:49:58.158546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.677 [2024-11-16 17:49:58.158879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.677 [2024-11-16 17:49:58.159006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.677 [2024-11-16 17:49:58.159032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.677 [2024-11-16 17:49:58.159048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.677 [2024-11-16 17:49:58.159229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.677 [2024-11-16 17:49:58.159400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.677 [2024-11-16 17:49:58.159419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.677 [2024-11-16 17:49:58.159432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.677 [2024-11-16 17:49:58.161532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.937 [2024-11-16 17:49:58.170817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.937 [2024-11-16 17:49:58.171134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.937 [2024-11-16 17:49:58.171278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.937 [2024-11-16 17:49:58.171303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.937 [2024-11-16 17:49:58.171319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.937 [2024-11-16 17:49:58.171466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.937 [2024-11-16 17:49:58.171600] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.937 [2024-11-16 17:49:58.171644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.937 [2024-11-16 17:49:58.171660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.937 [2024-11-16 17:49:58.173677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.937 [2024-11-16 17:49:58.182905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.937 [2024-11-16 17:49:58.183248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.937 [2024-11-16 17:49:58.183378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.937 [2024-11-16 17:49:58.183402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.937 [2024-11-16 17:49:58.183418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.937 [2024-11-16 17:49:58.183581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.937 [2024-11-16 17:49:58.183773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.937 [2024-11-16 17:49:58.183795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.937 [2024-11-16 17:49:58.183809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.937 [2024-11-16 17:49:58.185828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.937 [2024-11-16 17:49:58.195133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.937 [2024-11-16 17:49:58.195446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.937 [2024-11-16 17:49:58.195566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.937 [2024-11-16 17:49:58.195595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.937 [2024-11-16 17:49:58.195612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.937 [2024-11-16 17:49:58.195771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.937 [2024-11-16 17:49:58.195949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.195969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.195981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.197817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.207384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.207686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.207811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.207836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.207852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.208033] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.208243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.208264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.208278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.210651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.219682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.220001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.220097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.220123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.220139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.220333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.220519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.220538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.220551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.222728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.231810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.232126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.232250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.232275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.232296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.232489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.232703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.232724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.232737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.234634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.243838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.244211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.244339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.244364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.244380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.244511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.244714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.244736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.244749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.246749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.255984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.256296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.256381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.256406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.256422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.256566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.256788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.256810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.256823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.258804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.267977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.268259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.268403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.268428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.268444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.268581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.268756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.268778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.268791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.270697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.280287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.280694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.280818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.280844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.280860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.281008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.281181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.281200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.281212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.283246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.292406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.292718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.292821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.292846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.292862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.293009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.293197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.293216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.293229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.295307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.938 [2024-11-16 17:49:58.304482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.938 [2024-11-16 17:49:58.304786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.304908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.938 [2024-11-16 17:49:58.304933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.938 [2024-11-16 17:49:58.304949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.938 [2024-11-16 17:49:58.305126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.938 [2024-11-16 17:49:58.305316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.938 [2024-11-16 17:49:58.305335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.938 [2024-11-16 17:49:58.305348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.938 [2024-11-16 17:49:58.307451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.316769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.317147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.317265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.317290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.317306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.317485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.317734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.317755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.317769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.319727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.328971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.329236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.329359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.329385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.329401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.329549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.329780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.329801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.329815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.331783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.341127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.341522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.341637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.341666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.341683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.341815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.341960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.341985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.341998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.343866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.353414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.353733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.353856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.353881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.353898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.354078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.354220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.354239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.354251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.356158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.365534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.365863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.365976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.366001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.366016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.366148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.366337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.366356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.366369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.368348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.377641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.378044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.378187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.378211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.378227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.378422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.378607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.378649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.378668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.380469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.389727] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.390073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.390191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.390216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.390232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.390396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.390572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.390590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.390603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.392561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.401820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.402121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.402263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.402288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.402304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.402468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.402687] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.402708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.402722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.404747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.413739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.414088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.414230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.414255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.939 [2024-11-16 17:49:58.414271] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.939 [2024-11-16 17:49:58.414451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.939 [2024-11-16 17:49:58.414665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.939 [2024-11-16 17:49:58.414701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.939 [2024-11-16 17:49:58.414714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.939 [2024-11-16 17:49:58.416826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.939 [2024-11-16 17:49:58.426092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.939 [2024-11-16 17:49:58.426362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.426461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.939 [2024-11-16 17:49:58.426487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:20.940 [2024-11-16 17:49:58.426503] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:20.940 [2024-11-16 17:49:58.426645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:20.940 [2024-11-16 17:49:58.426797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.940 [2024-11-16 17:49:58.426818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.940 [2024-11-16 17:49:58.426831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.199 [2024-11-16 17:49:58.429018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.199 [2024-11-16 17:49:58.438448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.199 [2024-11-16 17:49:58.438769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.199 [2024-11-16 17:49:58.438855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.199 [2024-11-16 17:49:58.438880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.199 [2024-11-16 17:49:58.438897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.199 [2024-11-16 17:49:58.439045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.199 [2024-11-16 17:49:58.439191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.199 [2024-11-16 17:49:58.439210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.199 [2024-11-16 17:49:58.439222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.199 [2024-11-16 17:49:58.441330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.199 [2024-11-16 17:49:58.450579] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.199 [2024-11-16 17:49:58.450825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.199 [2024-11-16 17:49:58.450995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.199 [2024-11-16 17:49:58.451020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.199 [2024-11-16 17:49:58.451036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.199 [2024-11-16 17:49:58.451184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.199 [2024-11-16 17:49:58.451302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.199 [2024-11-16 17:49:58.451336] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.199 [2024-11-16 17:49:58.451348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.199 [2024-11-16 17:49:58.453360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.462866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.463285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.463409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.463434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.463450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.463599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.463744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.463765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.463779] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.465997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.475118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.475500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.475626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.475652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.475668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.475848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.476010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.476029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.476041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.478161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.487300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.487560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.487715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.487741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.487757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.487905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.488102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.488121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.488133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.490202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.499445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.499767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.499914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.499938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.499954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.500135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.500289] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.500308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.500321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.502370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.511688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.511995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.512111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.512136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.512152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.512251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.512463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.512482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.512495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.514441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.523979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.524325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.524448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.524473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.524488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.524604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.524747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.524768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.524782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.526673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.536129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.536375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.536509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.536534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.536550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.536691] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.536876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.536912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.536925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.539115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.548165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.548447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.548559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.548584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.548600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.548739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.548960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.548980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.548993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.550937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.560310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.560738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.560907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.200 [2024-11-16 17:49:58.560935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.200 [2024-11-16 17:49:58.560951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.200 [2024-11-16 17:49:58.561100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.200 [2024-11-16 17:49:58.561262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.200 [2024-11-16 17:49:58.561283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.200 [2024-11-16 17:49:58.561296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.200 [2024-11-16 17:49:58.563492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.200 [2024-11-16 17:49:58.572400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.200 [2024-11-16 17:49:58.572630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.572739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.572764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.572786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.572902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.573077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.573096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.573109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.574881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.584992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.585403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.585521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.585546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.585562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.585703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.585850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.585869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.585882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.587855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.597189] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.597531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.597650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.597677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.597693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.597841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.598016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.598035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.598047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.599981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.609208] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.609550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.609678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.609705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.609721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.609875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.610080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.610100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.610113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.612050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.621400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.621757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.621877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.621902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.621919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.622051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.622248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.622267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.622280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.624202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.633476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.633885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.634008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.634033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.634051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.634200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.634372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.634391] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.634404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.636387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.645739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.646073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.646173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.646198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.646214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.646409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.646573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.646600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.646613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.648662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.658044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.658385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.658478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.658503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.658519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.658690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.658850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.658870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.658883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.660856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.670163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.670478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.670632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.670658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.201 [2024-11-16 17:49:58.670674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.201 [2024-11-16 17:49:58.670773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.201 [2024-11-16 17:49:58.670950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.201 [2024-11-16 17:49:58.670969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.201 [2024-11-16 17:49:58.670982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.201 [2024-11-16 17:49:58.673019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.201 [2024-11-16 17:49:58.682284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.201 [2024-11-16 17:49:58.682624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.682726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.201 [2024-11-16 17:49:58.682753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.202 [2024-11-16 17:49:58.682769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.202 [2024-11-16 17:49:58.682869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.202 [2024-11-16 17:49:58.683061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.202 [2024-11-16 17:49:58.683084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.202 [2024-11-16 17:49:58.683097] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.202 [2024-11-16 17:49:58.685049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.461 [2024-11-16 17:49:58.694460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.461 [2024-11-16 17:49:58.694803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-16 17:49:58.694904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-16 17:49:58.694930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.461 [2024-11-16 17:49:58.694946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.461 [2024-11-16 17:49:58.695141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.461 [2024-11-16 17:49:58.695300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.461 [2024-11-16 17:49:58.695319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.461 [2024-11-16 17:49:58.695332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.461 [2024-11-16 17:49:58.697401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.461 [2024-11-16 17:49:58.706647] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.461 [2024-11-16 17:49:58.707069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-16 17:49:58.707175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-16 17:49:58.707201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.461 [2024-11-16 17:49:58.707217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.461 [2024-11-16 17:49:58.707349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.461 [2024-11-16 17:49:58.707542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.461 [2024-11-16 17:49:58.707561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.461 [2024-11-16 17:49:58.707589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.461 [2024-11-16 17:49:58.709349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.461 [2024-11-16 17:49:58.718793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.461 [2024-11-16 17:49:58.719067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.461 [2024-11-16 17:49:58.719221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.719247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.719263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.719428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.719576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.719611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.719644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.722038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.731006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.731320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.731420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.731445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.731461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.731680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.731827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.731848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.731861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.734098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.743169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.743510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.743630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.743656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.743672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.743788] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.743940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.743959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.743986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.745937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.755337] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.755605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.755755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.755780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.755796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.755929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.756104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.756123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.756135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.758133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.767357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.767668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.767762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.767787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.767803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.767935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.768097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.768116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.768130] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.770209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.779453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.779774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.779895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.779919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.779935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.780127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.780297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.780316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.780329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.782251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.791535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.791861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.791959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.791983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.791998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.792172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.792344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.792363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.792375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.794499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.803747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.804062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.804226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.804250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.804266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.804432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.804649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.804670] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.804683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.806811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.815956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.816223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.816351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.816376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.816392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.462 [2024-11-16 17:49:58.816538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.462 [2024-11-16 17:49:58.816749] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.462 [2024-11-16 17:49:58.816770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.462 [2024-11-16 17:49:58.816783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.462 [2024-11-16 17:49:58.818800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.462 [2024-11-16 17:49:58.828043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.462 [2024-11-16 17:49:58.828356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.828500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.462 [2024-11-16 17:49:58.828525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.462 [2024-11-16 17:49:58.828541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.828698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.828904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.828938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.828952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.830840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.840114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.840419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.840549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.840575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.840591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.840715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.840927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.840947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.840960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.842803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.852228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.852586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.852697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.852722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.852738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.852886] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.853062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.853081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.853093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.855139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.864365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.864666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.864788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.864813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.864830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.865009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.865166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.865185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.865198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.867239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.876287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.876620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.876752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.876778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.876793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.876991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.877161] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.877180] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.877193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.879238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.888406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.888733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.888855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.888881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.888896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.889029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.889220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.889239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.889251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.891295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.900589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.900901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.901003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.901028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.901044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.901222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.901391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.901410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.901423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.903507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.913166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.913495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.913647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.913673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.913694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.913917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.914112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.914131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.914143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.916343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.925505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.925896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.926102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.926128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.926143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.926315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.926482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.463 [2024-11-16 17:49:58.926500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.463 [2024-11-16 17:49:58.926512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.463 [2024-11-16 17:49:58.928902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.463 [2024-11-16 17:49:58.938043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.463 [2024-11-16 17:49:58.938384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.938540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.463 [2024-11-16 17:49:58.938565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.463 [2024-11-16 17:49:58.938581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.463 [2024-11-16 17:49:58.938739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.463 [2024-11-16 17:49:58.938916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.464 [2024-11-16 17:49:58.938948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.464 [2024-11-16 17:49:58.938960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.464 [2024-11-16 17:49:58.941210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.464 [2024-11-16 17:49:58.950682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.464 [2024-11-16 17:49:58.950928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-16 17:49:58.951047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.464 [2024-11-16 17:49:58.951072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.464 [2024-11-16 17:49:58.951088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.464 [2024-11-16 17:49:58.951265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.464 [2024-11-16 17:49:58.951435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.464 [2024-11-16 17:49:58.951458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.464 [2024-11-16 17:49:58.951473] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.723 [2024-11-16 17:49:58.953799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.723 [2024-11-16 17:49:58.963446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.723 [2024-11-16 17:49:58.963778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.723 [2024-11-16 17:49:58.963886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.723 [2024-11-16 17:49:58.963911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.723 [2024-11-16 17:49:58.963927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.723 [2024-11-16 17:49:58.964122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.723 [2024-11-16 17:49:58.964260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.723 [2024-11-16 17:49:58.964279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.723 [2024-11-16 17:49:58.964291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.723 [2024-11-16 17:49:58.966476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.723 [2024-11-16 17:49:58.976078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.723 [2024-11-16 17:49:58.976405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.723 [2024-11-16 17:49:58.976560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.723 [2024-11-16 17:49:58.976585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.723 [2024-11-16 17:49:58.976601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.723 [2024-11-16 17:49:58.976775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.723 [2024-11-16 17:49:58.976939] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.723 [2024-11-16 17:49:58.976959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.723 [2024-11-16 17:49:58.976971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.723 [2024-11-16 17:49:58.979228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.723 [2024-11-16 17:49:58.988465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.723 [2024-11-16 17:49:58.988759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.723 [2024-11-16 17:49:58.988877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.723 [2024-11-16 17:49:58.988902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.723 [2024-11-16 17:49:58.988918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.723 [2024-11-16 17:49:58.989082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.723 [2024-11-16 17:49:58.989271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.723 [2024-11-16 17:49:58.989290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.723 [2024-11-16 17:49:58.989302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.723 [2024-11-16 17:49:58.991611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.723 [2024-11-16 17:49:59.001016] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.723 [2024-11-16 17:49:59.001386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.723 [2024-11-16 17:49:59.001504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.723 [2024-11-16 17:49:59.001528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.723 [2024-11-16 17:49:59.001544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.001717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.001850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.001869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.001883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.004129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.013793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.014116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.014246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.014272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.014288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.014482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.014710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.014731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.014745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.017133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.026397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.026790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.026945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.026971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.026987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.027150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.027338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.027361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.027374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.029754] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.039027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.039381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.039510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.039536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.039552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.039743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.039936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.039955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.039967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.042273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.051780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.052290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.052476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.052501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.052517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.052643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.052808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.052829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.052842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.055119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.064317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.064688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.064843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.064868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.064884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.065079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.065248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.065267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.065284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.067540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.077112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.077501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.077631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.077673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.077689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.077820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.078010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.078030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.078042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.080334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.089708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.090040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.090162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.090187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.090204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.090382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.090539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.090558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.090570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.093180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.102117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.102516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.102704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.102730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.102746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.102966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.103118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.103137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.724 [2024-11-16 17:49:59.103153] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.724 [2024-11-16 17:49:59.105438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.724 [2024-11-16 17:49:59.114679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.724 [2024-11-16 17:49:59.115075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.115241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.724 [2024-11-16 17:49:59.115266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.724 [2024-11-16 17:49:59.115282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.724 [2024-11-16 17:49:59.115466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.724 [2024-11-16 17:49:59.115676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.724 [2024-11-16 17:49:59.115711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.725 [2024-11-16 17:49:59.115725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.725 [2024-11-16 17:49:59.118203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.725 [2024-11-16 17:49:59.127143] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.725 [2024-11-16 17:49:59.127533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.127774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.127800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.725 [2024-11-16 17:49:59.127815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.725 [2024-11-16 17:49:59.127957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.725 [2024-11-16 17:49:59.128137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.725 [2024-11-16 17:49:59.128156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.725 [2024-11-16 17:49:59.128168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.725 [2024-11-16 17:49:59.130317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.725 [2024-11-16 17:49:59.139772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.725 [2024-11-16 17:49:59.140117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.140238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.140263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.725 [2024-11-16 17:49:59.140279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.725 [2024-11-16 17:49:59.140474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.725 [2024-11-16 17:49:59.140672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.725 [2024-11-16 17:49:59.140692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.725 [2024-11-16 17:49:59.140705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.725 [2024-11-16 17:49:59.142951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.725 [2024-11-16 17:49:59.152407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.725 [2024-11-16 17:49:59.152774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.152895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.152920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.725 [2024-11-16 17:49:59.152936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.725 [2024-11-16 17:49:59.153099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.725 [2024-11-16 17:49:59.153241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.725 [2024-11-16 17:49:59.153260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.725 [2024-11-16 17:49:59.153273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.725 [2024-11-16 17:49:59.155487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.725 [2024-11-16 17:49:59.165228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.725 [2024-11-16 17:49:59.165541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.165635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.165662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.725 [2024-11-16 17:49:59.165678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.725 [2024-11-16 17:49:59.165810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.725 [2024-11-16 17:49:59.165988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.725 [2024-11-16 17:49:59.166007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.725 [2024-11-16 17:49:59.166020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.725 [2024-11-16 17:49:59.168397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.725 [2024-11-16 17:49:59.177911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.725 [2024-11-16 17:49:59.178302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.178458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.178483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.725 [2024-11-16 17:49:59.178499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.725 [2024-11-16 17:49:59.178689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.725 [2024-11-16 17:49:59.178864] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.725 [2024-11-16 17:49:59.178883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.725 [2024-11-16 17:49:59.178895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.725 [2024-11-16 17:49:59.181004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.725 [2024-11-16 17:49:59.190445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.725 [2024-11-16 17:49:59.190771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.190966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.190991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.725 [2024-11-16 17:49:59.191007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.725 [2024-11-16 17:49:59.191180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.725 [2024-11-16 17:49:59.191348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.725 [2024-11-16 17:49:59.191367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.725 [2024-11-16 17:49:59.191379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.725 [2024-11-16 17:49:59.193637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.725 [2024-11-16 17:49:59.202813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.725 [2024-11-16 17:49:59.203125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.203253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.725 [2024-11-16 17:49:59.203278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.725 [2024-11-16 17:49:59.203294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.725 [2024-11-16 17:49:59.203426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.725 [2024-11-16 17:49:59.203556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.725 [2024-11-16 17:49:59.203575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.725 [2024-11-16 17:49:59.203587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.725 [2024-11-16 17:49:59.206102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.985 [2024-11-16 17:49:59.215339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.985 [2024-11-16 17:49:59.215677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.215808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.215833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.985 [2024-11-16 17:49:59.215849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.985 [2024-11-16 17:49:59.216023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.985 [2024-11-16 17:49:59.216221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.985 [2024-11-16 17:49:59.216240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.985 [2024-11-16 17:49:59.216252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.985 [2024-11-16 17:49:59.218474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.985 [2024-11-16 17:49:59.227867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.985 [2024-11-16 17:49:59.228217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.228342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.228367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.985 [2024-11-16 17:49:59.228383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.985 [2024-11-16 17:49:59.228547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.985 [2024-11-16 17:49:59.228704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.985 [2024-11-16 17:49:59.228725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.985 [2024-11-16 17:49:59.228739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.985 [2024-11-16 17:49:59.230849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.985 [2024-11-16 17:49:59.240229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.985 [2024-11-16 17:49:59.240523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.240642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.240668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.985 [2024-11-16 17:49:59.240684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.985 [2024-11-16 17:49:59.240848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.985 [2024-11-16 17:49:59.241021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.985 [2024-11-16 17:49:59.241040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.985 [2024-11-16 17:49:59.241053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.985 [2024-11-16 17:49:59.243193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.985 [2024-11-16 17:49:59.252774] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.985 [2024-11-16 17:49:59.253166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.253331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.253356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.985 [2024-11-16 17:49:59.253372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.985 [2024-11-16 17:49:59.253518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.985 [2024-11-16 17:49:59.253717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.985 [2024-11-16 17:49:59.253737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.985 [2024-11-16 17:49:59.253750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.985 [2024-11-16 17:49:59.256182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.985 [2024-11-16 17:49:59.265419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.985 [2024-11-16 17:49:59.265729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.265862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.265887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.985 [2024-11-16 17:49:59.265909] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.985 [2024-11-16 17:49:59.266056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.985 [2024-11-16 17:49:59.266195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.985 [2024-11-16 17:49:59.266213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.985 [2024-11-16 17:49:59.266225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.985 [2024-11-16 17:49:59.268423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.985 [2024-11-16 17:49:59.277799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.985 [2024-11-16 17:49:59.278201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.278379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.278404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.985 [2024-11-16 17:49:59.278421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.985 [2024-11-16 17:49:59.278568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.985 [2024-11-16 17:49:59.278692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.985 [2024-11-16 17:49:59.278712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.985 [2024-11-16 17:49:59.278725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.985 [2024-11-16 17:49:59.281207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.985 [2024-11-16 17:49:59.290211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.985 [2024-11-16 17:49:59.290612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.290773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.985 [2024-11-16 17:49:59.290798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.985 [2024-11-16 17:49:59.290815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.985 [2024-11-16 17:49:59.291009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.985 [2024-11-16 17:49:59.291165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.985 [2024-11-16 17:49:59.291184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.985 [2024-11-16 17:49:59.291195] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.985 [2024-11-16 17:49:59.293675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.985 [2024-11-16 17:49:59.302714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.303072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.303169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.303194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.303210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.303380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.303563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.303582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.303608] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.305879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.315403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.315792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.315917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.315941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.315957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.316103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.316262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.316280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.316292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.318413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.327972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.328343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.328466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.328491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.328507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.328713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.328888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.328921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.328934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.331402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.340499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.340861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.340964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.340988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.341003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.341167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.341335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.341353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.341365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.343715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.353056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.353446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.353593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.353627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.353645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.353762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.353985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.354003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.354016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.356523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.365550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.365871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.366015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.366039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.366055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.366247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.366385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.366404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.366416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.368839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.378119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.378429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.378581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.378606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.378633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.378830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.378931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.378964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.378977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.381411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.390670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.391053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.391181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.391205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.391221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.391353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.391554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.391573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.391585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.393818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.403225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.403595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.403765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.403790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.403805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.403968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.404181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.404200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.404212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.406532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.415962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.416254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.416406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.416432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.416447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.416611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.416794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.416813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.416830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.419046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.428418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.428800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.428921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.428946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.428962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.429110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.429268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.429287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.429299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.431629] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.441043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.441430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.441589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.441614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.441642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.441807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.442011] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.442030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.442042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.444348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.453440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.453796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.453957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.453982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.986 [2024-11-16 17:49:59.453997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.986 [2024-11-16 17:49:59.454096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.986 [2024-11-16 17:49:59.454285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.986 [2024-11-16 17:49:59.454303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.986 [2024-11-16 17:49:59.454319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.986 [2024-11-16 17:49:59.456649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.986 [2024-11-16 17:49:59.465974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.986 [2024-11-16 17:49:59.466281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.986 [2024-11-16 17:49:59.466433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.987 [2024-11-16 17:49:59.466458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:21.987 [2024-11-16 17:49:59.466474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:21.987 [2024-11-16 17:49:59.466676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:21.987 [2024-11-16 17:49:59.466786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.987 [2024-11-16 17:49:59.466805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.987 [2024-11-16 17:49:59.466817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.987 [2024-11-16 17:49:59.469198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.246 [2024-11-16 17:49:59.478499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.246 [2024-11-16 17:49:59.478827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.478949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.478974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.246 [2024-11-16 17:49:59.478990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.246 [2024-11-16 17:49:59.479153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.246 [2024-11-16 17:49:59.479347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.246 [2024-11-16 17:49:59.479367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.246 [2024-11-16 17:49:59.479379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.246 [2024-11-16 17:49:59.481611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.246 [2024-11-16 17:49:59.490858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.246 [2024-11-16 17:49:59.491193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.491318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.491343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.246 [2024-11-16 17:49:59.491359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.246 [2024-11-16 17:49:59.491599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.246 [2024-11-16 17:49:59.491767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.246 [2024-11-16 17:49:59.491788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.246 [2024-11-16 17:49:59.491801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.246 [2024-11-16 17:49:59.493917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.246 [2024-11-16 17:49:59.503509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.246 [2024-11-16 17:49:59.503836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.503965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.503990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.246 [2024-11-16 17:49:59.504006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.246 [2024-11-16 17:49:59.504154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.246 [2024-11-16 17:49:59.504353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.246 [2024-11-16 17:49:59.504371] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.246 [2024-11-16 17:49:59.504384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.246 [2024-11-16 17:49:59.506574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.246 [2024-11-16 17:49:59.516058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.246 [2024-11-16 17:49:59.516444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.516598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.516631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.246 [2024-11-16 17:49:59.516649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.246 [2024-11-16 17:49:59.516798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.246 [2024-11-16 17:49:59.516999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.246 [2024-11-16 17:49:59.517017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.246 [2024-11-16 17:49:59.517029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.246 [2024-11-16 17:49:59.519228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.246 [2024-11-16 17:49:59.528751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.246 [2024-11-16 17:49:59.529060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.529184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.529209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.246 [2024-11-16 17:49:59.529224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.246 [2024-11-16 17:49:59.529405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.246 [2024-11-16 17:49:59.529572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.246 [2024-11-16 17:49:59.529591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.246 [2024-11-16 17:49:59.529603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.246 [2024-11-16 17:49:59.531812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.246 [2024-11-16 17:49:59.541152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.246 [2024-11-16 17:49:59.541423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.541577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.246 [2024-11-16 17:49:59.541602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.246 [2024-11-16 17:49:59.541630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.246 [2024-11-16 17:49:59.541804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.246 [2024-11-16 17:49:59.541946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.246 [2024-11-16 17:49:59.541979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.246 [2024-11-16 17:49:59.541991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.246 [2024-11-16 17:49:59.543912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.553662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.554006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.554135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.554161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.554177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.554354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.554526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.554544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.554556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.557072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.566217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.566541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.566692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.566718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.566734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.566833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.567027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.567046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.567058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.569423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.578845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.579273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.579464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.579502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.579518] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.579717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.579934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.579968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.579980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.582218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.591485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.591889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.592036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.592061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.592077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.592210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.592411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.592429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.592441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.594732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.603954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.604333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.604503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.604529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.604545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.604761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.604887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.604920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.604931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.607276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.616278] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.616622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.616748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.616773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.616794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.616940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.617107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.617125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.617137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.619376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.628889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.629180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.629286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.629311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.629327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.629490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.629706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.629726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.629739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.632081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.641561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.641930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.642059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.642085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.642101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.642233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.642405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.642423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.642435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.644746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.654112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.654522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.654681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.654707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.247 [2024-11-16 17:49:59.654728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.247 [2024-11-16 17:49:59.654941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.247 [2024-11-16 17:49:59.655094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.247 [2024-11-16 17:49:59.655113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.247 [2024-11-16 17:49:59.655125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.247 [2024-11-16 17:49:59.657344] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.247 [2024-11-16 17:49:59.666718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.247 [2024-11-16 17:49:59.667092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.667264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.247 [2024-11-16 17:49:59.667289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.248 [2024-11-16 17:49:59.667305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.248 [2024-11-16 17:49:59.667453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.248 [2024-11-16 17:49:59.667663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.248 [2024-11-16 17:49:59.667683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.248 [2024-11-16 17:49:59.667695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.248 [2024-11-16 17:49:59.670031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.248 [2024-11-16 17:49:59.679105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.248 [2024-11-16 17:49:59.679444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.679567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.679592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.248 [2024-11-16 17:49:59.679609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.248 [2024-11-16 17:49:59.679751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.248 [2024-11-16 17:49:59.679869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.248 [2024-11-16 17:49:59.679888] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.248 [2024-11-16 17:49:59.679901] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.248 [2024-11-16 17:49:59.682060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.248 [2024-11-16 17:49:59.691696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.248 [2024-11-16 17:49:59.691984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.692157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.692182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.248 [2024-11-16 17:49:59.692198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.248 [2024-11-16 17:49:59.692363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.248 [2024-11-16 17:49:59.692518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.248 [2024-11-16 17:49:59.692537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.248 [2024-11-16 17:49:59.692549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.248 [2024-11-16 17:49:59.694563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.248 [2024-11-16 17:49:59.704361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.248 [2024-11-16 17:49:59.704748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.704892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.704922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.248 [2024-11-16 17:49:59.704938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.248 [2024-11-16 17:49:59.705088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.248 [2024-11-16 17:49:59.705245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.248 [2024-11-16 17:49:59.705264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.248 [2024-11-16 17:49:59.705276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.248 [2024-11-16 17:49:59.707640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.248 [2024-11-16 17:49:59.716854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.248 [2024-11-16 17:49:59.717169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.717289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.717315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.248 [2024-11-16 17:49:59.717331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.248 [2024-11-16 17:49:59.717446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.248 [2024-11-16 17:49:59.717605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.248 [2024-11-16 17:49:59.717634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.248 [2024-11-16 17:49:59.717664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.248 [2024-11-16 17:49:59.719880] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.248 [2024-11-16 17:49:59.729491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.248 [2024-11-16 17:49:59.729843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.729965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.248 [2024-11-16 17:49:59.729990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.248 [2024-11-16 17:49:59.730006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.248 [2024-11-16 17:49:59.730171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.248 [2024-11-16 17:49:59.730383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.248 [2024-11-16 17:49:59.730403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.248 [2024-11-16 17:49:59.730416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.248 [2024-11-16 17:49:59.732683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.508 [2024-11-16 17:49:59.742154] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.508 [2024-11-16 17:49:59.742458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.508 [2024-11-16 17:49:59.742675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.508 [2024-11-16 17:49:59.742702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.508 [2024-11-16 17:49:59.742718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.508 [2024-11-16 17:49:59.742834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.508 [2024-11-16 17:49:59.742970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.508 [2024-11-16 17:49:59.742990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.508 [2024-11-16 17:49:59.743004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.508 [2024-11-16 17:49:59.745269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.508 [2024-11-16 17:49:59.754857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.508 [2024-11-16 17:49:59.755222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.508 [2024-11-16 17:49:59.755371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.508 [2024-11-16 17:49:59.755396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.508 [2024-11-16 17:49:59.755412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.508 [2024-11-16 17:49:59.755527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.508 [2024-11-16 17:49:59.755717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.508 [2024-11-16 17:49:59.755738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.508 [2024-11-16 17:49:59.755751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.508 [2024-11-16 17:49:59.758013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.508 [2024-11-16 17:49:59.767350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.508 [2024-11-16 17:49:59.767634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.508 [2024-11-16 17:49:59.767760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.508 [2024-11-16 17:49:59.767785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.508 [2024-11-16 17:49:59.767801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.508 [2024-11-16 17:49:59.767964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.508 [2024-11-16 17:49:59.768121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.508 [2024-11-16 17:49:59.768144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.508 [2024-11-16 17:49:59.768156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.508 [2024-11-16 17:49:59.770126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.508 [2024-11-16 17:49:59.779881] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.508 [2024-11-16 17:49:59.780187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.508 [2024-11-16 17:49:59.780314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.508 [2024-11-16 17:49:59.780339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.508 [2024-11-16 17:49:59.780355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.508 [2024-11-16 17:49:59.780504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.508 [2024-11-16 17:49:59.780744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.508 [2024-11-16 17:49:59.780766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.508 [2024-11-16 17:49:59.780780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.508 [2024-11-16 17:49:59.783193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.792405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.792740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.792836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.792861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.792877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.793009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.793204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.793224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.793237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.795605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.805136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.805531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.805693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.805719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.805735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.805884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.806040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.806059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.806076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.808563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.817731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.818101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.818253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.818278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.818294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.818470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.818677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.818698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.818711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.820788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.830355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.830652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.830794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.830819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.830835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.830998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.831140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.831158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.831170] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.833445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.842862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.843178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.843305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.843330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.843346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.843525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.843658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.843685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.843698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.845891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.855274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.855585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.855693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.855719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.855735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.855900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.856072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.856090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.856103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.858341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.867868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.868264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.868387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.868410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.868440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.868643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.868799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.868819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.868831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.871027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.880502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.880802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.880931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.880957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.880973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.881166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.881362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.881381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.881393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.883663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.893090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.893394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.893541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.893566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.509 [2024-11-16 17:49:59.893582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.509 [2024-11-16 17:49:59.893804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.509 [2024-11-16 17:49:59.893936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.509 [2024-11-16 17:49:59.893955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.509 [2024-11-16 17:49:59.893983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.509 [2024-11-16 17:49:59.896105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.509 [2024-11-16 17:49:59.905688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.509 [2024-11-16 17:49:59.905948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.906112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.509 [2024-11-16 17:49:59.906138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.510 [2024-11-16 17:49:59.906154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.510 [2024-11-16 17:49:59.906318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.510 [2024-11-16 17:49:59.906478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.510 [2024-11-16 17:49:59.906497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.510 [2024-11-16 17:49:59.906508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.510 [2024-11-16 17:49:59.908539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.510 [2024-11-16 17:49:59.918209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.510 [2024-11-16 17:49:59.918622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.918719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.918743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.510 [2024-11-16 17:49:59.918758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.510 [2024-11-16 17:49:59.918954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.510 [2024-11-16 17:49:59.919109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.510 [2024-11-16 17:49:59.919129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.510 [2024-11-16 17:49:59.919141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.510 [2024-11-16 17:49:59.921533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.510 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1710832 Killed "${NVMF_APP[@]}" "$@" 00:30:22.510 [2024-11-16 17:49:59.930742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.510 17:49:59 -- host/bdevperf.sh@36 -- # tgt_init 00:30:22.510 [2024-11-16 17:49:59.931036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 17:49:59 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:22.510 [2024-11-16 17:49:59.931188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.931213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.510 17:49:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:22.510 [2024-11-16 17:49:59.931229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.510 17:49:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:22.510 [2024-11-16 17:49:59.931379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.510 17:49:59 -- common/autotest_common.sh@10 -- # set +x 00:30:22.510 [2024-11-16 17:49:59.931565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.510 [2024-11-16 17:49:59.931584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.510 [2024-11-16 17:49:59.931613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.510 [2024-11-16 17:49:59.933979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.510 17:49:59 -- nvmf/common.sh@469 -- # nvmfpid=1711968 00:30:22.510 17:49:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:22.510 17:49:59 -- nvmf/common.sh@470 -- # waitforlisten 1711968 00:30:22.510 17:49:59 -- common/autotest_common.sh@829 -- # '[' -z 1711968 ']' 00:30:22.510 17:49:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:22.510 17:49:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:22.510 17:49:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:22.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:22.510 17:49:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:22.510 17:49:59 -- common/autotest_common.sh@10 -- # set +x 00:30:22.510 [2024-11-16 17:49:59.943378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.510 [2024-11-16 17:49:59.943731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.943832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.943856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.510 [2024-11-16 17:49:59.943872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.510 [2024-11-16 17:49:59.944059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.510 [2024-11-16 17:49:59.944230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.510 [2024-11-16 17:49:59.944253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.510 [2024-11-16 17:49:59.944269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.510 [2024-11-16 17:49:59.946656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.510 [2024-11-16 17:49:59.956086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.510 [2024-11-16 17:49:59.956402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.956544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.956569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.510 [2024-11-16 17:49:59.956591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.510 [2024-11-16 17:49:59.956781] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.510 [2024-11-16 17:49:59.956946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.510 [2024-11-16 17:49:59.956981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.510 [2024-11-16 17:49:59.956994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.510 [2024-11-16 17:49:59.959190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.510 [2024-11-16 17:49:59.968746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.510 [2024-11-16 17:49:59.969169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.969277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.969301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.510 [2024-11-16 17:49:59.969316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.510 [2024-11-16 17:49:59.969481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.510 [2024-11-16 17:49:59.969665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.510 [2024-11-16 17:49:59.969686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.510 [2024-11-16 17:49:59.969700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.510 [2024-11-16 17:49:59.971947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.510 [2024-11-16 17:49:59.980997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:22.510 [2024-11-16 17:49:59.981065] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:22.510 [2024-11-16 17:49:59.981283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.510 [2024-11-16 17:49:59.981564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.981715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.981741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.510 [2024-11-16 17:49:59.981757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.510 [2024-11-16 17:49:59.981889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.510 [2024-11-16 17:49:59.982055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.510 [2024-11-16 17:49:59.982075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.510 [2024-11-16 17:49:59.982089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.510 [2024-11-16 17:49:59.984448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.510 [2024-11-16 17:49:59.993711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.510 [2024-11-16 17:49:59.994046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.994231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.510 [2024-11-16 17:49:59.994257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.510 [2024-11-16 17:49:59.994273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.510 [2024-11-16 17:49:59.994422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.510 [2024-11-16 17:49:59.994635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.510 [2024-11-16 17:49:59.994656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.510 [2024-11-16 17:49:59.994685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.510 [2024-11-16 17:49:59.996902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.770 [2024-11-16 17:50:00.006319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.770 [2024-11-16 17:50:00.006656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-16 17:50:00.006759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-16 17:50:00.006786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.770 [2024-11-16 17:50:00.006803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.770 [2024-11-16 17:50:00.006919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.770 [2024-11-16 17:50:00.007082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.770 [2024-11-16 17:50:00.007110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.770 [2024-11-16 17:50:00.007139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.770 [2024-11-16 17:50:00.009740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.770 [2024-11-16 17:50:00.019230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.770 [2024-11-16 17:50:00.019545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-16 17:50:00.019711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-16 17:50:00.019738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.770 [2024-11-16 17:50:00.019757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.770 [2024-11-16 17:50:00.019876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.770 [2024-11-16 17:50:00.020039] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.770 [2024-11-16 17:50:00.020060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.770 [2024-11-16 17:50:00.020075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.770 [2024-11-16 17:50:00.022649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.770 EAL: No free 2048 kB hugepages reported on node 1 00:30:22.770 [2024-11-16 17:50:00.031761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.770 [2024-11-16 17:50:00.032124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-16 17:50:00.032259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-16 17:50:00.032293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.770 [2024-11-16 17:50:00.032311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.770 [2024-11-16 17:50:00.032478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.770 [2024-11-16 17:50:00.032702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.770 [2024-11-16 17:50:00.032724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.770 [2024-11-16 17:50:00.032739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.770 [2024-11-16 17:50:00.035003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.770 [2024-11-16 17:50:00.044316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.770 [2024-11-16 17:50:00.044656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.770 [2024-11-16 17:50:00.044774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.044801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.771 [2024-11-16 17:50:00.044818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.771 [2024-11-16 17:50:00.045004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.771 [2024-11-16 17:50:00.045159] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.771 [2024-11-16 17:50:00.045178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.771 [2024-11-16 17:50:00.045191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.771 [2024-11-16 17:50:00.047341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.771 [2024-11-16 17:50:00.057153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.771 [2024-11-16 17:50:00.057498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.057634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.057661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.771 [2024-11-16 17:50:00.057677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.771 [2024-11-16 17:50:00.057842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.771 [2024-11-16 17:50:00.057989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.771 [2024-11-16 17:50:00.058016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.771 [2024-11-16 17:50:00.058029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.771 [2024-11-16 17:50:00.060232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.771 [2024-11-16 17:50:00.062485] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:22.771 [2024-11-16 17:50:00.069584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.771 [2024-11-16 17:50:00.069992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.070133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.070167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.771 [2024-11-16 17:50:00.070185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.771 [2024-11-16 17:50:00.070322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.771 [2024-11-16 17:50:00.070500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.771 [2024-11-16 17:50:00.070520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.771 [2024-11-16 17:50:00.070534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.771 [2024-11-16 17:50:00.072491] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.771 [2024-11-16 17:50:00.082159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.771 [2024-11-16 17:50:00.082627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.082771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.082797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.771 [2024-11-16 17:50:00.082817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.771 [2024-11-16 17:50:00.083001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.771 [2024-11-16 17:50:00.083181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.771 [2024-11-16 17:50:00.083201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.771 [2024-11-16 17:50:00.083215] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.771 [2024-11-16 17:50:00.085643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.771 [2024-11-16 17:50:00.094642] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.771 [2024-11-16 17:50:00.095014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.095179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.095205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.771 [2024-11-16 17:50:00.095221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.771 [2024-11-16 17:50:00.095412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.771 [2024-11-16 17:50:00.095582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.771 [2024-11-16 17:50:00.095602] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.771 [2024-11-16 17:50:00.095640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.771 [2024-11-16 17:50:00.097625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.771 [2024-11-16 17:50:00.107216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.771 [2024-11-16 17:50:00.107639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.107823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.107849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.771 [2024-11-16 17:50:00.107875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.771 [2024-11-16 17:50:00.108010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.771 [2024-11-16 17:50:00.108155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.771 [2024-11-16 17:50:00.108174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.771 [2024-11-16 17:50:00.108187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.771 [2024-11-16 17:50:00.110475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.771 [2024-11-16 17:50:00.119663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.771 [2024-11-16 17:50:00.120068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.120243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.120269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.771 [2024-11-16 17:50:00.120289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.771 [2024-11-16 17:50:00.120477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.771 [2024-11-16 17:50:00.120677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.771 [2024-11-16 17:50:00.120698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.771 [2024-11-16 17:50:00.120713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.771 [2024-11-16 17:50:00.123022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.771 [2024-11-16 17:50:00.132355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.771 [2024-11-16 17:50:00.132678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.132777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.132804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.771 [2024-11-16 17:50:00.132822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.771 [2024-11-16 17:50:00.132986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.771 [2024-11-16 17:50:00.133143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.771 [2024-11-16 17:50:00.133163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.771 [2024-11-16 17:50:00.133175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.771 [2024-11-16 17:50:00.135378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.771 [2024-11-16 17:50:00.144945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.771 [2024-11-16 17:50:00.145281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.145454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.771 [2024-11-16 17:50:00.145480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.772 [2024-11-16 17:50:00.145497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.772 [2024-11-16 17:50:00.145667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.772 [2024-11-16 17:50:00.145846] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.772 [2024-11-16 17:50:00.145866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.772 [2024-11-16 17:50:00.145879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.772 [2024-11-16 17:50:00.148173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.772 [2024-11-16 17:50:00.152944] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:22.772 [2024-11-16 17:50:00.153052] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:22.772 [2024-11-16 17:50:00.153070] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:22.772 [2024-11-16 17:50:00.153083] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:22.772 [2024-11-16 17:50:00.153186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:22.772 [2024-11-16 17:50:00.153244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:22.772 [2024-11-16 17:50:00.153246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:22.772 [2024-11-16 17:50:00.157127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.772 [2024-11-16 17:50:00.157378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.157520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.157547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.772 [2024-11-16 17:50:00.157573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.772 [2024-11-16 17:50:00.157765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.772 [2024-11-16 17:50:00.157974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.772 [2024-11-16 17:50:00.157994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.772 [2024-11-16 17:50:00.158009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.772 [2024-11-16 17:50:00.160089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.772 [2024-11-16 17:50:00.169480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.772 [2024-11-16 17:50:00.169921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.170109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.170135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.772 [2024-11-16 17:50:00.170155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.772 [2024-11-16 17:50:00.170313] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.772 [2024-11-16 17:50:00.170481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.772 [2024-11-16 17:50:00.170502] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.772 [2024-11-16 17:50:00.170517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.772 [2024-11-16 17:50:00.172532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.772 [2024-11-16 17:50:00.181742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.772 [2024-11-16 17:50:00.182207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.182349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.182375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.772 [2024-11-16 17:50:00.182394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.772 [2024-11-16 17:50:00.182519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.772 [2024-11-16 17:50:00.182699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.772 [2024-11-16 17:50:00.182722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.772 [2024-11-16 17:50:00.182738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.772 [2024-11-16 17:50:00.184944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.772 [2024-11-16 17:50:00.194155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.772 [2024-11-16 17:50:00.194584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.194735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.194762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.772 [2024-11-16 17:50:00.194781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.772 [2024-11-16 17:50:00.194954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.772 [2024-11-16 17:50:00.195101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.772 [2024-11-16 17:50:00.195122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.772 [2024-11-16 17:50:00.195137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.772 [2024-11-16 17:50:00.197164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.772 [2024-11-16 17:50:00.206408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.772 [2024-11-16 17:50:00.206788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.206965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.206990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.772 [2024-11-16 17:50:00.207009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.772 [2024-11-16 17:50:00.207179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.772 [2024-11-16 17:50:00.207345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.772 [2024-11-16 17:50:00.207367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.772 [2024-11-16 17:50:00.207382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.772 [2024-11-16 17:50:00.209556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.772 [2024-11-16 17:50:00.218652] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.772 [2024-11-16 17:50:00.219193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.219331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.219357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.772 [2024-11-16 17:50:00.219376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.772 [2024-11-16 17:50:00.219518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.772 [2024-11-16 17:50:00.219724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.772 [2024-11-16 17:50:00.219747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.772 [2024-11-16 17:50:00.219765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.772 [2024-11-16 17:50:00.221933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.772 [2024-11-16 17:50:00.231018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.772 [2024-11-16 17:50:00.231438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.231572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.772 [2024-11-16 17:50:00.231608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.773 [2024-11-16 17:50:00.231637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.773 [2024-11-16 17:50:00.231772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.773 [2024-11-16 17:50:00.231924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.773 [2024-11-16 17:50:00.231944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.773 [2024-11-16 17:50:00.231959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.773 [2024-11-16 17:50:00.234155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.773 [2024-11-16 17:50:00.243229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.773 [2024-11-16 17:50:00.243506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-16 17:50:00.243649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-16 17:50:00.243683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.773 [2024-11-16 17:50:00.243701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.773 [2024-11-16 17:50:00.243834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.773 [2024-11-16 17:50:00.243998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.773 [2024-11-16 17:50:00.244018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.773 [2024-11-16 17:50:00.244032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.773 [2024-11-16 17:50:00.246161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:22.773 [2024-11-16 17:50:00.255451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:22.773 [2024-11-16 17:50:00.255740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-16 17:50:00.255839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:22.773 [2024-11-16 17:50:00.255871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:22.773 [2024-11-16 17:50:00.255888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:22.773 [2024-11-16 17:50:00.256037] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:22.773 [2024-11-16 17:50:00.256214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:22.773 [2024-11-16 17:50:00.256234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:22.773 [2024-11-16 17:50:00.256247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:22.773 [2024-11-16 17:50:00.258354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.032 [2024-11-16 17:50:00.267766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.032 [2024-11-16 17:50:00.268021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.268147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.268173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.032 [2024-11-16 17:50:00.268189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.032 [2024-11-16 17:50:00.268338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.032 [2024-11-16 17:50:00.268500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.032 [2024-11-16 17:50:00.268520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.032 [2024-11-16 17:50:00.268534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.032 [2024-11-16 17:50:00.270562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.032 [2024-11-16 17:50:00.280235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.032 [2024-11-16 17:50:00.280536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.280663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.280690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.032 [2024-11-16 17:50:00.280706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.032 [2024-11-16 17:50:00.280854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.032 [2024-11-16 17:50:00.281034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.032 [2024-11-16 17:50:00.281054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.032 [2024-11-16 17:50:00.281066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.032 [2024-11-16 17:50:00.282958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.032 [2024-11-16 17:50:00.292431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.032 [2024-11-16 17:50:00.292715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.292812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.292837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.032 [2024-11-16 17:50:00.292860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.032 [2024-11-16 17:50:00.293025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.032 [2024-11-16 17:50:00.293170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.032 [2024-11-16 17:50:00.293190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.032 [2024-11-16 17:50:00.293203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.032 [2024-11-16 17:50:00.295270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.032 [2024-11-16 17:50:00.304712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.032 [2024-11-16 17:50:00.304971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.305110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.305135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.032 [2024-11-16 17:50:00.305151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.032 [2024-11-16 17:50:00.305348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.032 [2024-11-16 17:50:00.305525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.032 [2024-11-16 17:50:00.305548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.032 [2024-11-16 17:50:00.305570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.032 [2024-11-16 17:50:00.307694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.032 [2024-11-16 17:50:00.316938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.032 [2024-11-16 17:50:00.317276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.317398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.317423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.032 [2024-11-16 17:50:00.317439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.032 [2024-11-16 17:50:00.317675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.032 [2024-11-16 17:50:00.317808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.032 [2024-11-16 17:50:00.317828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.032 [2024-11-16 17:50:00.317841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.032 [2024-11-16 17:50:00.319874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.032 [2024-11-16 17:50:00.329198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.032 [2024-11-16 17:50:00.329463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.329558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.032 [2024-11-16 17:50:00.329584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.032 [2024-11-16 17:50:00.329600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.032 [2024-11-16 17:50:00.329761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.329895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.329916] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.329929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.331800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.341536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.341836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.341938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.341964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.341980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.342111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.342276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.342296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.342309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.344325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.353751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.354094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.354215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.354240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.354256] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.354372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.354552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.354571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.354584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.356634] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.365939] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.366225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.366317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.366342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.366358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.366474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.366651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.366686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.366700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.368648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.378333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.378639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.378797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.378822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.378838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.378971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.379118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.379138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.379151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.381009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.390627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.390917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.391034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.391060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.391076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.391192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.391388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.391408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.391421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.393387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.402857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.403123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.403239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.403264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.403280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.403428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.403650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.403676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.403690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.405767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.415028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.415364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.415457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.415482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.415498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.415654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.415833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.415854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.415867] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.417927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.427272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.427593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.427714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.427740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.427756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.427920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.428112] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.428132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.428145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.430166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.033 [2024-11-16 17:50:00.439515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.033 [2024-11-16 17:50:00.439781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.439932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.033 [2024-11-16 17:50:00.439957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.033 [2024-11-16 17:50:00.439973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.033 [2024-11-16 17:50:00.440121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.033 [2024-11-16 17:50:00.440300] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.033 [2024-11-16 17:50:00.440320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.033 [2024-11-16 17:50:00.440341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.033 [2024-11-16 17:50:00.442404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.034 [2024-11-16 17:50:00.451747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.034 [2024-11-16 17:50:00.452045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.452154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.452180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.034 [2024-11-16 17:50:00.452196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.034 [2024-11-16 17:50:00.452328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.034 [2024-11-16 17:50:00.452490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.034 [2024-11-16 17:50:00.452510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.034 [2024-11-16 17:50:00.452523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.034 [2024-11-16 17:50:00.454517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.034 [2024-11-16 17:50:00.464108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.034 [2024-11-16 17:50:00.464424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.464533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.464558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.034 [2024-11-16 17:50:00.464574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.034 [2024-11-16 17:50:00.464698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.034 [2024-11-16 17:50:00.464834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.034 [2024-11-16 17:50:00.464856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.034 [2024-11-16 17:50:00.464869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.034 [2024-11-16 17:50:00.466926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.034 [2024-11-16 17:50:00.476367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.034 [2024-11-16 17:50:00.476712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.476833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.476859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.034 [2024-11-16 17:50:00.476875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.034 [2024-11-16 17:50:00.476974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.034 [2024-11-16 17:50:00.477124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.034 [2024-11-16 17:50:00.477159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.034 [2024-11-16 17:50:00.477173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.034 [2024-11-16 17:50:00.479158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.034 [2024-11-16 17:50:00.488628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.034 [2024-11-16 17:50:00.488940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.489060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.489085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.034 [2024-11-16 17:50:00.489101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.034 [2024-11-16 17:50:00.489217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.034 [2024-11-16 17:50:00.489382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.034 [2024-11-16 17:50:00.489403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.034 [2024-11-16 17:50:00.489417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.034 [2024-11-16 17:50:00.491688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.034 [2024-11-16 17:50:00.500772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.034 [2024-11-16 17:50:00.501096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.501221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.501246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.034 [2024-11-16 17:50:00.501262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.034 [2024-11-16 17:50:00.501411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.034 [2024-11-16 17:50:00.501586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.034 [2024-11-16 17:50:00.501631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.034 [2024-11-16 17:50:00.501646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.034 [2024-11-16 17:50:00.503794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.034 [2024-11-16 17:50:00.512941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.034 [2024-11-16 17:50:00.513316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.513437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.034 [2024-11-16 17:50:00.513462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.034 [2024-11-16 17:50:00.513478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.034 [2024-11-16 17:50:00.513651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.034 [2024-11-16 17:50:00.513783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.034 [2024-11-16 17:50:00.513803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.034 [2024-11-16 17:50:00.513817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.034 [2024-11-16 17:50:00.515890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.293 [2024-11-16 17:50:00.525232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.293 [2024-11-16 17:50:00.525522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.293 [2024-11-16 17:50:00.525652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.293 [2024-11-16 17:50:00.525678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.525694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.525842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.525996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.526016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.526030] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.528128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.537666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.537927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.538016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.538040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.538056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.538199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.538360] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.538380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.538394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.540369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.549659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.549919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.550058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.550083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.550099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.550263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.550439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.550459] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.550472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.552485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.561990] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.562265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.562411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.562436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.562452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.562600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.562741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.562762] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.562775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.564700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.574210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.574545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.574668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.574694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.574711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.574859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.575051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.575072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.575085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.577030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.586326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.586633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.586736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.586763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.586779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.586942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.587071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.587095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.587108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.589040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.598655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.598904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.599024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.599054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.599071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.599252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.599380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.599399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.599412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.601484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.611101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.611376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.611500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.611525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.611541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.611747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.611926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.611946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.611958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.614122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.623415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.623766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.623862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.623889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.294 [2024-11-16 17:50:00.623905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.294 [2024-11-16 17:50:00.624053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.294 [2024-11-16 17:50:00.624231] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.294 [2024-11-16 17:50:00.624251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.294 [2024-11-16 17:50:00.624264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.294 [2024-11-16 17:50:00.626371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.294 [2024-11-16 17:50:00.635587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.294 [2024-11-16 17:50:00.635884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.635970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.294 [2024-11-16 17:50:00.635995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.636016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.636164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.636307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.636327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.636340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.638576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.647780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.648009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.648144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.648169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.648186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.648318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.648511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.648531] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.648543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.650603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.660096] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.660356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.660469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.660493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.660510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.660666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.660830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.660851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.660864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.662861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.672395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.672714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.672833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.672858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.672874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.673011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.673202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.673222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.673235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.675385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.684628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.684944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.685063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.685089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.685105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.685254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.685448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.685468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.685481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.687482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.697032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.697423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.697513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.697538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.697554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.697694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.697847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.697867] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.697881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.699889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.709170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.709425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.709577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.709603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.709627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.709746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.709871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.709892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.709922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.711895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.721308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.721641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.721739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.721764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.721780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.721912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.722106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.722126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.722139] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.724321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.733574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.733874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.733994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.734020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.734036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.734184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.734362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.734382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.295 [2024-11-16 17:50:00.734395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.295 [2024-11-16 17:50:00.736314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.295 [2024-11-16 17:50:00.745776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.295 [2024-11-16 17:50:00.746080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.746207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.295 [2024-11-16 17:50:00.746232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.295 [2024-11-16 17:50:00.746248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.295 [2024-11-16 17:50:00.746412] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.295 [2024-11-16 17:50:00.746591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.295 [2024-11-16 17:50:00.746640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.296 [2024-11-16 17:50:00.746657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.296 [2024-11-16 17:50:00.748576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.296 [2024-11-16 17:50:00.758075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.296 [2024-11-16 17:50:00.758432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.296 [2024-11-16 17:50:00.758555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.296 [2024-11-16 17:50:00.758580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.296 [2024-11-16 17:50:00.758596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.296 [2024-11-16 17:50:00.758720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.296 [2024-11-16 17:50:00.758917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.296 [2024-11-16 17:50:00.758937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.296 [2024-11-16 17:50:00.758950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.296 [2024-11-16 17:50:00.761015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.296 [2024-11-16 17:50:00.770598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.296 [2024-11-16 17:50:00.770894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.296 [2024-11-16 17:50:00.771013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.296 [2024-11-16 17:50:00.771038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.296 [2024-11-16 17:50:00.771054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.296 [2024-11-16 17:50:00.771251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.296 [2024-11-16 17:50:00.771397] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.296 [2024-11-16 17:50:00.771417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.296 [2024-11-16 17:50:00.771431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.296 [2024-11-16 17:50:00.773666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.296 [2024-11-16 17:50:00.782953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.296 [2024-11-16 17:50:00.783191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.296 [2024-11-16 17:50:00.783285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.296 [2024-11-16 17:50:00.783310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.296 [2024-11-16 17:50:00.783326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.296 [2024-11-16 17:50:00.783458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.296 [2024-11-16 17:50:00.783634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.296 [2024-11-16 17:50:00.783655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.296 [2024-11-16 17:50:00.783673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.556 [2024-11-16 17:50:00.785862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.556 [2024-11-16 17:50:00.795333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.556 [2024-11-16 17:50:00.795572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.795716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.795742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.556 [2024-11-16 17:50:00.795758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.556 [2024-11-16 17:50:00.795890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.556 [2024-11-16 17:50:00.796053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.556 [2024-11-16 17:50:00.796073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.556 [2024-11-16 17:50:00.796086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.556 [2024-11-16 17:50:00.798205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.556 [2024-11-16 17:50:00.807560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.556 [2024-11-16 17:50:00.807831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.807952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.807977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.556 [2024-11-16 17:50:00.807993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.556 [2024-11-16 17:50:00.808141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.556 [2024-11-16 17:50:00.808306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.556 [2024-11-16 17:50:00.808326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.556 [2024-11-16 17:50:00.808340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.556 [2024-11-16 17:50:00.810237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.556 [2024-11-16 17:50:00.819814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.556 [2024-11-16 17:50:00.820122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.820237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.820262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.556 [2024-11-16 17:50:00.820278] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.556 [2024-11-16 17:50:00.820444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.556 [2024-11-16 17:50:00.820646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.556 [2024-11-16 17:50:00.820667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.556 [2024-11-16 17:50:00.820681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.556 [2024-11-16 17:50:00.822730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.556 [2024-11-16 17:50:00.832271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.556 [2024-11-16 17:50:00.832643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.832763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.832789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.556 [2024-11-16 17:50:00.832805] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.556 [2024-11-16 17:50:00.832970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.556 [2024-11-16 17:50:00.833177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.556 [2024-11-16 17:50:00.833198] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.556 [2024-11-16 17:50:00.833211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.556 [2024-11-16 17:50:00.835257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.556 [2024-11-16 17:50:00.844658] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.556 [2024-11-16 17:50:00.844945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.845063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.845089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.556 [2024-11-16 17:50:00.845106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.556 [2024-11-16 17:50:00.845221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.556 [2024-11-16 17:50:00.845401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.556 [2024-11-16 17:50:00.845422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.556 [2024-11-16 17:50:00.845434] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.556 [2024-11-16 17:50:00.847500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.556 [2024-11-16 17:50:00.857024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.556 [2024-11-16 17:50:00.857328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.857446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.857472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.556 [2024-11-16 17:50:00.857488] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.556 [2024-11-16 17:50:00.857628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.556 [2024-11-16 17:50:00.857839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.556 [2024-11-16 17:50:00.857860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.556 [2024-11-16 17:50:00.857873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.556 [2024-11-16 17:50:00.859875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.556 [2024-11-16 17:50:00.869477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.556 [2024-11-16 17:50:00.869718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.869808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.556 [2024-11-16 17:50:00.869834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.556 [2024-11-16 17:50:00.869850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.556 [2024-11-16 17:50:00.870028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.870157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.870177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.870190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.872403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 [2024-11-16 17:50:00.881676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.557 [2024-11-16 17:50:00.881921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.882067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.882104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.557 [2024-11-16 17:50:00.882120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.557 [2024-11-16 17:50:00.882268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.882462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.882482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.882494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.884536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 [2024-11-16 17:50:00.893977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.557 [2024-11-16 17:50:00.894226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.894341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.894366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.557 [2024-11-16 17:50:00.894382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.557 [2024-11-16 17:50:00.894547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.894713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.894734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.894747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.896780] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 [2024-11-16 17:50:00.906309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.557 [2024-11-16 17:50:00.906659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.906751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.906776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.557 [2024-11-16 17:50:00.906792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.557 [2024-11-16 17:50:00.906957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.907151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.907176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.907188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.909210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 [2024-11-16 17:50:00.918563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.557 [2024-11-16 17:50:00.918889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.919010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.919035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.557 [2024-11-16 17:50:00.919051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.557 [2024-11-16 17:50:00.919231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.919443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.919463] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.919477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.921654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 [2024-11-16 17:50:00.930811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.557 [2024-11-16 17:50:00.931165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.931290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.931315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.557 [2024-11-16 17:50:00.931331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.557 [2024-11-16 17:50:00.931527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.931746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.931768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.931782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.933850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 [2024-11-16 17:50:00.943051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.557 [2024-11-16 17:50:00.943313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.943431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.943460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.557 [2024-11-16 17:50:00.943477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.557 [2024-11-16 17:50:00.943609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.943803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.943823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.943836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.945913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 17:50:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:23.557 17:50:00 -- common/autotest_common.sh@862 -- # return 0 00:30:23.557 17:50:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:23.557 [2024-11-16 17:50:00.955351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.557 17:50:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:23.557 17:50:00 -- common/autotest_common.sh@10 -- # set +x 00:30:23.557 [2024-11-16 17:50:00.955632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.955738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.955763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.557 [2024-11-16 17:50:00.955779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.557 [2024-11-16 17:50:00.955960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.956124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.956145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.956173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.958147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 [2024-11-16 17:50:00.967649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.557 [2024-11-16 17:50:00.967911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.968027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.557 [2024-11-16 17:50:00.968052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.557 [2024-11-16 17:50:00.968068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.557 [2024-11-16 17:50:00.968200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.557 [2024-11-16 17:50:00.968364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.557 [2024-11-16 17:50:00.968385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.557 [2024-11-16 17:50:00.968398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.557 [2024-11-16 17:50:00.970566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.557 17:50:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:23.557 17:50:00 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:23.558 [2024-11-16 17:50:00.980111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controlle 17:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.558 r 00:30:23.558 17:50:00 -- common/autotest_common.sh@10 -- # set +x 00:30:23.558 [2024-11-16 17:50:00.980447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:00.980588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:00.980613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.558 [2024-11-16 17:50:00.980638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.558 [2024-11-16 17:50:00.980819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.558 [2024-11-16 17:50:00.980999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.558 [2024-11-16 17:50:00.981019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.558 [2024-11-16 17:50:00.981032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.558 [2024-11-16 17:50:00.982230] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:23.558 [2024-11-16 17:50:00.983168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.558 17:50:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.558 17:50:00 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:23.558 17:50:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.558 17:50:00 -- common/autotest_common.sh@10 -- # set +x 00:30:23.558 [2024-11-16 17:50:00.992592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.558 [2024-11-16 17:50:00.992842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:00.992973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:00.992999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.558 [2024-11-16 17:50:00.993015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.558 [2024-11-16 17:50:00.993180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.558 [2024-11-16 17:50:00.993356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.558 [2024-11-16 17:50:00.993376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.558 [2024-11-16 17:50:00.993389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.558 [2024-11-16 17:50:00.995637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.558 [2024-11-16 17:50:01.005157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.558 [2024-11-16 17:50:01.005469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:01.005578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:01.005604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.558 [2024-11-16 17:50:01.005629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.558 [2024-11-16 17:50:01.005782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.558 [2024-11-16 17:50:01.005919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.558 [2024-11-16 17:50:01.005948] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.558 [2024-11-16 17:50:01.005963] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.558 [2024-11-16 17:50:01.008166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.558 [2024-11-16 17:50:01.017444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.558 [2024-11-16 17:50:01.017867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:01.017978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:01.018004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.558 [2024-11-16 17:50:01.018024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.558 [2024-11-16 17:50:01.018199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.558 [2024-11-16 17:50:01.018381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.558 [2024-11-16 17:50:01.018401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.558 [2024-11-16 17:50:01.018418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.558 [2024-11-16 17:50:01.020421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.558 Malloc0 00:30:23.558 17:50:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.558 17:50:01 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:23.558 17:50:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.558 17:50:01 -- common/autotest_common.sh@10 -- # set +x 00:30:23.558 17:50:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.558 17:50:01 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:23.558 17:50:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.558 17:50:01 -- common/autotest_common.sh@10 -- # set +x 00:30:23.558 [2024-11-16 17:50:01.029859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.558 [2024-11-16 17:50:01.030132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:01.030287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:23.558 [2024-11-16 17:50:01.030312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110f870 with addr=10.0.0.2, port=4420 00:30:23.558 [2024-11-16 17:50:01.030329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x110f870 is same with the state(5) to be set 00:30:23.558 [2024-11-16 17:50:01.030446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110f870 (9): Bad file descriptor 00:30:23.558 [2024-11-16 17:50:01.030597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:23.558 [2024-11-16 17:50:01.030625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:23.558 [2024-11-16 17:50:01.030641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:23.558 [2024-11-16 17:50:01.032620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:23.558 17:50:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.558 17:50:01 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:23.558 17:50:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:23.558 17:50:01 -- common/autotest_common.sh@10 -- # set +x 00:30:23.558 [2024-11-16 17:50:01.041056] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:23.558 [2024-11-16 17:50:01.042216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:23.558 17:50:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:23.558 17:50:01 -- host/bdevperf.sh@38 -- # wait 1711159 00:30:23.816 [2024-11-16 17:50:01.116600] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:33.794 00:30:33.794 Latency(us) 00:30:33.794 [2024-11-16T16:50:11.286Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:33.794 [2024-11-16T16:50:11.286Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:33.794 Verification LBA range: start 0x0 length 0x4000 00:30:33.794 Nvme1n1 : 15.01 9362.19 36.57 16688.87 0.00 4899.29 688.73 19320.98 00:30:33.794 [2024-11-16T16:50:11.286Z] =================================================================================================================== 00:30:33.794 [2024-11-16T16:50:11.286Z] Total : 9362.19 36.57 16688.87 0.00 4899.29 688.73 19320.98 00:30:33.795 17:50:09 -- host/bdevperf.sh@39 -- # sync 00:30:33.795 17:50:09 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:33.795 17:50:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:33.795 17:50:09 -- common/autotest_common.sh@10 -- # set +x 00:30:33.795 17:50:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:33.795 17:50:09 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:33.795 17:50:09 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:33.795 17:50:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:33.795 17:50:09 -- nvmf/common.sh@116 -- # sync 00:30:33.795 17:50:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:33.795 17:50:09 -- nvmf/common.sh@119 -- # set +e 00:30:33.795 17:50:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:33.795 17:50:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:33.795 rmmod nvme_tcp 00:30:33.795 rmmod nvme_fabrics 00:30:33.795 rmmod nvme_keyring 00:30:33.795 17:50:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:33.795 17:50:09 -- nvmf/common.sh@123 -- # set -e 00:30:33.795 17:50:09 -- nvmf/common.sh@124 -- # return 0 00:30:33.795 17:50:09 -- nvmf/common.sh@477 -- # '[' -n 1711968 ']' 00:30:33.795 17:50:09 -- nvmf/common.sh@478 -- # killprocess 1711968 00:30:33.795 17:50:09 -- common/autotest_common.sh@936 -- # '[' -z 1711968 ']' 00:30:33.795 17:50:09 -- common/autotest_common.sh@940 -- # kill -0 1711968 00:30:33.795 17:50:09 -- common/autotest_common.sh@941 -- # uname 00:30:33.795 17:50:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:33.795 17:50:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1711968 00:30:33.795 17:50:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:33.795 17:50:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:33.795 17:50:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1711968' 00:30:33.795 killing process with pid 1711968 00:30:33.795 17:50:09 -- common/autotest_common.sh@955 -- # kill 1711968 00:30:33.795 17:50:09 -- common/autotest_common.sh@960 -- # wait 1711968 00:30:33.795 17:50:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:33.795 17:50:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:33.795 17:50:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:33.795 17:50:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:33.795 17:50:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:33.795 17:50:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:33.795 17:50:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:33.795 17:50:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:34.731 17:50:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:34.731 00:30:34.731 real 0m23.342s 00:30:34.731 user 1m3.671s 00:30:34.731 sys 0m4.106s 00:30:34.731 17:50:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:34.731 17:50:12 -- common/autotest_common.sh@10 -- # set +x 00:30:34.731 ************************************ 00:30:34.731 END TEST nvmf_bdevperf 00:30:34.731 ************************************ 00:30:34.731 17:50:12 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:34.731 17:50:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:34.731 17:50:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:34.731 17:50:12 -- common/autotest_common.sh@10 -- # set +x 00:30:34.731 ************************************ 00:30:34.731 START TEST nvmf_target_disconnect 00:30:34.731 ************************************ 00:30:34.731 17:50:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:34.731 * Looking for test storage... 00:30:34.731 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:34.731 17:50:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:34.731 17:50:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:34.731 17:50:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:34.993 17:50:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:34.993 17:50:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:34.993 17:50:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:34.993 17:50:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:34.993 17:50:12 -- scripts/common.sh@335 -- # IFS=.-: 00:30:34.993 17:50:12 -- scripts/common.sh@335 -- # read -ra ver1 00:30:34.993 17:50:12 -- scripts/common.sh@336 -- # IFS=.-: 00:30:34.993 17:50:12 -- scripts/common.sh@336 -- # read -ra ver2 00:30:34.993 17:50:12 -- scripts/common.sh@337 -- # local 'op=<' 00:30:34.993 17:50:12 -- scripts/common.sh@339 -- # ver1_l=2 00:30:34.993 17:50:12 -- scripts/common.sh@340 -- # ver2_l=1 00:30:34.993 17:50:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:34.993 17:50:12 -- scripts/common.sh@343 -- # case "$op" in 00:30:34.993 17:50:12 -- scripts/common.sh@344 -- # : 1 00:30:34.993 17:50:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:34.993 17:50:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:34.993 17:50:12 -- scripts/common.sh@364 -- # decimal 1 00:30:34.993 17:50:12 -- scripts/common.sh@352 -- # local d=1 00:30:34.993 17:50:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:34.993 17:50:12 -- scripts/common.sh@354 -- # echo 1 00:30:34.993 17:50:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:34.993 17:50:12 -- scripts/common.sh@365 -- # decimal 2 00:30:34.993 17:50:12 -- scripts/common.sh@352 -- # local d=2 00:30:34.993 17:50:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:34.993 17:50:12 -- scripts/common.sh@354 -- # echo 2 00:30:34.993 17:50:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:34.993 17:50:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:34.993 17:50:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:34.993 17:50:12 -- scripts/common.sh@367 -- # return 0 00:30:34.993 17:50:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:34.993 17:50:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:34.993 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:34.993 --rc genhtml_branch_coverage=1 00:30:34.993 --rc genhtml_function_coverage=1 00:30:34.993 --rc genhtml_legend=1 00:30:34.993 --rc geninfo_all_blocks=1 00:30:34.993 --rc geninfo_unexecuted_blocks=1 00:30:34.993 00:30:34.993 ' 00:30:34.993 17:50:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:34.993 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:34.993 --rc genhtml_branch_coverage=1 00:30:34.993 --rc genhtml_function_coverage=1 00:30:34.993 --rc genhtml_legend=1 00:30:34.993 --rc geninfo_all_blocks=1 00:30:34.993 --rc geninfo_unexecuted_blocks=1 00:30:34.993 00:30:34.993 ' 00:30:34.993 17:50:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:34.993 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:34.993 --rc genhtml_branch_coverage=1 00:30:34.993 --rc genhtml_function_coverage=1 00:30:34.993 --rc genhtml_legend=1 00:30:34.993 --rc geninfo_all_blocks=1 00:30:34.993 --rc geninfo_unexecuted_blocks=1 00:30:34.993 00:30:34.993 ' 00:30:34.993 17:50:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:34.993 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:34.993 --rc genhtml_branch_coverage=1 00:30:34.993 --rc genhtml_function_coverage=1 00:30:34.993 --rc genhtml_legend=1 00:30:34.993 --rc geninfo_all_blocks=1 00:30:34.993 --rc geninfo_unexecuted_blocks=1 00:30:34.993 00:30:34.993 ' 00:30:34.993 17:50:12 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:34.993 17:50:12 -- nvmf/common.sh@7 -- # uname -s 00:30:34.993 17:50:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:34.994 17:50:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:34.994 17:50:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:34.994 17:50:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:34.994 17:50:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:34.994 17:50:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:34.994 17:50:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:34.994 17:50:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:34.994 17:50:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:34.994 17:50:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:34.994 17:50:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:34.994 17:50:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:34.994 17:50:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:34.994 17:50:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:34.994 17:50:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:34.994 17:50:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:34.994 17:50:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:34.994 17:50:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:34.994 17:50:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:34.994 17:50:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.994 17:50:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.994 17:50:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.994 17:50:12 -- paths/export.sh@5 -- # export PATH 00:30:34.994 17:50:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:34.994 17:50:12 -- nvmf/common.sh@46 -- # : 0 00:30:34.994 17:50:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:34.994 17:50:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:34.994 17:50:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:34.994 17:50:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:34.994 17:50:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:34.994 17:50:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:34.994 17:50:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:34.994 17:50:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:34.994 17:50:12 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:34.994 17:50:12 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:34.994 17:50:12 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:34.994 17:50:12 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:34.994 17:50:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:34.994 17:50:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:34.994 17:50:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:34.994 17:50:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:34.994 17:50:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:34.994 17:50:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:34.994 17:50:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:34.994 17:50:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:34.994 17:50:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:34.994 17:50:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:34.994 17:50:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:34.994 17:50:12 -- common/autotest_common.sh@10 -- # set +x 00:30:36.973 17:50:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:36.973 17:50:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:36.973 17:50:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:36.973 17:50:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:36.973 17:50:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:36.973 17:50:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:36.973 17:50:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:36.973 17:50:14 -- nvmf/common.sh@294 -- # net_devs=() 00:30:36.973 17:50:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:36.973 17:50:14 -- nvmf/common.sh@295 -- # e810=() 00:30:36.973 17:50:14 -- nvmf/common.sh@295 -- # local -ga e810 00:30:36.973 17:50:14 -- nvmf/common.sh@296 -- # x722=() 00:30:36.973 17:50:14 -- nvmf/common.sh@296 -- # local -ga x722 00:30:36.973 17:50:14 -- nvmf/common.sh@297 -- # mlx=() 00:30:36.973 17:50:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:36.973 17:50:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:36.974 17:50:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:36.974 17:50:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:36.974 17:50:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:36.974 17:50:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:36.974 17:50:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:36.974 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:36.974 17:50:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:36.974 17:50:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:36.974 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:36.974 17:50:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:36.974 17:50:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:36.974 17:50:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:36.974 17:50:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:36.974 17:50:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:36.974 17:50:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:36.974 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:36.974 17:50:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:36.974 17:50:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:36.974 17:50:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:36.974 17:50:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:36.974 17:50:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:36.974 17:50:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:36.974 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:36.974 17:50:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:36.974 17:50:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:36.974 17:50:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:36.974 17:50:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:36.974 17:50:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:36.974 17:50:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:36.974 17:50:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:36.974 17:50:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:36.974 17:50:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:36.974 17:50:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:36.974 17:50:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:36.974 17:50:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:36.974 17:50:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:36.974 17:50:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:36.974 17:50:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:36.974 17:50:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:36.974 17:50:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:36.974 17:50:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:36.974 17:50:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:36.974 17:50:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:36.974 17:50:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:36.974 17:50:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:36.974 17:50:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:36.974 17:50:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:36.974 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:36.974 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:30:36.974 00:30:36.974 --- 10.0.0.2 ping statistics --- 00:30:36.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:36.974 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:30:36.974 17:50:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:36.974 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:36.974 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.069 ms 00:30:36.974 00:30:36.974 --- 10.0.0.1 ping statistics --- 00:30:36.974 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:36.974 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:30:36.974 17:50:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:36.974 17:50:14 -- nvmf/common.sh@410 -- # return 0 00:30:36.974 17:50:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:36.974 17:50:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:36.974 17:50:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:36.974 17:50:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:36.974 17:50:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:36.974 17:50:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:36.974 17:50:14 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:36.974 17:50:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:36.974 17:50:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:36.974 17:50:14 -- common/autotest_common.sh@10 -- # set +x 00:30:36.974 ************************************ 00:30:36.974 START TEST nvmf_target_disconnect_tc1 00:30:36.974 ************************************ 00:30:36.974 17:50:14 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:36.974 17:50:14 -- host/target_disconnect.sh@32 -- # set +e 00:30:36.974 17:50:14 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:36.974 EAL: No free 2048 kB hugepages reported on node 1 00:30:36.974 [2024-11-16 17:50:14.398206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.974 [2024-11-16 17:50:14.398353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.974 [2024-11-16 17:50:14.398380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x145cdf0 with addr=10.0.0.2, port=4420 00:30:36.974 [2024-11-16 17:50:14.398410] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:36.974 [2024-11-16 17:50:14.398430] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:36.974 [2024-11-16 17:50:14.398443] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:36.974 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:36.974 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:36.974 Initializing NVMe Controllers 00:30:36.974 17:50:14 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:36.974 17:50:14 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:36.974 17:50:14 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:36.974 17:50:14 -- common/autotest_common.sh@1142 -- # return 0 00:30:36.974 17:50:14 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:36.974 17:50:14 -- host/target_disconnect.sh@41 -- # set -e 00:30:36.974 00:30:36.974 real 0m0.099s 00:30:36.974 user 0m0.038s 00:30:36.974 sys 0m0.060s 00:30:36.974 17:50:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:36.974 17:50:14 -- common/autotest_common.sh@10 -- # set +x 00:30:36.974 ************************************ 00:30:36.975 END TEST nvmf_target_disconnect_tc1 00:30:36.975 ************************************ 00:30:36.975 17:50:14 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:36.975 17:50:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:36.975 17:50:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:36.975 17:50:14 -- common/autotest_common.sh@10 -- # set +x 00:30:36.975 ************************************ 00:30:36.975 START TEST nvmf_target_disconnect_tc2 00:30:36.975 ************************************ 00:30:36.975 17:50:14 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:36.975 17:50:14 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:36.975 17:50:14 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:36.975 17:50:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:36.975 17:50:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:36.975 17:50:14 -- common/autotest_common.sh@10 -- # set +x 00:30:36.975 17:50:14 -- nvmf/common.sh@469 -- # nvmfpid=1715044 00:30:36.975 17:50:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:36.975 17:50:14 -- nvmf/common.sh@470 -- # waitforlisten 1715044 00:30:36.975 17:50:14 -- common/autotest_common.sh@829 -- # '[' -z 1715044 ']' 00:30:36.975 17:50:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:36.975 17:50:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:36.975 17:50:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:36.975 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:36.975 17:50:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:36.975 17:50:14 -- common/autotest_common.sh@10 -- # set +x 00:30:37.233 [2024-11-16 17:50:14.490554] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:37.233 [2024-11-16 17:50:14.490655] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:37.233 EAL: No free 2048 kB hugepages reported on node 1 00:30:37.233 [2024-11-16 17:50:14.556800] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:37.233 [2024-11-16 17:50:14.641964] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:37.233 [2024-11-16 17:50:14.642121] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:37.233 [2024-11-16 17:50:14.642137] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:37.233 [2024-11-16 17:50:14.642153] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:37.233 [2024-11-16 17:50:14.642238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:37.233 [2024-11-16 17:50:14.642343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:37.233 [2024-11-16 17:50:14.642432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:37.233 [2024-11-16 17:50:14.642439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:38.169 17:50:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:38.169 17:50:15 -- common/autotest_common.sh@862 -- # return 0 00:30:38.169 17:50:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:38.169 17:50:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:38.169 17:50:15 -- common/autotest_common.sh@10 -- # set +x 00:30:38.169 17:50:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:38.169 17:50:15 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:38.169 17:50:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.169 17:50:15 -- common/autotest_common.sh@10 -- # set +x 00:30:38.169 Malloc0 00:30:38.169 17:50:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.169 17:50:15 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:38.169 17:50:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.169 17:50:15 -- common/autotest_common.sh@10 -- # set +x 00:30:38.169 [2024-11-16 17:50:15.498405] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:38.169 17:50:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.169 17:50:15 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:38.169 17:50:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.169 17:50:15 -- common/autotest_common.sh@10 -- # set +x 00:30:38.169 17:50:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.169 17:50:15 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:38.169 17:50:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.169 17:50:15 -- common/autotest_common.sh@10 -- # set +x 00:30:38.169 17:50:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.169 17:50:15 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:38.169 17:50:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.169 17:50:15 -- common/autotest_common.sh@10 -- # set +x 00:30:38.169 [2024-11-16 17:50:15.526703] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:38.169 17:50:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.169 17:50:15 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:38.169 17:50:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:38.169 17:50:15 -- common/autotest_common.sh@10 -- # set +x 00:30:38.169 17:50:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:38.169 17:50:15 -- host/target_disconnect.sh@50 -- # reconnectpid=1715202 00:30:38.169 17:50:15 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:38.169 17:50:15 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:38.169 EAL: No free 2048 kB hugepages reported on node 1 00:30:40.071 17:50:17 -- host/target_disconnect.sh@53 -- # kill -9 1715044 00:30:40.071 17:50:17 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 [2024-11-16 17:50:17.550279] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Write completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.071 Read completed with error (sct=0, sc=8) 00:30:40.071 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 [2024-11-16 17:50:17.550628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 [2024-11-16 17:50:17.551068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Read completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 Write completed with error (sct=0, sc=8) 00:30:40.072 starting I/O failed 00:30:40.072 [2024-11-16 17:50:17.551349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:40.072 [2024-11-16 17:50:17.551533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.551711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.551740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.072 qpair failed and we were unable to recover it. 00:30:40.072 [2024-11-16 17:50:17.551831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.551998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.552025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.072 qpair failed and we were unable to recover it. 00:30:40.072 [2024-11-16 17:50:17.552152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.552307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.552332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.072 qpair failed and we were unable to recover it. 00:30:40.072 [2024-11-16 17:50:17.552464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.552625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.552652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.072 qpair failed and we were unable to recover it. 00:30:40.072 [2024-11-16 17:50:17.552749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.552858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.552884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.072 qpair failed and we were unable to recover it. 00:30:40.072 [2024-11-16 17:50:17.553038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.553202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.553228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.072 qpair failed and we were unable to recover it. 00:30:40.072 [2024-11-16 17:50:17.553357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.553493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.072 [2024-11-16 17:50:17.553521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.072 qpair failed and we were unable to recover it. 00:30:40.072 [2024-11-16 17:50:17.553662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.553745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.553770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.553885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.553977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.554102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.554364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.554566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.554791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.554895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.555014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.555131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.555157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.555245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.555409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.555437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.555576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.555680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.555706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.555794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.555879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.555903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.556023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.556287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.556329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.556471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.556589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.556622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.556717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.556807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.556832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.556942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.557202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.557483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.557733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.557923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.557999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.558024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.558137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.558221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.558247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.558336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.558472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.558501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.558659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.558749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.558776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.558864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.558994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.559020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.559101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.559275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.559300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.559437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.559569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.559595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.559684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.559776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.559801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.559894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.560003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.560028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.560142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.560230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.560256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.073 qpair failed and we were unable to recover it. 00:30:40.073 [2024-11-16 17:50:17.560345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.073 [2024-11-16 17:50:17.560452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.560477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.074 [2024-11-16 17:50:17.560597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.560695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.560721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.074 [2024-11-16 17:50:17.560815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.560902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.560936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.074 [2024-11-16 17:50:17.561083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.561163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.561188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.074 [2024-11-16 17:50:17.561272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.561381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.561407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.074 [2024-11-16 17:50:17.561498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.561607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.561644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.074 [2024-11-16 17:50:17.561724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.561838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.561864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.074 [2024-11-16 17:50:17.561966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.562071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.562100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.074 [2024-11-16 17:50:17.562219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.562329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.074 [2024-11-16 17:50:17.562354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.074 qpair failed and we were unable to recover it. 00:30:40.351 [2024-11-16 17:50:17.562454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.562539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.562564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.351 qpair failed and we were unable to recover it. 00:30:40.351 [2024-11-16 17:50:17.562686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.562767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.562811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.351 qpair failed and we were unable to recover it. 00:30:40.351 [2024-11-16 17:50:17.562958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.563073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.563099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.351 qpair failed and we were unable to recover it. 00:30:40.351 [2024-11-16 17:50:17.563222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.563333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.563358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.351 qpair failed and we were unable to recover it. 00:30:40.351 [2024-11-16 17:50:17.563472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.351 [2024-11-16 17:50:17.563565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.563590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.563688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.563769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.563795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.563887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.563979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.564005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.564174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.564307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.564333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.564465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.564614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.564666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.564786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.564876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.564902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.565009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.565123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.565149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.565292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.565390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.565419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.565558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.565666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.565692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.565786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.565900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.565925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.566067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.566150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.566175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.566290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.566378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.566403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.566515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.566677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.566703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.566817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.566903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.566928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.567036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.567120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.567149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.567314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.567428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.567453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.567539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.567635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.567661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.567747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.567832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.567857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.567969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.568089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.568114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.568269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.568358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.568383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.568523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.568608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.568649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.568735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.568828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.568854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.352 qpair failed and we were unable to recover it. 00:30:40.352 [2024-11-16 17:50:17.568945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.352 [2024-11-16 17:50:17.569027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.569053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.569176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.569266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.569293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.569376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.569492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.569518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.569635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.569730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.569757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.569873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.570155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.570409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.570656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.570857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.570993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.571106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.571246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.571272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.571391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.571527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.571552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.571643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.571726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.571750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.571864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.571989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.572015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.572166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.572249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.572274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.572413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.572530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.572557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.572699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.572840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.572865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.572991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.573102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.573127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.573218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.573361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.573386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.573495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.573589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.573621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.573716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.573828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.573853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.573997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.574083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.574109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.574192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.574330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.574355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.574435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.574541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.574566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.353 qpair failed and we were unable to recover it. 00:30:40.353 [2024-11-16 17:50:17.574703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.353 [2024-11-16 17:50:17.574791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.574817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.574930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.575016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.575042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.575190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.575305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.575331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.575414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.575532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.575558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.575682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.575802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.575827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.575927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.576017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.576042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.576167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.576274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.576298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.576377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.576490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.576516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.576674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.576783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.576809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.576949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.577029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.577056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.577177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.577324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.577350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.577435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.577524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.577551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.577669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.577782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.577807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.577922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.578009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.578034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.578175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.578285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.578310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.578427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.578543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.578569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.578698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.578786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.578810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.578926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.579139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.579358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.579591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.579842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.579953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.580039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.580149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.580175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.580288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.580406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.580432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.580549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.580639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.580665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.354 qpair failed and we were unable to recover it. 00:30:40.354 [2024-11-16 17:50:17.580779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.580878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.354 [2024-11-16 17:50:17.580903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.581035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.581155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.581182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.581297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.581435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.581461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.581553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.581640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.581667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.581755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.581848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.581874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.581995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.582123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.582149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.582240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.582348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.582374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.582461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.582578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.582603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.582728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.582865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.582890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.583030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.583176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.583201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.583313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.583438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.583464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.583611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.583759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.583784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.583872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.584018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.584044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.584155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.584262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.584287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.584426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.584573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.584598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.584741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.584851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.584876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.585019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.585096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.585121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.585242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.585380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.585406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.585555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.585645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.585672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.585764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.585847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.585873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.585974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.586115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.586141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.586257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.586376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.586402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.586520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.586673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.586699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.586820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.586965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.586989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.355 [2024-11-16 17:50:17.587099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.587236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.355 [2024-11-16 17:50:17.587261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.355 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.587359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.587443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.587469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.587562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.587685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.587713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.587833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.587958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.587984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.588066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.588180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.588204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.588289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.588393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.588419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.588561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.588668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.588694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.588778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.588896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.588921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.589035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.589120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.589145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.589233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.589335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.589359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.589465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.589572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.589597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.589747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.589836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.589862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.589980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.590234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.590430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.590644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.590897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.590981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.591112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.591330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.591553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.591772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.591913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.592053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.592141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.592166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.592259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.592410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.356 [2024-11-16 17:50:17.592435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-16 17:50:17.592526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.592629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.592656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.592776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.592881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.592905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.593045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.593196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.593221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.593307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.593388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.593412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.593526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.593603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.593637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.593748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.593885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.593910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.594050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.594133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.594160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.594253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.594391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.594416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.594558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.594710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.594736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.594851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.594999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.595170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.595388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.595581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.595835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.595986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.596127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.596213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.596237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.596351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.596462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.596488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.596580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.596685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.596712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-16 17:50:17.596858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.596970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.357 [2024-11-16 17:50:17.596995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.597074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.597199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.597226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.597312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.597407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.597431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.597513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.597625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.597652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.597795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.597934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.597960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.598059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.598172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.598198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.598288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.598404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.598430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.598573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.598689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.598715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.598852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.598977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.599002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.599115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.599232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.599257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.599348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.599427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.599452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.599590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.599710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.599741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.599850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.599977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.600143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.600357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.600609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.600875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.600983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.601072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.601163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.601188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.601302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.601444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.601470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.601585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.601705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.601732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.601876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.601970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.601996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.602084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.602191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.602221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.602366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.602481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.602507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.602630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.602744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.602769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.602888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.603026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.603051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.603192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.603304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.603329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.603440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.603562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.358 [2024-11-16 17:50:17.603587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-16 17:50:17.603738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.603833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.603859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.603978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.604087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.604113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.604254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.604396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.604422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.604563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.604660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.604687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.604834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.604948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.604980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.605097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.605216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.605241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.605350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.605463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.605488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.605634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.605725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.605751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.605864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.605960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.605986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.606105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.606190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.606214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.606303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.606388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.606414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.606554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.606669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.606695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.606809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.606898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.606923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.607036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.607149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.607175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.607291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.607407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.607436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.607551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.607671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.607695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.607810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.607903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.607927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.608042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.608126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.608151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.608243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.608397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.608422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.608535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.608663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.608689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.608779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.608888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.608913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.609034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.609147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.609173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.609257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.609371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.609396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.609509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.609628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.609653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.609798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.609881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.609906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.359 qpair failed and we were unable to recover it. 00:30:40.359 [2024-11-16 17:50:17.610001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.359 [2024-11-16 17:50:17.610116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.610141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.610291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.610431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.610456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.610573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.610703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.610731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.610848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.610976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.611003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.611096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.611209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.611235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.611340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.611456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.611482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.611630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.611771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.611796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.611876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.612025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.612050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.612145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.612261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.612288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.612429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.612544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.612570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.612751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.612868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.612894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.613008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.613155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.613180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.613288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.613402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.613428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.613513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.613633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.613659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.613804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.613898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.613923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.614010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.614146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.614171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.614280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.614392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.614417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.614527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.614639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.614665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.614746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.614863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.614889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.615000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.615116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.615141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.615290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.615403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.615429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.615569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.615694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.615720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.360 [2024-11-16 17:50:17.615810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.615893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.360 [2024-11-16 17:50:17.615917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.360 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.616003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.616123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.616149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.616265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.616404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.616430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.616516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.616626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.616652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.616768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.616883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.616908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.617020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.617131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.617156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.617302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.617390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.617415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.617532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.617614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.617647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.617758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.617875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.617901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.618025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.618141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.618167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.618248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.618387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.618413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.618495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.618635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.618660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.618754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.618865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.618889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.619008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.619098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.619123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.619261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.619379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.619405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.619487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.619575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.619602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.619736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.619848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.619875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.619991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.620107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.620133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.620256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.620403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.620428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.620545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.620670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.620697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.620795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.620933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.620959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.621049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.621168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.621193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.621282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.621400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.621425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.621505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.621587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.621612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.361 [2024-11-16 17:50:17.621703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.621816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.361 [2024-11-16 17:50:17.621843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.361 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.621958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.622070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.622096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.622209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.622324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.622350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.622463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.622579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.622604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.622724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.622808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.622833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.622970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.623078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.623104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.623247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.623353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.623379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.623465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.623607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.623642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.623748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.623854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.623880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.624021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.624163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.624189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.624300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.624389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.624414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.624525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.624647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.624673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.624765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.624882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.624907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.625022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.625113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.625138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.625250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.625334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.625358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.625480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.625587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.625612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.625737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.625824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.625849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.625991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.626111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.626138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.626247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.626361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.626386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.626504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.626627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.362 [2024-11-16 17:50:17.626654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.362 qpair failed and we were unable to recover it. 00:30:40.362 [2024-11-16 17:50:17.626771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.626891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.626916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.627057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.627133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.627158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.627298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.627387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.627413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.627527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.627626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.627652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.627735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.627869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.627894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.627976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.628064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.628090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.628196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.628338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.628363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.628485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.628603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.628659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.628743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.628858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.628885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.629028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.629141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.629167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.629286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.629366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.629392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.629511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.629632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.629659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.629745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.629831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.629855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.629977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.630088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.630113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.630192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.630310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.630335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.630480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.630588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.630613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.630744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.630856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.630882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.630998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.631115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.631140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.631243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.631381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.631407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.631522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.631652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.631678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.631819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.631941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.631968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.632082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.632226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.632251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.632359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.632446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.632473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.632594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.632738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.632764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.363 [2024-11-16 17:50:17.632879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.633009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.363 [2024-11-16 17:50:17.633035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.363 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.633154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.633266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.633291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.633397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.633484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.633509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.633627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.633707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.633732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.633873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.634014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.634040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.634158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.634270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.634296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.634434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.634572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.634598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.634719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.634837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.634862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.634982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.635063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.635090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.635167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.635302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.635328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.635401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.635482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.635507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.635627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.635700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.635725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.635867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.636150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.636375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.636592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.636832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.636933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.637009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.637122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.637148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.637236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.637378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.637404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.637478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.637589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.637614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.637719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.637866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.637891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.638000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.638137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.638162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.638286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.638404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.638429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.638571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.638653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.364 [2024-11-16 17:50:17.638680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.364 qpair failed and we were unable to recover it. 00:30:40.364 [2024-11-16 17:50:17.638830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.638941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.638966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.639080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.639166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.639192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.639335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.639429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.639454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.639566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.639679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.639704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.639791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.639868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.639893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.640007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.640158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.640183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.640265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.640378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.640409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.640519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.640636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.640662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.640805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.640920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.640946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.641066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.641144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.641170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.641312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.641392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.641417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.641533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.641649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.641676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.641792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.641879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.641904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.642051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.642166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.642191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.642330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.642468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.642493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.642610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.642736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.642761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.642848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.642961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.642991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.643108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.643200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.643226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.643369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.643519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.643545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.643694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.643777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.643803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.643897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.644011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.644038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.644179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.644260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.644286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.644394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.644506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.644532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.644644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.644764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.644789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.644933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.645074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.645099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.365 qpair failed and we were unable to recover it. 00:30:40.365 [2024-11-16 17:50:17.645215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.365 [2024-11-16 17:50:17.645366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.645391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.645509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.645645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.645685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.645779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.645893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.645919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.646007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.646096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.646123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.646212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.646322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.646348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.646432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.646570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.646596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.646717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.646843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.646870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.646952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.647070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.647095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.647235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.647321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.647346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.647457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.647537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.647563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.647687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.647830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.647854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.647998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.648083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.648113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.648204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.648289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.648315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.648427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.648515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.648539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.648664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.648775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.648800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.648917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.649113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.649355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.649538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.649763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.649870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.649952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.650066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.650091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.650206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.650323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.650347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.650464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.650550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.650576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.650692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.650806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.650832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.650954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.651071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.366 [2024-11-16 17:50:17.651095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.366 qpair failed and we were unable to recover it. 00:30:40.366 [2024-11-16 17:50:17.651204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.651316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.651342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.651483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.651626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.651653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.651772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.651881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.651906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.652023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.652104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.652128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.652242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.652357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.652382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.652466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.652584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.652609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.652737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.652880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.652906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.653001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.653110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.653136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.653246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.653384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.653409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.653522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.653612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.653647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.653788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.653900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.653925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.654040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.654120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.654145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.654236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.654366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.654391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.654485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.654566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.654591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.654717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.654854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.654879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.654996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.655097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.655122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.655262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.655414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.655439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.655590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.655714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.655740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.655884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.655975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.656120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.656311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.656553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.656845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.656984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.367 [2024-11-16 17:50:17.657074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.657185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.367 [2024-11-16 17:50:17.657211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.367 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.657317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.657400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.657425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.657541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.657654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.657680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.657765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.657870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.657894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.658002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.658087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.658112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.658232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.658343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.658368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.658481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.658565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.658591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.658741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.658823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.658849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.658998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.659139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.659164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.659273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.659363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.659388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.659495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.659608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.659639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.659728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.659869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.659893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.660004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.660090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.660115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.660259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.660377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.660402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.660520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.660631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.660656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.660747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.660881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.660905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.661050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.661164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.661188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.661330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.661470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.661494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.661644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.661737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.661762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.661870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.661990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.662014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.662137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.662277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.662303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.662419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.662500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.662525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.662634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.662721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.368 [2024-11-16 17:50:17.662747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.368 qpair failed and we were unable to recover it. 00:30:40.368 [2024-11-16 17:50:17.662862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.662977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.663001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.663093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.663207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.663233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.663352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.663442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.663467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.663585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.663735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.663760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.663884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.663994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.664018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.664134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.664283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.664307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.664421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.664562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.664587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.664679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.664790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.664814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.664932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.665015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.665041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.665158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.665272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.665297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.665406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.665492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.665516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.665629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.665774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.665799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.665916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.666188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.666441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.666640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.666852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.666993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.667072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.667213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.667239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.667326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.667436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.667461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.667600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.667753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.667779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.667894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.668127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.668377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.668582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.668817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.668981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.669125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.669236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.669261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.369 qpair failed and we were unable to recover it. 00:30:40.369 [2024-11-16 17:50:17.669367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.369 [2024-11-16 17:50:17.669452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.669478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.669647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.669760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.669785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.669876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.670045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.670071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.670187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.670304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.670330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.670446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.670563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.670589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.670675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.670795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.670822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.670967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.671081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.671106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.671250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.671391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.671417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.671528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.671639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.671665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.671783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.671895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.671920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.672039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.672181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.672206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.672325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.672444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.672470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.672582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.672669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.672696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.672812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.672926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.672953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.673048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.673161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.673186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.673298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.673391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.673416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.673535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.673648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.673674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.673792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.673903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.673927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.674044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.674157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.674182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.674293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.674380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.674407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.674548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.674653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.674680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.674795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.674898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.674923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.675014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.675106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.675131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.370 qpair failed and we were unable to recover it. 00:30:40.370 [2024-11-16 17:50:17.675247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.370 [2024-11-16 17:50:17.675384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.675409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.675522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.675671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.675697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.675843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.675951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.675976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.676063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.676180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.676205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.676323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.676466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.676491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.676614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.676734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.676761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.676899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.676989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.677101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.677357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.677597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.677817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.677949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.678069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.678205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.678230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.678311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.678427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.678456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.678552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.678634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.678659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.678789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.678869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.678893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.679009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.679145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.679169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.679309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.679453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.679477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.679590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.679686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.679711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.679866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.679977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.680002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.680146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.680252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.680276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.680391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.680512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.680536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.680653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.680770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.680795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.680905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.681021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.681050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.681136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.681243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.681268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.681391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.681481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.681506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.371 qpair failed and we were unable to recover it. 00:30:40.371 [2024-11-16 17:50:17.681625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.371 [2024-11-16 17:50:17.681737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.681761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.681847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.681956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.681981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.682091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.682202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.682227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.682366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.682475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.682500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.682644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.682758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.682782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.682899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.683014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.683038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.683176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.683290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.683314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.683425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.683552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.683583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.683700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.683843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.683869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.683957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.684069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.684095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.684193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.684272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.684298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.684437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.684553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.684579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.684702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.684816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.684840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.684928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.685123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.685405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.685651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.685884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.685992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.686022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.686114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.686224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.686249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.686370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.686482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.686507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.686590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.686710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.686736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.686881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.686990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.687017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.687127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.687242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.687267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.687409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.687556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.687581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.372 qpair failed and we were unable to recover it. 00:30:40.372 [2024-11-16 17:50:17.687674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.372 [2024-11-16 17:50:17.687764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.687790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.687944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.688174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.688389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.688620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.688831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.688975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.689067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.689176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.689202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.689286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.689402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.689427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.689539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.689655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.689680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.689819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.689895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.689919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.690015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.690116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.690142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.690257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.690373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.690399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.690539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.690626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.690653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.690777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.690914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.690939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.691057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.691171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.691197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.691336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.691411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.691437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.691593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.691733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.691760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.691849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.692048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.692074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.692198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.692312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.692338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.373 qpair failed and we were unable to recover it. 00:30:40.373 [2024-11-16 17:50:17.692461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.373 [2024-11-16 17:50:17.692546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.692572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.692693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.692803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.692829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.692938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.693150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.693375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.693622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.693852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.693988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.694130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.694238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.694264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.694356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.694466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.694491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.694609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.694735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.694760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.694872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.694985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.695009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.695145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.695294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.695319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.695417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.695554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.695580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.695710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.695795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.695821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.695937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.696056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.696081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.696209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.696321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.696346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.696440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.696582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.696607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.696730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.696873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.696898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.697015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.697099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.697125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.697268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.697382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.697406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.697516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.697601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.697651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.697742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.697849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.697874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.698010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.698113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.698137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.698274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.698391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.698415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.698538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.698646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.698672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.374 qpair failed and we were unable to recover it. 00:30:40.374 [2024-11-16 17:50:17.698821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.374 [2024-11-16 17:50:17.698911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.698936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.699013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.699127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.699151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.699251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.699371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.699396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.699504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.699621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.699647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.699763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.699905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.699929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.700054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.700147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.700172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.700312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.700425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.700450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.700562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.700669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.700694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.700804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.700914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.700939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.701034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.701174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.701199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.701322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.701412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.701436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.701544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.701643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.701670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.701786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.701895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.701922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.702036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.702122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.702147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.702260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.702400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.702424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.702513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.702656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.702682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.702761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.702876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.702901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.703015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.703131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.703155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.703268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.703379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.703403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.703517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.703625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.703651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.703767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.703850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.703875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.704012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.704096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.704123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.704202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.704341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.704366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.375 qpair failed and we were unable to recover it. 00:30:40.375 [2024-11-16 17:50:17.704481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.704599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.375 [2024-11-16 17:50:17.704632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.704754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.704872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.704896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.705006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.705119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.705144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.705239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.705357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.705382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.705522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.705648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.705674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.705786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.705996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.706166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.706394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.706640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.706853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.706992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.707104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.707213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.707237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.707353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.707464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.707488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.707604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.707699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.707726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.707806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.707923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.707948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.708065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.708137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.708161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.708304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.708442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.708467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.708580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.708667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.708692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.708775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.708891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.708915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.709009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.709158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.709182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.709276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.709396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.709420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.709536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.709648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.709674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.709823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.709953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.709978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.710091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.710206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.710231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.710322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.710466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.710491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.376 [2024-11-16 17:50:17.710605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.710728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.376 [2024-11-16 17:50:17.710755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.376 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.710847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.710971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.710997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.711136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.711220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.711247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.711391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.711534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.711560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.711681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.711794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.711819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.711914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.712191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.712373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.712594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.712886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.712997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.713137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.713355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.713640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.713868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.713982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.714134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.714275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.714300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.714446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.714532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.714558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.714704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.714791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.714818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.714939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.715053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.715080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.715197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.715311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.715338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.715482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.715569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.715595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.715743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.715856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.715881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.716006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.716117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.716142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.716256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.716368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.716395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.716477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.716572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.716597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.716725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.716834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.716858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.377 qpair failed and we were unable to recover it. 00:30:40.377 [2024-11-16 17:50:17.716972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.377 [2024-11-16 17:50:17.717050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.717074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.717181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.717293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.717319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.717435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.717576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.717601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.717756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.717881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.717906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.717987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.718107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.718132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.718226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.718335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.718359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.718439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.718527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.718551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.718668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.718781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.718806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.718955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.719042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.719072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.719218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.719356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.719381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.719468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.719605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.719637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.719757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.719845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.719870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.719990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.720073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.720097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.720212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.720291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.720317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.720439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.720527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.720554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.720695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.720807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.720833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.720923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.721065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.721089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.721209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.721325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.721349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.721463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.721581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.721609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.721705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.721785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.721810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.721962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.722065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.722089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.378 qpair failed and we were unable to recover it. 00:30:40.378 [2024-11-16 17:50:17.722174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.722285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.378 [2024-11-16 17:50:17.722310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.722401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.722516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.722541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.722659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.722800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.722825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.722910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.722999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.723161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.723360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.723568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.723845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.723983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.724078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.724192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.724217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.724331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.724439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.724464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.724543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.724654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.724681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.724830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.724949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.724974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.725069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.725187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.725213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.725351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.725440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.725464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.725580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.725735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.725761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.725850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.725958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.725983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.726101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.726183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.726208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.726301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.726406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.726434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.726553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.726673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.726699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.726814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.726897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.726922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.727041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.727154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.727179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.727271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.727379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.727404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.727521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.727631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.727655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.727770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.727916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.727941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.379 qpair failed and we were unable to recover it. 00:30:40.379 [2024-11-16 17:50:17.728059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.379 [2024-11-16 17:50:17.728201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.728225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.728336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.728454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.728477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.728597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.728705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.728731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.728836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.728945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.728971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.729056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.729199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.729225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.729369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.729451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.729476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.729589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.729690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.729716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.729830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.729936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.729961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.730058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.730195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.730221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.730339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.730455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.730480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.730589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.730682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.730707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.730851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.731125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.731380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.731613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.731859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.731975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.732145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.732391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.732643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.732883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.732995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.733140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.733226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.733251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.733364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.733443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.733467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.733561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.733674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.733702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.733787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.733870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.733896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.734018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.734103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.734129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.734269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.734377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.380 [2024-11-16 17:50:17.734403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.380 qpair failed and we were unable to recover it. 00:30:40.380 [2024-11-16 17:50:17.734547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.734667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.734693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.734835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.734922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.734949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.735033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.735173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.735198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.735304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.735445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.735470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.735613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.735740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.735765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.735855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.735967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.735993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.736150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.736328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.736354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.736438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.736583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.736608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.736748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.736829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.736855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.736972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.737113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.737139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.737224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.737364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.737390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.737476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.737587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.737613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.737780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.737894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.737919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.738027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.738107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.738132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.738278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.738418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.738444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.738532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.738607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.738639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.738720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.738811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.738840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.738922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.739038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.739063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.739167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.739279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.739303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.739447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.739537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.739562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.739697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.739783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.739808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.739926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.740077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.740101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.740242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.740321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.740346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.740483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.740596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.740628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.740721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.740861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.740886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.740977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.741095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.381 [2024-11-16 17:50:17.741119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.381 qpair failed and we were unable to recover it. 00:30:40.381 [2024-11-16 17:50:17.741262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.741359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.741385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.741486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.741639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.741664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.741783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.741899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.741923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.742073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.742219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.742243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.742358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.742445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.742469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.742576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.742699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.742724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.742839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.742916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.742940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.743040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.743157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.743181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.743292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.743431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.743455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.743571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.743649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.743674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.743769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.743885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.743909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.743991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.744118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.744143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.744261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.744370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.744396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.744511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.744602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.744635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.744746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.744889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.744914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.745026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.745106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.745133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.745220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.745364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.745389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.745538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.745649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.745675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.745768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.745850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.745875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.745994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.746102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.746128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.746243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.746380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.746404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.746491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.746610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.746643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.746760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.746900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.746926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.747010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.747127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.747152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.747294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.747380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.747405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.382 [2024-11-16 17:50:17.747546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.747663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.382 [2024-11-16 17:50:17.747689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.382 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.747832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.747917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.747942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.748055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.748197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.748223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.748339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.748429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.748453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.748566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.748671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.748696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.748832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.748946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.748971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.749085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.749200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.749224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.749306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.749451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.749476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.749567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.749698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.749724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.749840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.749922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.749946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.750083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.750167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.750192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.750272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.750357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.750381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.750504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.750584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.750609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.750740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.750860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.750885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.750999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.751116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.751141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.751260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.751356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.751382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.751466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.751572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.751598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.751720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.751836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.751862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.751951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.752142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.752381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.752622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.752850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.752986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.753069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.753210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.753235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.383 qpair failed and we were unable to recover it. 00:30:40.383 [2024-11-16 17:50:17.753379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.753493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.383 [2024-11-16 17:50:17.753518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.753643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.753755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.753780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.753918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.754053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.754078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.754195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.754336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.754361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.754492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.754582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.754606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.754701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.754808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.754833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.754950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.755033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.755059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.755202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.755315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.755340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.755450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.755564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.755591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.755719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.755834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.755861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.755983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.756069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.756094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.756205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.756318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.756344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.756492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.756604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.756639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.756760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.756883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.756908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.756995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.757143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.757168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.757255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.757338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.757363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.757474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.757558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.757583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.757715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.757853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.757878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.757996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.758141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.758166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.758250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.758356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.758381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.758495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.758632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.758659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.384 qpair failed and we were unable to recover it. 00:30:40.384 [2024-11-16 17:50:17.758738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.384 [2024-11-16 17:50:17.758821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.758846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.758934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.759127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.759152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.759293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.759415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.759444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.759562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.759684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.759710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.759827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.759974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.759999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.760085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.760198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.760223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.760336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.760448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.760474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.760614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.760756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.760781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.760895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.761035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.761061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.761170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.761287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.761311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.761427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.761502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.761527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.761638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.761785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.761811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.761955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.762064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.762094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.762289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.762399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.762425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.762566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.762706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.762732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.762850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.762967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.762993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.763106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.763215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.763241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.763332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.763445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.763470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.763585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.763711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.763737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.763845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.763934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.763959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.764065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.764145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.764170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.764314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.764425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.764452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.764536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.764649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.764680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.764801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.764915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.764942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.765053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.765170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.765195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.765345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.765434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.385 [2024-11-16 17:50:17.765459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.385 qpair failed and we were unable to recover it. 00:30:40.385 [2024-11-16 17:50:17.765577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.765665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.765691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.765802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.765916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.765942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.766057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.766198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.766223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.766332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.766446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.766471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.766586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.766699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.766726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.766922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.767033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.767059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.767178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.767283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.767313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.767460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.767574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.767599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.767723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.767799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.767824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.767916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.768002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.768027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.768172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.768311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.768336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.768454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.768584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.768614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.768789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.768940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.768968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.769147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.769268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.769293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.769436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.769580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.769606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.769743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.769873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.769917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.770127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.770355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.770383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.770488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.770612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.770645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.770775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.770919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.770950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.771108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.771278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.771303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.771415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.771658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.771687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.771840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.771941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.771967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.772087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.772200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.386 [2024-11-16 17:50:17.772225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.386 qpair failed and we were unable to recover it. 00:30:40.386 [2024-11-16 17:50:17.772338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.772443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.772468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.772580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.772692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.772718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.772836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.772919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.772944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.773055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.773200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.773225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.773371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.773483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.773508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.773638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.773755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.773781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.773867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.773984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.774120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.774354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.774607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.774870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.774988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.775130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.775244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.775270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.775394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.775472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.775497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.775609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.775707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.775733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.775852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.775996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.776111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.776336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.776623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.776876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.776977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.777089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.777177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.777202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.777343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.777448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.777473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.777636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.777760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.777786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.777898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.778003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.778028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.778119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.778232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.387 [2024-11-16 17:50:17.778258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.387 qpair failed and we were unable to recover it. 00:30:40.387 [2024-11-16 17:50:17.778378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.778520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.778546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.778658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.778788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.778813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.778921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.779142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.779399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.779604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.779876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.779983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.780008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.780107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.780250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.780276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.780401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.780511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.780537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.780650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.780746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.780771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.780914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.781112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.781324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.781629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.781893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.781982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.782007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.782149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.782259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.782284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.782367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.782483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.782508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.782654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.782738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.782764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.782882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.782989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.783094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.783299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.783610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.783870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.783983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.388 qpair failed and we were unable to recover it. 00:30:40.388 [2024-11-16 17:50:17.784099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.784179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.388 [2024-11-16 17:50:17.784205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.784300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.784385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.784412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.784522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.784640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.784666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.784754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.784845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.784870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.784954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.785063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.785089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.785168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.785284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.785310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.785429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.785536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.785561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.785671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.785783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.785808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.785919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.786036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.786063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.786183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.786296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.786322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.786445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.786556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.786581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.786696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.786817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.786844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.786971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.787116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.787141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.787256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.787335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.787361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.787476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.787559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.787587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.787714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.787852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.787877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.787996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.788077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.788102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.788216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.788307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.788333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.788475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.788587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.788612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.788732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.788847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.788873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.389 [2024-11-16 17:50:17.788989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.789100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.389 [2024-11-16 17:50:17.789126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.389 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.789246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.789386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.789411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.789528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.789643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.789671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.789811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.789926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.789951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.790039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.790149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.790175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.790287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.790430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.790456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.790572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.790720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.790746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.790863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.790982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.791007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.791150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.791288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.791313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.791424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.791565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.791590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.791698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.791840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.791866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.791980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.792062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.792088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.792199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.792313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.792338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.792422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.792537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.792564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.792650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.792779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.792804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.792920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.793028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.793054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.793195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.793307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.793333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.793440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.793560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.793587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.793732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.793845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.793870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.794013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.794122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.794146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.794260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.794373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.794399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.794484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.794572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.794598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.794751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.794840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.390 [2024-11-16 17:50:17.794865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.390 qpair failed and we were unable to recover it. 00:30:40.390 [2024-11-16 17:50:17.794948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.795060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.795085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.795193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.795278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.795303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.795425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.795544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.795569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.795709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.795829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.795855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.795943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.796077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.796103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.796249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.796362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.796387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.796502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.796614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.796645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.796729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.796867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.796892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.797008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.797125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.797152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.797263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.797343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.797369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.797484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.797602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.797655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.797782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.797932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.797957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.798047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.798162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.798189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.798279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.798384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.798409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.798564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.798681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.798712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.798826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.798937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.798962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.799081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.799222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.799247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.799390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.799499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.799526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.799610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.799711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.799737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.799815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.799900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.799925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.800016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.800130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.800155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.800276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.800363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.800390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.800501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.800614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.391 [2024-11-16 17:50:17.800655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.391 qpair failed and we were unable to recover it. 00:30:40.391 [2024-11-16 17:50:17.800762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.800912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.800939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.801062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.801175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.801207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.801309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.801405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.801432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.801584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.801719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.801751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.801847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.801962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.801989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.802091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.802207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.802238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.802367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.802456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.802501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.802604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.802743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.802773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.802899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.803020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.803047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.803164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.803247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.803278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.803396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.803488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.803518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.803643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.803741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.803776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.803896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.804007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.804034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.804166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.804283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.804310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.804425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.804552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.804578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.804681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.804791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.804819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.804924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.805051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.805094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.805219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.805367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.805394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.805538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.805644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.805671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.805783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.805900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.805927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.806053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.806203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.806235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.806360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.806456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.806511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.806687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.806841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.806872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.807030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.807114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.807141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.807240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.807359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.807388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.807507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.807589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.807627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.392 [2024-11-16 17:50:17.807755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.807874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.392 [2024-11-16 17:50:17.807906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.392 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.808029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.808151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.808177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.808276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.808399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.808426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.808530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.808653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.808683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.808780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.808899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.808926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.809051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.809174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.809202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.809312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.809434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.809465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.809622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.809724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.809756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.809883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.810041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.810077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.810203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.810301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.810328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.810463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.810614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.810683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.810776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.810863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.810898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.811054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.811145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.811172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.811262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.811373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.811400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.811508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.811595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.811644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.811763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.811853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.811884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.812007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.812154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.812185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.812340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.812465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.812498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.812581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.812709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.812738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.812832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.812954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.812985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.813108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.813263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.813295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.813398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.813537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.813567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.813676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.813803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.813835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.813982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.814073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.814103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.814224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.814339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.814369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.814469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.814586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.814613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.814776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.814896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.814929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.393 [2024-11-16 17:50:17.815033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.815145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.393 [2024-11-16 17:50:17.815172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.393 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.815273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.815410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.815441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.815523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.815630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.815661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.815807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.815897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.815924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.816043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.816167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.816197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.816322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.816434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.816464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.816585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.816725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.816753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.816873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.816998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.817026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.817170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.817265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.817295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.817426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.817558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.817586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.817736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.817852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.817882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.818023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.818113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.818141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.818256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.818348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.818378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.818514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.818696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.818726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.818851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.818948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.818977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.819065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.819174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.819204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.819349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.819441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.819472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.819588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.819754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.819785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.819914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.820035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.820066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.820206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.820311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.820339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.820436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.820537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.820568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.820672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.820787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.820816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.394 [2024-11-16 17:50:17.820905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.821002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.394 [2024-11-16 17:50:17.821031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.394 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.821122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.821244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.821277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.821442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.821544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.821576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.821713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.821860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.821887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.822014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.822137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.822168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.822266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.822358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.822385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.822552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.822714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.822743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.822852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.823129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.823359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.823560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.823811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.823975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.395 [2024-11-16 17:50:17.824095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.824201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.395 [2024-11-16 17:50:17.824232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.395 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-16 17:50:17.824353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-16 17:50:17.824444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-16 17:50:17.824474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-16 17:50:17.824606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-16 17:50:17.824721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-16 17:50:17.824755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-16 17:50:17.824842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-16 17:50:17.824991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-16 17:50:17.825017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-16 17:50:17.825123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-16 17:50:17.825268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.825295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.825401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.825493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.825525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.825636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.825750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.825778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.825891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.826006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.826036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.826184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.826324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.826350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.826450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.826572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.826601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.826774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.826873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.826901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.827065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.827189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.827221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.827343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.827484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.827514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.827652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.827738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.827765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.827854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.827997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.828028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.828176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.828309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.828342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.828486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.828586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.828639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.828762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.828870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.828901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.829083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.829182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.829217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.829352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.829475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.829506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.829588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.829715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.829743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.829834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.829948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.829978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.830087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.830190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.830226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.830406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.830567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.830596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-16 17:50:17.830786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.830901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-16 17:50:17.830927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.831021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.831136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.831170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.831302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.831457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.831487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.831598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.831726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.831754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.831887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.832054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.832085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.832233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.832363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.832399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.832529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.832649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.832680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.832773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.832891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.832918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.833026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.833114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.833144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.833236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.833377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.833411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.833537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.833674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.833707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.833867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.833991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.834021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.834119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.834246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.834276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.834418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.834566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.834600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.834757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.834850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.834883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.835062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.835197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.835226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.835387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.835515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.835549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.835686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.835810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.835840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.835962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.836080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.836106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.836234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.836386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.836419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.836548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.836692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.836726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.836825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.836932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.836979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.837136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.837255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-16 17:50:17.837290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-16 17:50:17.837431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.837558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.837590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.837750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.837872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.837899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.837989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.838144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.838175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.838333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.838438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.838466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.838595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.838719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.838746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.838836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.838956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.838983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.839115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.839234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.839263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.839383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.839534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.839561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.839715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.839842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.839872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.839992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.840096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.840128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.840220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.840310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.840354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.840488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.840590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.840637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.840742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.840833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.840861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.840984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.841102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.841129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.841250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.841360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.841394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.841512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.841631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.841658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.841779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.841881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.841909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.842035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.842172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.842201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.842306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.842432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.842464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.842596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.842717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.842750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.842842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.842993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.843025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.843140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.843251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.843296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.843415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.843560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.843590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.843743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.843839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.843871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-16 17:50:17.843964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-16 17:50:17.844081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.844111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.844226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.844323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.844352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.844469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.844595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.844637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.844765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.844861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.844891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.845009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.845134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.845167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.845290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.845408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.845439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.845538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.845657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.845689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.845818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.845908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.845938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.846030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.846116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.846146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.846276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.846389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.846416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.846538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.846694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.846725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.846837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.846956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.846984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.847109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.847198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.847228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.847376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.847467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.847495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.847614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.847742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.847777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.847870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.847961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.847992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.848084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.848165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.848195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.848296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.848417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.848444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.848559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.848701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.848734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.848857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.848960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.848989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.849136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.849219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.849247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.849354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.849445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.849478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.849592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.849745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.849772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.849873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.849997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.850026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.850143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.850225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.850257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.850404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.850511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.850540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.850650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.850770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.850797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.850922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.851067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.851096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-16 17:50:17.851191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.851310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-16 17:50:17.851340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.851467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.851611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.851648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.851752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.851883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.851911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.852009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.852146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.852175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.852274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.852396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.852426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.852547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.852678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.852707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.852821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.852911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.852941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.853068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.853154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.853181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.853327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.853430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.853461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.853589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.853699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.853726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.853829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.853918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.853944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.854074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.854204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.854230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.854320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.854439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.854469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.854566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.854670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.854698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.854819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.854944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.854973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.855087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.855225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.855255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.855387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.855477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.855504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.855638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.855765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.855795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.855949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.856064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.856093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.856218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.856312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.856342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.856493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.856629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.856661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.856779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.856897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.856924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.857054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.857174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.857203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.857303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.857384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.857413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.857502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.857629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.857659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.857779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.857877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.857908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.858014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.858129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.858156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.858260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.858374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.858400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.858522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.858653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.858682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-16 17:50:17.858809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-16 17:50:17.858936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.858967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.859065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.859213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.859241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.859368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.859470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.859502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.859632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.859751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.859781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.859904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.860022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.860049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.860199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.860319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.860349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.860479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.860629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.860656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.860783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.860905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.860933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.861057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.861152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.861183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.861297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.861421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.861447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.861595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.861692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.861722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.861813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.861932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.861964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.862086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.862169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.862199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.862307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.862397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.862425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.862574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.862712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.862741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.862868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.862988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.863016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.863135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.863253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.863279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.863400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.863522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.863549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.863723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.863844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.863870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.864000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.864098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.864125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.864252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.864370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.864400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.864523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.864653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.864681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.864818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.864910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.864940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.865082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.865193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-16 17:50:17.865223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-16 17:50:17.865322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.865410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.865437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.865561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.865649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.865677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.865840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.865990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.866020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.866150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.866251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.866282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.866435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.866558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.866590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.866761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.866872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.866903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.867028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.867124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.867151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.867292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.867388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.867416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.867558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.867699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.867731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.867832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.867952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.867981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.868112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.868228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.868255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.868401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.868525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.868553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.868672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.868784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.868811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.868904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.869022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.869049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.869169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.869320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.869350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.869440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.869527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.869558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.869658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.869776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.869805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.869954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.870066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.870094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.870190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.870294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.870325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.870479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.870600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.870635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.870789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.870883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.870913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.871038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.871127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.871159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.871288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.871405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.871432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.871528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.871649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.871677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.871808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.871913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.871946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.872072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.872187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.872213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.872365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.872488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.872517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.872643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.872731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.872759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-16 17:50:17.872879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-16 17:50:17.872973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.873003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.873091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.873179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.873209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.873359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.873484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.873512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.873658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.873803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.873833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.873934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.874041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.874068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.874223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.874359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.874385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.874507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.874593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.874652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.874780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.874915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.874946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.875066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.875181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.875222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.875311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.875397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.875427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.875550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.875682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.875711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.875835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.875936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.875971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.876086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.876204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.876235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.876368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.876487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.876516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.876638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.876741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.876772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.876928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.877013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.877042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.877176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.877270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.877299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.877419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.877519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.877551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.877701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.877793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.877822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.877954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.878074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.878103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.878197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.878314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.878344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.878482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.878567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.878596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.878729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.878824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.878854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.878955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.879075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.879102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.879224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.879338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.879366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.879460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.879608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.879654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.879799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.879888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.879915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.880033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.880177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.880209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.687 [2024-11-16 17:50:17.880327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.880439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.687 [2024-11-16 17:50:17.880465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.687 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.880562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.880697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.880729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.880847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.880976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.881005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.881108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.881225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.881251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.881390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.881507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.881537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.881676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.881818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.881849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.881948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.882061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.882087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.882187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.882270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.882301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.882393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.882486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.882516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.882624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.882740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.882767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.882869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.883029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.883061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.883186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.883332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.883360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.883456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.883579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.883609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.883746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.883867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.883900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.884032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.884158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.884185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.884320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.884464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.884495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.884590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.884690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.884720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.884815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.884968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.884995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.885115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.885257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.885290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.885450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.885604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.885677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.885781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.885879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.885910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.886020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.886109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.886135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.886227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.886345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.886372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.886485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.886624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.886657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.886760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.886882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.886909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.887054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.887177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.887204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.887298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.887411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.887438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.887543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.887661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.887689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.887805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.887890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.887928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.688 qpair failed and we were unable to recover it. 00:30:40.688 [2024-11-16 17:50:17.888024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.688 [2024-11-16 17:50:17.888168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.888196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.888330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.888458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.888485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.888581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.888676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.888704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.888835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.888931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.888958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.889085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.889208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.889239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.889385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.889500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.889533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.889642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.889759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.889786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.889897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.890014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.890041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.890156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.890268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.890299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.890434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.890526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.890561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.890673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.890797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.890828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.890914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.891027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.891055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.891146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.891302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.891329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.891445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.891564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.891595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.891695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.891792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.891823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.891916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.892033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.892062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.892184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.892304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.892333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.892462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.892556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.892597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.892755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.892918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.892954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.893113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.893266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.893300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.893440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.893596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.893670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.893793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.893882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.893929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.894067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.894185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.894216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.894306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.894425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.894456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.894550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.894669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.689 [2024-11-16 17:50:17.894702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.689 qpair failed and we were unable to recover it. 00:30:40.689 [2024-11-16 17:50:17.894797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.894942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.894969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.895070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.895172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.895199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.895324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.895462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.895493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.895582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.895682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.895710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.895830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.895977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.896136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.896342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.896586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.896847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.896981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.897105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.897199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.897228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.897361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.897479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.897509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.897658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.897748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.897775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.897923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.898039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.898067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.898174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.898290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.898320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.898470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.898584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.898611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.898743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.898841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.898871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.898988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.899083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.899110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.899219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.899334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.899360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.899479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.899600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.899643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.899743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.899837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.899866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.899967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.900086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.900114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.900233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.900343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.900370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.900463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.900549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.900578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.900717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.900812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.900842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.900956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.901081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.901112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.901267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.901399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.901429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.901544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.901697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.901726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.901819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.901907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.901937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.690 qpair failed and we were unable to recover it. 00:30:40.690 [2024-11-16 17:50:17.902050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.902141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.690 [2024-11-16 17:50:17.902169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.902272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.902397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.902428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.902525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.902611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.902648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.902775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.902862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.902890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.903010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.903105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.903132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.903281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.903407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.903434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.903535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.903654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.903690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.903819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.903926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.903954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.904075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.904165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.904193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.904326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.904471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.904497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.904596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.904762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.904790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.904894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.904994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.905024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.905149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.905273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.905303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.905428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.905525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.905556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.905683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.905776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.905804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.905905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.905999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.906025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.906121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.906218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.906245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.906370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.906493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.906522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.906646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.906743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.906770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.906864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.906987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.907018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.907140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.907259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.907290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.907397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.907501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.907528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.907663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.907753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.907780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.907897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.908022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.908049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.908138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.908249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.908281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.908460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.908580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.908607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.908739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.908858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.908886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.909055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.909215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.909259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.909394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.909571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.691 [2024-11-16 17:50:17.909605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.691 qpair failed and we were unable to recover it. 00:30:40.691 [2024-11-16 17:50:17.909775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.909892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.909938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.910043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.910138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.910167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.910274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.910450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.910483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.910587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.910696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.910729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.910878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.911031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.911062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.911190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.911284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.911314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.911406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.911539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.911565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.911730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.911849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.911876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.911987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.912107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.912135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.912258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.912403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.912436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.912605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.912758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.912786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.912914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.913050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.913077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.913241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.913389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.913418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.913510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.913637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.913665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.913756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.913869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.913900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.913995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.914101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.914128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.914252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.914395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.914424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.914551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.914687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.914719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.914848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.914942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.914972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.915074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.915169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.915196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.915357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.915473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.915503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.915716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.915880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.915907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.916035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.916134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.916165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.916286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.916403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.916429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.916564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.916713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.916743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.916833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.916979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.917007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.917135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.917232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.917261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.917362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.917487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.692 [2024-11-16 17:50:17.917517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.692 qpair failed and we were unable to recover it. 00:30:40.692 [2024-11-16 17:50:17.917662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.917784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.917811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.917907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.918062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.918090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.918195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.918296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.918327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.918453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.918583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.918611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.918718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.918833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.918859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.918988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.919085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.919112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.919215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.919339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.919366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.919504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.919636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.919665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.919762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.919889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.919916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.920038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.920132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.920160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.920312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.920410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.920437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.920534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.920634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.920663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.920781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.920869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.920897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.921029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.921123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.921153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.921286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.921424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.921453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.921583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.921689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.921717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.921836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.921952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.921979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.922124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.922250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.922282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.922432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.922556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.922583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.922737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.922829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.922856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.922980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.923103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.923132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.923252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.923382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.923409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.923504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.923643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.923671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.923777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.923871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.923900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.924039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.924146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.924173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.924293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.924409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.924437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.924567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.924684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.924711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.924861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.924966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.924995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.693 qpair failed and we were unable to recover it. 00:30:40.693 [2024-11-16 17:50:17.925089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.925232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.693 [2024-11-16 17:50:17.925259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.925382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.925524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.925560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.925718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.925840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.925876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.925992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.926075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.926101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.926229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.926351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.926377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.926519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.926627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.926654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.926746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.926845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.926876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.926997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.927119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.927157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.927260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.927383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.927410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.927507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.927631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.927659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.927784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.927939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.927968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.928058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.928182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.928212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.928313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.928464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.928498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.928649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.928739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.928765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.928892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.929005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.929035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.929133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.929230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.929265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.929487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.929612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.929669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.929816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.929911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.929939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.930058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.930170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.930196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.930328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.930420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.930451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.930626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.930744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.930771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.930891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.931035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.931068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.931176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.931297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.931329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.931455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.931549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.931575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.931675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.931795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.931826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.694 qpair failed and we were unable to recover it. 00:30:40.694 [2024-11-16 17:50:17.931986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.932099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.694 [2024-11-16 17:50:17.932125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.932223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.932371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.932398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.932518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.932661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.932689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.932785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.932898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.932925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.933029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.933149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.933176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.933271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.933378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.933404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.933525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.933648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.933677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.933767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.933855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.933890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.934017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.934131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.934161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.934256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.934351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.934377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.934523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.934638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.934666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.934786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.934904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.934943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.935044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.935164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.935191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.935310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.935452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.935480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.935568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.935669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.935700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.935819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.935913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.935946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.936077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.936170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.936200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.936307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.936401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.936428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.936556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.936683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.936713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.936817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.936936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.936966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.937070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.937189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.937218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.937334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.937460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.937489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.937633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.937733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.937764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.937861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.937966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.937999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.938121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.938238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.938268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.938365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.938473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.938500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.938634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.938758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.938785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.938925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.939051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.939085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.939188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.939329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.695 [2024-11-16 17:50:17.939355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.695 qpair failed and we were unable to recover it. 00:30:40.695 [2024-11-16 17:50:17.939458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.939557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.939587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.939689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.939835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.939865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.939961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.940103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.940130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.940227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.940338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.940368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.940500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.940607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.940645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.940744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.940896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.940929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.941052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.941136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.941166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.941266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.941389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.941416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.941515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.941684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.941716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.941845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.941995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.942022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.942109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.942225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.942251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.942406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.942500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.942530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.942639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.942755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.942785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.942875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.942972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.943002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.943121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.943269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.943296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.943397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.943531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.943563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.943651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.943773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.943800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.943920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.944038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.944066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.944166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.944313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.944340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.944440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.944533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.944561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.944717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.944809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.944837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.944957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.945082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.945109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.945234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.945329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.945359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.945489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.945632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.945660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.945780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.945872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.945900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.946018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.946120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.946146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.946237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.946326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.946354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.946454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.946568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.946594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.696 qpair failed and we were unable to recover it. 00:30:40.696 [2024-11-16 17:50:17.946716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.946811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.696 [2024-11-16 17:50:17.946841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.946940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.947055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.947089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.947218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.947328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.947355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.947481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.947573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.947605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.947727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.947842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.947869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.947999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.948118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.948151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.948275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.948395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.948426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.948526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.948673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.948706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.948795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.948922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.948953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.949054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.949190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.949222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.949373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.949494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.949522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.949665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.949763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.949795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.949893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.949989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.950018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.950136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.950262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.950289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.950418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.950537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.950563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.950670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.950769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.950797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.950892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.950972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.951005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.951157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.951254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.951282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.951405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.951518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.951554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.951670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.951787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.951817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.951927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.952037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.952066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.952179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.952332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.952364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.952475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.952568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.952594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.952711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.952810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.952841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.952941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.953061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.953092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.953194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.953284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.953311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.953421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.953526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.953557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.953695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.953830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.953859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.697 [2024-11-16 17:50:17.953992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.954091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.697 [2024-11-16 17:50:17.954121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.697 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.954248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.954348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.954375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.954473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.954597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.954658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.954765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.954882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.954913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.955015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.955110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.955139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.955227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.955350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.955384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.955502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.955636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.955667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.955791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.955935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.955961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.956081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.956174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.956206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.956326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.956417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.956445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.956531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.956679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.956711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.956857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.956949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.956979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.957077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.957195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.957226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.957336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.957468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.957496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.957623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.957722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.957751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.957851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.957980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.958009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.958158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.958290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.958319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.958407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.958523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.958551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.958650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.958745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.958772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.958899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.959022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.959050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.959146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.959234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.959267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.959359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.959484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.959511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.959632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.959752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.959782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.959902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.960001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.960028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.698 qpair failed and we were unable to recover it. 00:30:40.698 [2024-11-16 17:50:17.960165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.960280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.698 [2024-11-16 17:50:17.960308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.960436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.960567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.960599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.960757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.960842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.960873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.961003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.961117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.961144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.961247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.961369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.961396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.961524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.961629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.961659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.961760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.961872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.961902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.962006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.962168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.962197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.962318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.962401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.962431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.962528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.962646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.962675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.962837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.962970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.962998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.963120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.963240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.963267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.963359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.963471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.963498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.963592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.963707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.963734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.963834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.963926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.963952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.964094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.964183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.964218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.964371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.964507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.964535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.964657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.964801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.964828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.964952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.965077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.965106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.965262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.965389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.965420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.965565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.965709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.965739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.965869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.965990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.966020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.966146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.966294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.966323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.966419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.966504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.966534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.966659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.966778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.966806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.966894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.967015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.967045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.967146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.967259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.967289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.967402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.967520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.967549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.699 qpair failed and we were unable to recover it. 00:30:40.699 [2024-11-16 17:50:17.967653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.967761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.699 [2024-11-16 17:50:17.967793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.967893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.967978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.968025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.968145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.968275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.968302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.968418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.968545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.968573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.968682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.968789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.968817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.968936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.969080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.969107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.969231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.969352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.969383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.969529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.969652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.969679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.969801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.969886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.969915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.970025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.970127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.970157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.970290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.970384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.970416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.970551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.970654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.970688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.970807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.970896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.970934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.971035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.971129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.971158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.971300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.971451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.971481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.971576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.971695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.971722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.971830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.971945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.971971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.972093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.972214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.972241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.972403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.972548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.972578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.972685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.972804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.972834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.972966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.973071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.973101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.700 [2024-11-16 17:50:17.973190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.973311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.700 [2024-11-16 17:50:17.973345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.700 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.973515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.973676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.973705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.973845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.973936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.973968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.974073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.974168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.974199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.974317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.974399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.974430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.974519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.974625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.974657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.974750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.974837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.974869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.975000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.975154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.975185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.975276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.975363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.975390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.975538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.975658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.975687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.975788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.975912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.975952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.976104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.976223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.976250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.976376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.976491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.976518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.976637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.976739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.976769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.976903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.976986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.977017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.977143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.977236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.977269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.977388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.977511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.977542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.977663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.977780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.977812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.977939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.978091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.978124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.978250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.978363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.978390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.978517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.978654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.978685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.978795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.978943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.701 [2024-11-16 17:50:17.978973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.701 qpair failed and we were unable to recover it. 00:30:40.701 [2024-11-16 17:50:17.979063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.979149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.979177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.979313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.979410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.979438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.979562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.979666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.979696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.979785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.979899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.979940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.980051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.980169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.980196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.980319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.980437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.980468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.980590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.980729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.980761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.980879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.980996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.981025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.981152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.981266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.981297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.981391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.981536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.981570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.981707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.981795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.981822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.981967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.982052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.982080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.982208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.982308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.982338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.982457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.982546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.982576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.982689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.982808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.982839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.982958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.983079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.983107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.983242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.983326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.983357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.983483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.983572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.983598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.983695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.983784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.983815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.983941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.984073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.984100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.984197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.984319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.702 [2024-11-16 17:50:17.984346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.702 qpair failed and we were unable to recover it. 00:30:40.702 [2024-11-16 17:50:17.984429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.984526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.984555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.984664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.984757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.984784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.984933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.985079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.985106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.985202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.985298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.985328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.985443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.985592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.985632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.985761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.985855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.985885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.986040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.986161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.986192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.986284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.986416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.986447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.986548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.986668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.986697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.986820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.986950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.986981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.987106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.987219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.987249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.987351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.987450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.987476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.987609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.987718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.987750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.987842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.987991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.988020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.988119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.988232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.988259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.988378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.988513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.988545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.988673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.988784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.988814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.988941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.989082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.989109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.989243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.989371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.989398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.989523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.989644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.989672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.703 [2024-11-16 17:50:17.989776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.989871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.703 [2024-11-16 17:50:17.989899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.703 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.989994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.990080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.990110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.990199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.990299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.990329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.990449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.990558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.990585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.990697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.990786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.990814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.990907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.991055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.991083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.991234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.991351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.991379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.991473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.991570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.991597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.991709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.991826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.991853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.991980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.992095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.992125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.992257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.992396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.992422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.992540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.992687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.992715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.992864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.992964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.992992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.993123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.993245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.993274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.993367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.993487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.993516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.993613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.993714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.993745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.993838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.993959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.993990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.994114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.994235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.704 [2024-11-16 17:50:17.994265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.704 qpair failed and we were unable to recover it. 00:30:40.704 [2024-11-16 17:50:17.994422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.994543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.994572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.994706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.994807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.994833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.994948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.995069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.995100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.995191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.995299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.995326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.995415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.995525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.995553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.995667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.995765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.995795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.995893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.996025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.996054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.996153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.996301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.996332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.996449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.996562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.996592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.996697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.996838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.996864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.996972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.997055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.997085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.997202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.997318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.997344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.997470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.997585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.997611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.997736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.997848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.997875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.997980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.998101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.998131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.998282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.998402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.998429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.998528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.998674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.998706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.998836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.998959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.998989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.999115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.999231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.999260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.999381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.999501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.999528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.999637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.999731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.705 [2024-11-16 17:50:17.999761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.705 qpair failed and we were unable to recover it. 00:30:40.705 [2024-11-16 17:50:17.999870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:17.999995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.000112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.000381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.000596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.000859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.000989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.001112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.001259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.001286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.001403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.001517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.001544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.001704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.001826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.001854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.001955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.002074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.002103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.002206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.002306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.002333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.002452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.002545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.002574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.002704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.002831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.002861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.002968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.003058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.003086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.003186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.003312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.003343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.003477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.003572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.003602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.003708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.003825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.003856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.004019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.004143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.004176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.004271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.004390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.004420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.004539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.004678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.004707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.004829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.004991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.005019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.005145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.005263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.706 [2024-11-16 17:50:18.005293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.706 qpair failed and we were unable to recover it. 00:30:40.706 [2024-11-16 17:50:18.005414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.005531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.005561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.005686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.005787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.005814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.005892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.005976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.006119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.006335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.006591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.006878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.006983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.007107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.007233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.007261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.007386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.007507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.007535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.007679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.007767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.007795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.007888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.008020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.008047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.008171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.008290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.008316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.008446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.008543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.008571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.008678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.008799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.008826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.008953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.009074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.009101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.009195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.009339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.009367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.009463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.009581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.009606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.009775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.009897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.009927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.010039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.010159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.010195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.010300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.010395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.010423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.707 [2024-11-16 17:50:18.010526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.010631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.707 [2024-11-16 17:50:18.010667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.707 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.010763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.010881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.010914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.011035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.011177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.011207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.011327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.011418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.011446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.011544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.011673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.011704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.011798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.011895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.011925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.012012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.012134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.012163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.012288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.012385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.012412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.012533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.012650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.012686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.012806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.012903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.012934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.013057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.013205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.013233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.013391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.013511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.013538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.013676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.013790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.013818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.013909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.014028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.014057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.014176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.014295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.014324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.014437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.014517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.014547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.014657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.014766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.014798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.014912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.015010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.015039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.015159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.015257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.015293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.015419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.015539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.015567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.015698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.015790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.015820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.708 [2024-11-16 17:50:18.015930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.016025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.708 [2024-11-16 17:50:18.016059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.708 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.016156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.016272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.016301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.016449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.016566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.016596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.016700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.016814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.016844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.016937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.017075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.017101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.017192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.017334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.017362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.017486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.017577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.017609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.017726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.017844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.017881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.017976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.018121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.018151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.018271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.018389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.018417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.018510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.018601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.018659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.018769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.018876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.018903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.018999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.019122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.019153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.019305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.019420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.019447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.019599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.019729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.019758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.019876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.019997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.020028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.020147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.020285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.020319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.020467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.020645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.020673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.020800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.020926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.020956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.021069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.021210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.021235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.021374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.021486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.021512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.021646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.021785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.021810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.709 [2024-11-16 17:50:18.021897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.021986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.709 [2024-11-16 17:50:18.022011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.709 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.022118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.022227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.022253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.022366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.022448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.022473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.022624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.022716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.022741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.022820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.022927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.022953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.023063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.023149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.023175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.023277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.023385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.023411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.023528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.023645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.023672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.023814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.023902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.023928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.024050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.024188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.024214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.024295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.024383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.024410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.024500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.024642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.024668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.024785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.024875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.024901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.025010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.025094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.025119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.025231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.025335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.025361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.025464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.025604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.025638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.025732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.025815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.025840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.025933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.026019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.026044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.026129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.026236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.026262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.710 qpair failed and we were unable to recover it. 00:30:40.710 [2024-11-16 17:50:18.026347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.026486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.710 [2024-11-16 17:50:18.026512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.026643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.026727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.026753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.026847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.026940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.026966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.027063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.027181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.027206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.027295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.027408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.027433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.027520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.027634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.027661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.027773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.027915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.027941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.028063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.028170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.028195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.028300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.028442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.028468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.028549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.028666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.028693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.028836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.028920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.028946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.029091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.029184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.029209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.029360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.029512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.029540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.029693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.029807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.029833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.029962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.030050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.030075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.030194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.030280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.030305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.030417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.030531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.030556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.030705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.030849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.030874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.030999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.031111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.031136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.031280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.031352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.031377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.711 qpair failed and we were unable to recover it. 00:30:40.711 [2024-11-16 17:50:18.031498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.711 [2024-11-16 17:50:18.031642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.031669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.031785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.031874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.031899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.032016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.032101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.032127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.032209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.032317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.032342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.032483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.032597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.032631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.032759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.032845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.032870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.032974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.033084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.033109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.033231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.033322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.033347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.033459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.033572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.033597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.033717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.033804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.033829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.033946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.034232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.034422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.034640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.034840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.034950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.035042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.035121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.035146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.035256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.035368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.035394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.035519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.035600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.035636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.035753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.035893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.035919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.036000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.036106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.036132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.712 [2024-11-16 17:50:18.036247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.036399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.712 [2024-11-16 17:50:18.036424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.712 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.036545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.036639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.036672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.036769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.036853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.036880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.037000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.037111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.037136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.037220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.037325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.037350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.037464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.037612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.037646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.037729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.037839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.037865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.037961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.038105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.038131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.038218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.038305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.038332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.038472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.038552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.038577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.038733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.038876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.038901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.038995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.039080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.039105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.039212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.039326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.039353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.039459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.039543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.039568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.039657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.039770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.039796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.039888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.040111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.040370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.040632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.040828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.040979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.713 [2024-11-16 17:50:18.041117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.041235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.713 [2024-11-16 17:50:18.041261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.713 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.041353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.041496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.041522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.041613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.041757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.041782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.041894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.042009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.042034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.042173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.042318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.042343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.042434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.042552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.042578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.042720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.042835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.042860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.042981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.043208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.043451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.043653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.043888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.043997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.044166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.044391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.044625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.044857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.044996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.045119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.045232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.045258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.045377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.045493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.045519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.045650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.045795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.045820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.045942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.046174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.046353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.046585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.046828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.046994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.047136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.047275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.047300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.047395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.047505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.047530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.714 qpair failed and we were unable to recover it. 00:30:40.714 [2024-11-16 17:50:18.047640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.047731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.714 [2024-11-16 17:50:18.047756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.047871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.047963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.047993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.048106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.048221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.048246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.048353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.048437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.048463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.048601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.048722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.048748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.048869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.048977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.049002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.049116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.049227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.049253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.049368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.049493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.049519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.049602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.049725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.049751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.049859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.049986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.050011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.050123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.050232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.050257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.050346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.050428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.050458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.050573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.050745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.050776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.050929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.051027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.051058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.051179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.051278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.051305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.051447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.051571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.051603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.051744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.051852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.051881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.052009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.052134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.052161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.052308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.052450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.052481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.052595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.052697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.052725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.052846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.052995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.053152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.053354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.053604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.053853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.053972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.054095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.054214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.054242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.054396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.054518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.054549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.054668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.054821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.054850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.055007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.055131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.715 [2024-11-16 17:50:18.055162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.715 qpair failed and we were unable to recover it. 00:30:40.715 [2024-11-16 17:50:18.055278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.055397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.055426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.055553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.055653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.055686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.055841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.055959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.055993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.056089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.056208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.056237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.056361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.056448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.056474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.056596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.056725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.056754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.056886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.056969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.056996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.057106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.057198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.057230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.057355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.057449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.057477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.057605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.057708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.057738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.057838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.057957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.057987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.058100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.058191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.058220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.058318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.058405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.058432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.058591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.058758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.058789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.058915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.059016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.059047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.059166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.059314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.059343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.059474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.059585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.059622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.059748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.059839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.059869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.059964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.060082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.060112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.060212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.060303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.060330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.060424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.060541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.060571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.060736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.060831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.060862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.060965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.061115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.061141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.061254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.061345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.061376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.716 [2024-11-16 17:50:18.061497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.061625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.716 [2024-11-16 17:50:18.061652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.716 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.061755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.061866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.061895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.062013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.062100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.062128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.062224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.062339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.062365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.062483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.062659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.062692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.062835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.062976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.063008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.063100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.063193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.063222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.063312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.063412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.063446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.063568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.063704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.063732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.063844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.063993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.064020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.064154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.064246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.064276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.064398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.064514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.064545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.064646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.064742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.064769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.064918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.065047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.065075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.065211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.065332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.065363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.065488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.065627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.065655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.065778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.065892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.065922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.066016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.066159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.066188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.066319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.066409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.066441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.066593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.066722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.066749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.066863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.067121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.067390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.067610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.067832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.067973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.068091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.068187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.068215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.068358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.068457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.068487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.068622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.068719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.068749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.717 [2024-11-16 17:50:18.068868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.068993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.717 [2024-11-16 17:50:18.069022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.717 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.069146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.069236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.069265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.069360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.069475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.069505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.069633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.069724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.069754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.069858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.069969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.069997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.070113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.070234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.070265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.070363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.070474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.070501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.070629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.070752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.070781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.070902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.071003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.071035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.071158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.071270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.071301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.071419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.071536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.071562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.071662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.071768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.071795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.071900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.072132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.072363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.072575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.072823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.072942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.073036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.073155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.073182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.073269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.073357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.073387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.073505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.073599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.073635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.073758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.073877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.073903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.074047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.074150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.074184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.074325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.074499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.074529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.074665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.074769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.074800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.074917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.075017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.075049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.075182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.075301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.075331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.075466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.075578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.075607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.075716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.075865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.075891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.075979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.076122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.076150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.076255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.076352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.076379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.076474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.076593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.076627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.718 qpair failed and we were unable to recover it. 00:30:40.718 [2024-11-16 17:50:18.076761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.718 [2024-11-16 17:50:18.076855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.076886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.076989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.077080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.077111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.077279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.077418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.077447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.077603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.077717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.077743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.077850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.077967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.077996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.078095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.078213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.078241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.078414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.078508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.078551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.078696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.078813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.078840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.078957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.079119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.079147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.079299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.079420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.079448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.079553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.079701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.079728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.079817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.079936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.079962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.080079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.080193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.080218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.080301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.080436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.080463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.080598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.080688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.080715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.080833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.080946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.080971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.081113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.081224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.081250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.081338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.081476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.081502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.081624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.081767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.081793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.081884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.082027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.082052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.082141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.082310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.082338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.082494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.082664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.082691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.082803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.082924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.082949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.083064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.083179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.083204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.083346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.083475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.083503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.083672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.083786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.083813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.083906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.084042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.084068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.084211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.084296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.084322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.084409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.084524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.084550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.084665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.084774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.084801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.084918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.085010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.085036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.719 qpair failed and we were unable to recover it. 00:30:40.719 [2024-11-16 17:50:18.085140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.719 [2024-11-16 17:50:18.085252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.085279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.085373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.085484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.085510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.085604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.085725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.085750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.085866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.086008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.086033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.086181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.086271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.086297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.086439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.086553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.086579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.086706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.086796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.086822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.086923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.087038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.087063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.087178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.087292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.087317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.087405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.087525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.087551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.087666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.087806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.087831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.087948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.088172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.088429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.088689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.088912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.088995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.089021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.089135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.089287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.089313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.089454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.089570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.089595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.089745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.089829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.089855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.089967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.090051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.090081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.090196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.090314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.090339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.090419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.090555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.090580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.090695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.090779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.090807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.090928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.091048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.091074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.091209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.091324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.091349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.091464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.091542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.091567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.720 qpair failed and we were unable to recover it. 00:30:40.720 [2024-11-16 17:50:18.091657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.720 [2024-11-16 17:50:18.091772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.091799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.091944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.092056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.092082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.092164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.092278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.092303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.092401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.092540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.092569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.092684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.092768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.092793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.092909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.093026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.093053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.093193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.093332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.093358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.093441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.093579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.093605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.093693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.093807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.093832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.093949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.094062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.094087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.094200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.094341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.094366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.094481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.094566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.094593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.094716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.094807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.094832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.094936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.095076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.095108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.095225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.095315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.095341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.095482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.095591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.095623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.095745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.095862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.095887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.096034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.096112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.096138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.096254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.096376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.096401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.096519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.096656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.096682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.096797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.096916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.096941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.097023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.097133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.097159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.097245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.097361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.097386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.097480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.097574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.097604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.097726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.097842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.097867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.097951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.098063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.098089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.098232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.098375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.098400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.098519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.098639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.098666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.098793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.098940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.098965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.099078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.099166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.099192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.099309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.099399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.099424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.099538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.099650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.099677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.099754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.099866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.099892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.721 qpair failed and we were unable to recover it. 00:30:40.721 [2024-11-16 17:50:18.100017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.721 [2024-11-16 17:50:18.100128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.100154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.100277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.100413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.100438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.100547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.100635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.100660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.100777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.100889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.100914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.101007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.101094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.101120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.101238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.101380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.101406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.101520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.101627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.101653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.101766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.101883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.101908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.102024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.102163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.102188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.102306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.102384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.102409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.102523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.102605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.102648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.102800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.102916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.102941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.103050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.103165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.103190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.103304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.103410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.103435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.103512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.103629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.103655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.103737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.103876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.103901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.103989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.104129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.104154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.104230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.104307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.104332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.104423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.104538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.104564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.104678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.104791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.104818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.104927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.105040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.105065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.105150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.105266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.105292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.105411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.105521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.105548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.105667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.105806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.105832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.105920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.106140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.106366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.106561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.106776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.106885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.107027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.107109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.107136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.107291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.107378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.107405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.107528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.107670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.107696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.107814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.107928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.107954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.722 qpair failed and we were unable to recover it. 00:30:40.722 [2024-11-16 17:50:18.108093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.722 [2024-11-16 17:50:18.108205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.108231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.108344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.108427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.108454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.108541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.108657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.108683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.108827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.108948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.108973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.109087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.109175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.109200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.109283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.109396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.109422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.109570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.109710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.109736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.109845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.109922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.109947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.110073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.110214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.110239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.110358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.110467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.110492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.110580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.110675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.110701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.110842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.110969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.110994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.111137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.111216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.111243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.111356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.111475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.111500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.111639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.111752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.111777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.111858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.112000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.112025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.112143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.112290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.112315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.112428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.112535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.112560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.112708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.112796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.112823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.112973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.113168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.113393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.113609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.113864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.113979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.114147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.114426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.114627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.114878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.114980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.115077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.115188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.115213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.115303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.115424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.115450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.115569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.115683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.115709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.115827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.115931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.115956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.116095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.116231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.116256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.723 qpair failed and we were unable to recover it. 00:30:40.723 [2024-11-16 17:50:18.116345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.723 [2024-11-16 17:50:18.116425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.116450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.116563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.116705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.116731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.116856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.116998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.117023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.117166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.117279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.117304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.117426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.117568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.117593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.117744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.117872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.117900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.117996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.118136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.118162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.118284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.118361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.118386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.118526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.118625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.118653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.118750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.118862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.118894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.118982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.119123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.119148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.119265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.119351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.119377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.119465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.119577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.119602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.119685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.119803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.119827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.119967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.120048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.120074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.120195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.120311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.120336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.120419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.120509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.120534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.120648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.120736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.120760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.120901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.121155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.121367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.121608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.121808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.121947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.122028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.122144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.122168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.122277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.122360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.122385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.122493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.122574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.122608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.122735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.122849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.122874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.122967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.123059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.123084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.123193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.123307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.123334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.123455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.123590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.123614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.724 qpair failed and we were unable to recover it. 00:30:40.724 [2024-11-16 17:50:18.123715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.123796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.724 [2024-11-16 17:50:18.123820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.123941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.124047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.124071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.124177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.124288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.124313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.124425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.124535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.124559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.124675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.124766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.124791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.124874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.125013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.125038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.125180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.125321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.125345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.125471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.125562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.125588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.125716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.125803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.125829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.125916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.126148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.126371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.126642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.126872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.126977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.127051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.127166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.127192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.127268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.127409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.127433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.127549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.127654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.127680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.127785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.127869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.127894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.128011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.128089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.128114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.128236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.128358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.128382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.128471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.128586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.128611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.128757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.128871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.128896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.128976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.129113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.129138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.129223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.129335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.129360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.129452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.129560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.129585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.129708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.129799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.129824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.129968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.130084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.130109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.130196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.130309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.130333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.130416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.130537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.130561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.130701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.130816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.130841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.130964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.131079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.131104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.131189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.131331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.131355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.131445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.131554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.131579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.131670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.131810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.725 [2024-11-16 17:50:18.131835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.725 qpair failed and we were unable to recover it. 00:30:40.725 [2024-11-16 17:50:18.131924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.132145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.132386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.132600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.132828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.132937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.133055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.133168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.133192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.133337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.133458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.133482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.133596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.133695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.133721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.133811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.133951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.133976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.134092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.134233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.134258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.134400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.134519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.134544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.134634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.134747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.134772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.134883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.134961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.134990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.135104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.135213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.135238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.135348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.135461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.135485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.135563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.135648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.135674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.135787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.135902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.135927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.136005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.136082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.136107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.136215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.136327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.136352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.136494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.136608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.136639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.136724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.136831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.136855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.136995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.137133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.137157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.137302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.137444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.137468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.137626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.137755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.137779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.137891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.137974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.137998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.138109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.138223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.138248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.138387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.138474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.138500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.138607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.138720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.138746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.138840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.138952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.138977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.139061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.139150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.139174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.139258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.139341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.139366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.139486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.139628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.139654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.139766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.139873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.139898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.139977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.140067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.140093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.726 [2024-11-16 17:50:18.140208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.140320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.726 [2024-11-16 17:50:18.140345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.726 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.140458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.140563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.140587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.140712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.140863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.140888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.140981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.141120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.141144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.141262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.141402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.141427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.141506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.141612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.141663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.141764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.141872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.141897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.142011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.142112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.142137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.142228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.142380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.142405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.142547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.142639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.142665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.142754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.142849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.142873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.142989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.143129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.143154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.143292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.143431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.143456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.143543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.143658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.143684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.143767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.143880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.143905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.144015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.144206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.144452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.144666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.144891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.144999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.145142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.145225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.145249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.145362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.145452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.145477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.145623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.145712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.145737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.145875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.145957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.145982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.146093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.146197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.146222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.146329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.146471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.146496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.146611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.146747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.146771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.146853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.146962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.146986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.147100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.147185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.147210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.147323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.147402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.147427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:40.727 qpair failed and we were unable to recover it. 00:30:40.727 [2024-11-16 17:50:18.147518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.147632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.727 [2024-11-16 17:50:18.147658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.014 qpair failed and we were unable to recover it. 00:30:41.014 [2024-11-16 17:50:18.147765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.147879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.147903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.014 qpair failed and we were unable to recover it. 00:30:41.014 [2024-11-16 17:50:18.148018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.148133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.148160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.014 qpair failed and we were unable to recover it. 00:30:41.014 [2024-11-16 17:50:18.148283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.148399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.148424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.014 qpair failed and we were unable to recover it. 00:30:41.014 [2024-11-16 17:50:18.148536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.148686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.148711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.014 qpair failed and we were unable to recover it. 00:30:41.014 [2024-11-16 17:50:18.148823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.148899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.148923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.014 qpair failed and we were unable to recover it. 00:30:41.014 [2024-11-16 17:50:18.149040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.149123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.149147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.014 qpair failed and we were unable to recover it. 00:30:41.014 [2024-11-16 17:50:18.149262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.149384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.149408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.014 qpair failed and we were unable to recover it. 00:30:41.014 [2024-11-16 17:50:18.149488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.014 [2024-11-16 17:50:18.149600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.149638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.149731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.149835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.149860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.149959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.150097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.150122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.150234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.150373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.150398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.150487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.150642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.150668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.150777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.150861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.150886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.151024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.151146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.151171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.151284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.151361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.151385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.151499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.151609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.151643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.151755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.151895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.151920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.152030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.152119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.152143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.152223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.152334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.152358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.152454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.152539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.152564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.152688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.152771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.152795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.152906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.153154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.153395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.153626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.153868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.153982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.154121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.154256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.154281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.154391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.154503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.154527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.154613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.154757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.154782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.154858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.154978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.155003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.155119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.155203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.155228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.155343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.155447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.155471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.015 qpair failed and we were unable to recover it. 00:30:41.015 [2024-11-16 17:50:18.155579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.015 [2024-11-16 17:50:18.155699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.155724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.155810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.155948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.155972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.156067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.156153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.156178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.156263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.156374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.156399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.156540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.156647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.156673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.156760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.156851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.156876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.156987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.157179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.157406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.157597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.157824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.157963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.158051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.158162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.158187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.158294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.158408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.158433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.158547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.158693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.158719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.158834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.158918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.158944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.159060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.159199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.159224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.159303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.159383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.159409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.159557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.159679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.159705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.159853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.159964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.159989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.160075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.160189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.160213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.160296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.160403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.160427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.160545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.160686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.160711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.160798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.160880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.160905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.161018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.161104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.161129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.161271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.161380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.161404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.161524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.161637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.016 [2024-11-16 17:50:18.161662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.016 qpair failed and we were unable to recover it. 00:30:41.016 [2024-11-16 17:50:18.161768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.161852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.161877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.161993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.162099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.162123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.162203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.162341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.162366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.162451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.162592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.162622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.162779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.162855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.162880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.163019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.163104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.163129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.163222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.163308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.163332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.163451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.163529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.163553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.163689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.163840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.163865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.163955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.164154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.164367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.164589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.164816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.164919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.165038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.165153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.165178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.165325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.165443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.165468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.165587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.165684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.165719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.165833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.165974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.165999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.166118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.166225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.166250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.166372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.166448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.166473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.166583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.166731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.166756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.166837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.166913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.166938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.167050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.167131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.167161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.167273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.167345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.017 [2024-11-16 17:50:18.167370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.017 qpair failed and we were unable to recover it. 00:30:41.017 [2024-11-16 17:50:18.167509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.167630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.167658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.167776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.167888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.167912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.168053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.168159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.168184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.168297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.168384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.168409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.168524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.168606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.168649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.168765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.168875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.168900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.169013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.169124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.169148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.169290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.169398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.169423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.169537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.169649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.169678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.169797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.169888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.169912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.169994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.170106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.170130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.170243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.170360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.170385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.170472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.170582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.170607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.170756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.170867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.170892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.171003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.171087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.171112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.171199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.171309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.171334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.171455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.171562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.171586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.171717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.171793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.171818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.171928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.172073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.172098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.172225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.172367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.172391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.172470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.172612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.172644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.172759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.172872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.172897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.172974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.173111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.173136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.173230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.173370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.173394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.173505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.173593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.173625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.018 qpair failed and we were unable to recover it. 00:30:41.018 [2024-11-16 17:50:18.173748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.018 [2024-11-16 17:50:18.173835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.173861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.173948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.174166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.174358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.174622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.174819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.174928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.175045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.175153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.175179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.175289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.175368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.175392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.175483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.175628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.175656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.175745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.175858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.175882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.176002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.176112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.176138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.176253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.176362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.176387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.176467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.176585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.176609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.176711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.176801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.176826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.176943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.177226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.177444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.177647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.177893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.177980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.178004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.178146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.178263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.178288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.178362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.178475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.178500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.019 qpair failed and we were unable to recover it. 00:30:41.019 [2024-11-16 17:50:18.178613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.178724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.019 [2024-11-16 17:50:18.178748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.178830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.178921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.178946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.179031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.179141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.179166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.179248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.179360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.179389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.179473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.179584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.179609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.179738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.179829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.179855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.180003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.180115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.180140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.180282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.180429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.180454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.180544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.180684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.180710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.180792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.180872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.180897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.181013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.181129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.181154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.181260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.181340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.181365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.181459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.181540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.181564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.181710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.181803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.181828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.181948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.182172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.182366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.182587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.182830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.182948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.183042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.183188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.183213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.183328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.183431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.183456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.183546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.183694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.183720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.020 qpair failed and we were unable to recover it. 00:30:41.020 [2024-11-16 17:50:18.183811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.020 [2024-11-16 17:50:18.183919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.183944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.184053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.184159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.184184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.184280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.184385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.184409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.184525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.184640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.184665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.184784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.184919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.184944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.185086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.185166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.185191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.185301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.185436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.185461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.185547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.185633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.185658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.185776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.185857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.185883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.185964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.186178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.186437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.186667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.186861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.186996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.187071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.187151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.187176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.187260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.187348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.187373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.187514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.187601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.187637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.187754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.187864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.187889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.188029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.188122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.188146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.188262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.188369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.188394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.188542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.188651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.188676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.021 qpair failed and we were unable to recover it. 00:30:41.021 [2024-11-16 17:50:18.188789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.188936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.021 [2024-11-16 17:50:18.188961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.189046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.189189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.189214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.189295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.189402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.189427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.189533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.189645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.189671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.189798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.189939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.189964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.190103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.190245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.190270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.190355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.190466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.190491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.190599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.190694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.190719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.190830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.190942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.190967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.191075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.191159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.191185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.191264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.191371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.191396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.191537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.191652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.191683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.191777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.191859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.191884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.191999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.192114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.192139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.192255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.192394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.192418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.192505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.192647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.192672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.192759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.192873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.192898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.193044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.193178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.193202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.193284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.193371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.193397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.193480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.193570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.193595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.193718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.193829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.193853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.193999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.194076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.194101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.022 [2024-11-16 17:50:18.194196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.194337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.022 [2024-11-16 17:50:18.194362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.022 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.194476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.194565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.194590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.194685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.194773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.194798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.194937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.195137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.195359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.195608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.195853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.195963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.196084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.196203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.196228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.196340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.196449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.196473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.196570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.196689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.196715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.196829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.196912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.196937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.197019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.197136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.197161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.197243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.197334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.197358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.197478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.197593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.197626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.197736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.197843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.197868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.198010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.198148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.198173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.198319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.198433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.198459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.198601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.198697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.198722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.198814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.198931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.198956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.199074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.199157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.199182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.199322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.199463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.023 [2024-11-16 17:50:18.199488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.023 qpair failed and we were unable to recover it. 00:30:41.023 [2024-11-16 17:50:18.199581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.199696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.199722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.199869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.199960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.199984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.200127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.200270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.200295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.200379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.200461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.200486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.200645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.200758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.200783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.200893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.200977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.201116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.201375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.201627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.201826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.201925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.202042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.202120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.202145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.202258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.202339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.202363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.202480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.202592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.202623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.202704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.202814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.202839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.202950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.203126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.203340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.203551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.203776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.203944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.204052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.204160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.204185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.204303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.204388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.204413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.204489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.204601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.204633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.204787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.204896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.204920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.024 [2024-11-16 17:50:18.205029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.205170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.024 [2024-11-16 17:50:18.205195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.024 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.205275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.205388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.205412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.205521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.205597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.205628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.205727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.205804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.205829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.205949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.206132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.206394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.206612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.206884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.206987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.207131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.207246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.207270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.207380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.207467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.207491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.207574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.207680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.207707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.207824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.207947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.207972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.208084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.208159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.208183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.208295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.208403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.208427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.208571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.208682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.208708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.208818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.208934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.208958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.209051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.209158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.209183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.209290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.209389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.209414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.209526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.209634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.209660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.209769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.209871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.209895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.025 qpair failed and we were unable to recover it. 00:30:41.025 [2024-11-16 17:50:18.209988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.025 [2024-11-16 17:50:18.210123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.210147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.210284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.210402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.210427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.210536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.210649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.210676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.210757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.210849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.210873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.210980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.211091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.211116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.211232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.211345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.211370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.211489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.211603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.211634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.211726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.211828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.211853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.211945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.212161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.212371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.212588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.212812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.212919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.213025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.213102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.213128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.213273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.213384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.213410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.213493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.213596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.213633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.213748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.213827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.213853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.213964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.214076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.214102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.214215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.214322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.214347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.214444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.214552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.214577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.214695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.214779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.214804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.214952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.215069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.215093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.215177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.215314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.215338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.215489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.215602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.215641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.215763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.215858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.026 [2024-11-16 17:50:18.215882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.026 qpair failed and we were unable to recover it. 00:30:41.026 [2024-11-16 17:50:18.215975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.216111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.216135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.216222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.216329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.216353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.216464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.216578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.216603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.216753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.216892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.216916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.217021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.217211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.217432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.217662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.217876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.217982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.218124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.218314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.218624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.218844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.218961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.219113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.219248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.219273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.219359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.219445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.219470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.219576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.219660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.219685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.219762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.219874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.219899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.220017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.220127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.220152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.220269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.220381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.220406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.220489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.220601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.220633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.220723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.220804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.220828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.220982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.221067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.221093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.221177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.221287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.221312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.221423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.221511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.221536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.221659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.221759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.027 [2024-11-16 17:50:18.221784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.027 qpair failed and we were unable to recover it. 00:30:41.027 [2024-11-16 17:50:18.221869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.221964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.221989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.222073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.222184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.222209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.222287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.222373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.222397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.222514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.222632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.222662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.222774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.222892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.222916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.223041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.223120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.223144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.223227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.223319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.223344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.223428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.223549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.223574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.223688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.223774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.223799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.223919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.224034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.224059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.224197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.224279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.224304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.224445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.224578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.224603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.224691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.224806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.224832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.224926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.225174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.225404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.225610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.225821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.225924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.226028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.226142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.226167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.226305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.226409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.226433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.226553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.226695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.226723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.226807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.226920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.226944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.227065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.227174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.227198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.227319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.227457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.227481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.227570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.227678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.227703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.227819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.227898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.227923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.028 qpair failed and we were unable to recover it. 00:30:41.028 [2024-11-16 17:50:18.228008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.028 [2024-11-16 17:50:18.228122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.228147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.228232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.228347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.228373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.228463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.228549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.228574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.228693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.228810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.228835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.228912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.229053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.229077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.229221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.229336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.229361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.229480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.229565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.229590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.229711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.229823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.229849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.229968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.230054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.230079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.230198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.230309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.230334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.230427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.230538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.230563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.230659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.230780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.230805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.230919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.231146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.231370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.231588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.231874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.231989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.232126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.232198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.232223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.232303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.232422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.232447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.232558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.232671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.232696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.232837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.232926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.232951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.233035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.233131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.233156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.233274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.233379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.233403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.233495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.233578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.233604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.029 qpair failed and we were unable to recover it. 00:30:41.029 [2024-11-16 17:50:18.233696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.029 [2024-11-16 17:50:18.233805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.233829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.233971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.234167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.234413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.234634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.234920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.234999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.235168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.235397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.235627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.235826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.235994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.236078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.236190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.236215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.236330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.236434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.236458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.236549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.236667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.236692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.236805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.236881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.236906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.237052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.237173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.237198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.237334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.237449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.237475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.237564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.237681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.237707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.237787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.237866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.237895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.237982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.238094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.238119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.238241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.238347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.238371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.238509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.238631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.238658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.238780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.238893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.238918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.239037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.239126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.239150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.239266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.239349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.030 [2024-11-16 17:50:18.239373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.030 qpair failed and we were unable to recover it. 00:30:41.030 [2024-11-16 17:50:18.239517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.239652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.239678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.239824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.239965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.239989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.240131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.240210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.240235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.240351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.240475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.240499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.240621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.240764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.240789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.240901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.241151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.241395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.241586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.241852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.241984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.242097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.242314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.242564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.242756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.242898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.242985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.243097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.243121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.243229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.243336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.243360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.243470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.243582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.243608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.243699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.243810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.243835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.243914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.244029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.244054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.244161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.244247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.244273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.031 qpair failed and we were unable to recover it. 00:30:41.031 [2024-11-16 17:50:18.244410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.244549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.031 [2024-11-16 17:50:18.244574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.244691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.244777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.244802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.244894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.244980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.245142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.245350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.245569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.245837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.245974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.246063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.246150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.246175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.246254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.246372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.246397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.246475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.246580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.246604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.246739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.246849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.246874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.246964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.247050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.247074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.247182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.247299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.247324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.247414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.247501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.247526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.247664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.247780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.247810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.247923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.248168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.248419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.248645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.248875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.248980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.249095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.249203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.249229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.249343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.249453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.249479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.249591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.249737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.249762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.249878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.249989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.250014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.250109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.250257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.250281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.250397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.250514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.250539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.250654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.250796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.032 [2024-11-16 17:50:18.250821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.032 qpair failed and we were unable to recover it. 00:30:41.032 [2024-11-16 17:50:18.250938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.251017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.251043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.251182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.251293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.251318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.251433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.251547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.251572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.251712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.251795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.251821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.251940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.252164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.252382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.252641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.252892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.252984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.253128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.253369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.253592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.253819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.253924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.254000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.254248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.254498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.254705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.254888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.254990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.255093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.255233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.255258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.255398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.255512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.255537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.255654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.255762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.255787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.255898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.256013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.256038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.256154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.256258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.256283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.256408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.256544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.256569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.033 qpair failed and we were unable to recover it. 00:30:41.033 [2024-11-16 17:50:18.256714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.033 [2024-11-16 17:50:18.256821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.256845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.256933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.257067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.257091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.257231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.257308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.257332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.257444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.257547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.257572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.257667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.257754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.257779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.257888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.258129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.258306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.258556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.258773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.258883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.258965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.259069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.259094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.259186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.259331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.259356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.259464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.259570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.259595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.259731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.259821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.259845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.259983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.260210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.260496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.260718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.260919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.260997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.261112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.261298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.261526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.261753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.261850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.034 qpair failed and we were unable to recover it. 00:30:41.034 [2024-11-16 17:50:18.261965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.034 [2024-11-16 17:50:18.262081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.262106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.262187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.262335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.262360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.262479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.262558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.262583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.262725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.262839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.262864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.262949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.263175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.263375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.263583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.263847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.263995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.264019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.264133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.264223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.264248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.264323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.264459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.264484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.264603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.264730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.264755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.264908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.264997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.265133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.265357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.265579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.265833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.265997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.266116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.266255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.266280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.266361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.266465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.266489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.266570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.266683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.266710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.266835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.266938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.266962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.267050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.267158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.267183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.267263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.267384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.267409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.267515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.267653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.267679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.035 [2024-11-16 17:50:18.267788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.267923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.035 [2024-11-16 17:50:18.267948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.035 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.268065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.268152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.268177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.268288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.268398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.268422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.268548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.268686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.268711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.268788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.268903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.268928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.269005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.269222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.269418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.269611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.269865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.269996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.270076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.270149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.270174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.270313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.270393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.270418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.270506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.270657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.270683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.270800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.270912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.270937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.271011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.271127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.271152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.271268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.271359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.271384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.271499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.271576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.271600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.271702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.271817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.271841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.271946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.272030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.272059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.272173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.272258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.272284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.272367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.272472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.036 [2024-11-16 17:50:18.272497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.036 qpair failed and we were unable to recover it. 00:30:41.036 [2024-11-16 17:50:18.272614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.272711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.272735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.272849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.272955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.272980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.273100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.273173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.273198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.273288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.273425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.273449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.273527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.273639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.273665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.273779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.273871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.273896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.274004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.274118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.274143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.274290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.274403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.274428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.274516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.274629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.274658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.274767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.274880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.274905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.275020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.275131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.275156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.275268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.275385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.275410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.275520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.275610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.275662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.275755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.275833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.275857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.275978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.276055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.276080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.276197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.276335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.276360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.276453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.276570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.276595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.276687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.276804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.276829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.276913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.277133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.277391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.277621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.277871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.277967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.278057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.278195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.278220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.278297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.278382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.037 [2024-11-16 17:50:18.278407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.037 qpair failed and we were unable to recover it. 00:30:41.037 [2024-11-16 17:50:18.278523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.278596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.278631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.278727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.278814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.278838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.278929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.279116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.279355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.279602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.279804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.279983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.280072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.280174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.280198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.280286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.280395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.280420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.280533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.280661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.280688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.280796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.280906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.280931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.281057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.281138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.281163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.281245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.281387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.281412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.281557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.281673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.281703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.281823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.281910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.281936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.282063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.282138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.282163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.282254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.282332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.282357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.282466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.282553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.282577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.282684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.282798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.282824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.282905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.283015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.283039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.283149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.283262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.283287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.038 qpair failed and we were unable to recover it. 00:30:41.038 [2024-11-16 17:50:18.283398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.283514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.038 [2024-11-16 17:50:18.283538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.283640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.283719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.283744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.283830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.283966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.283991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.284085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.284202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.284226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.284306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.284395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.284419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.284514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.284627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.284653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.284765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.284854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.284878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.284994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.285130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.285155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.285238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.285322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.285347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.285500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.285611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.285643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.285763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.285872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.285896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.286009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.286088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.286112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.286253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.286363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.286389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.286510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.286624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.286657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.286772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.286885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.286911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.287052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.287130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.287155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.287268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.287374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.287399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.287488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.287603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.287636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.287719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.287868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.287893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.288031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.288144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.288169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.288309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.288423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.288448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.288565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.288671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.039 [2024-11-16 17:50:18.288696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.039 qpair failed and we were unable to recover it. 00:30:41.039 [2024-11-16 17:50:18.288781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.288858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.288882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.288983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.289102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.289127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.289267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.289357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.289382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.289495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.289611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.289641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.289753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.289832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.289856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.289937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.290087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.290112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.290192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.290298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.290323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.290440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.290528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.290553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.290672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.290763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.290788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.290898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.291145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.291389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.291662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.291869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.291982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.292095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.292229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.292254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.292367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.292482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.292508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.292596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.292681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.292706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.292845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.292929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.292954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.293061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.293139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.293163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.293242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.293348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.293373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.293453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.293545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.293570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.293699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.293807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.293836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.293946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.294026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.294051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.040 [2024-11-16 17:50:18.294136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.294218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.040 [2024-11-16 17:50:18.294242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.040 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.294379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.294469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.294494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.294581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.294681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.294707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.294826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.294935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.294960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.295104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.295213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.295238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.295322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.295393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.295418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.295506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.295593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.295631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.295747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.295857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.295882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.295966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.296069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.296094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.296195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.296334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.296358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.296448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.296552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.296576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.296702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.296792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.296818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.296936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.297130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.297324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.297554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.297811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.297977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.298063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.298200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.298225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.298350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.298460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.298485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.298628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.298771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.298796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.298940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.299060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.299084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.299200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.299316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.299340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.299483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.299644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.299669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.299755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.299865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.041 [2024-11-16 17:50:18.299889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.041 qpair failed and we were unable to recover it. 00:30:41.041 [2024-11-16 17:50:18.300003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.300148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.300173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.300291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.300438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.300463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.300545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.300668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.300693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.300780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.300915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.300940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.301056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.301140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.301165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.301280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.301359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.301384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.301498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.301603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.301635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.301748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.301863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.301888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.301979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.302196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.302413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.302642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.302871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.302984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.303095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.303320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.303572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.303806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.303920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.304028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.304121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.042 [2024-11-16 17:50:18.304145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.042 qpair failed and we were unable to recover it. 00:30:41.042 [2024-11-16 17:50:18.304223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.304299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.304324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.304415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.304528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.304553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.304645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.304750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.304775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.304853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.304930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.304955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.305038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.305153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.305178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.305291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.305375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.305400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.305485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.305588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.305612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.305733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.305847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.305878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.305981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.306092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.306117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.306200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.306306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.306330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.306445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.306560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.306585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.306681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.306792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.306817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.306937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.307052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.307076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.307157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.307277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.307302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.307417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.307551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.307576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.307735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.307819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.307844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.307982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.308090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.308115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.308228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.308344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.308368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.308497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.308629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.308655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.308745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.308830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.308855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.308938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.309154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.309344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.309561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.309784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.309890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.309996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.310077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.310102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.043 qpair failed and we were unable to recover it. 00:30:41.043 [2024-11-16 17:50:18.310245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.043 [2024-11-16 17:50:18.310354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.310379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.310495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.310568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.310593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.310698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.310810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.310835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.310918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.311147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.311404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.311647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.311862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.311976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.312089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.312284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.312516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.312719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.312857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.312953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.313165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.313376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.313607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.313837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.313986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.314124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.314316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.314545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.314778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.314889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.314972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.315060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.315085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.315224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.315339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.315368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.044 qpair failed and we were unable to recover it. 00:30:41.044 [2024-11-16 17:50:18.315480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.044 [2024-11-16 17:50:18.315590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.315635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.315794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.315875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.315900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.316016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.316126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.316151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.316257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.316338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.316362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.316470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.316597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.316628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.316773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.316856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.316880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.316971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.317164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.317413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.317635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.317827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.317940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.318061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.318273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.318494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.318702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.318896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.318974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.319099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.319334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.319564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.319762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.319892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.319980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.320097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.320122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.320216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.320362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.320387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.320506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.320586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.320610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.320709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.320815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.320840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.320926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.321038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.321063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.045 qpair failed and we were unable to recover it. 00:30:41.045 [2024-11-16 17:50:18.321201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.321312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.045 [2024-11-16 17:50:18.321337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.321454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.321528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.321552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.321640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.321779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.321804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.321895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.321978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.322085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.322371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.322591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.322795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.322937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.323051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.323158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.323182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.323296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.323407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.323432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.323518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.323641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.323667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.323748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.323861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.323885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.323995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.324184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.324378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.324613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.324812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.324974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.325057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.325154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.325178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.325263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.325377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.325402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.325489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.325601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.325632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.325725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.325814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.325839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.325925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.326156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.326379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.326628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.326848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.326997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.327088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.327223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.327248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.046 [2024-11-16 17:50:18.327356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.327470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.046 [2024-11-16 17:50:18.327495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.046 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.327578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.327722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.327748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.327833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.327920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.327946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.328029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.328109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.328134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.328214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.328300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.328325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.328447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.328576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.328604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.328753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.328837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.328862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.328941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.329029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.329053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.329170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.329282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.329307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.329435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.329545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.329570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.329675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.329781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.329806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.329920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.330129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.330348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.330587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.330826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.330932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.331025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.331139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.331164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.331257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.331364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.331388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.331494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.331571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.331596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.331732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.331815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.047 [2024-11-16 17:50:18.331841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.047 qpair failed and we were unable to recover it. 00:30:41.047 [2024-11-16 17:50:18.331932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.332133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.332353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.332536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.332794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.332903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.332993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.333079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.333104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.333217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.333324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.333349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.333435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.333545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.333571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.333696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.333837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.333862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.333957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.334215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.334440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.334658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.334850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.334963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.335075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.335224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.335249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.335331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.335413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.335438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.335551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.335637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.335663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.335781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.335872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.335897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.336009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.336225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.336460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.336672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.336856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.336962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.337061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.337141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.337165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.048 qpair failed and we were unable to recover it. 00:30:41.048 [2024-11-16 17:50:18.337279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.048 [2024-11-16 17:50:18.337383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.337408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.337525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.337640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.337666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.337750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.337862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.337886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.337983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.338193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.338435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.338639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.338855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.338958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.339066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.339163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.339189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.339316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.339427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.339454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.339547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.339656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.339682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.339760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.339877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.339902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.339983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.340271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.340460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.340668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.340875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.340984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.341074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.341162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.341186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.341301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.341409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.341433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.341549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.341653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.341678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.341763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.341851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.341876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.341982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.342066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.342091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.342209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.342296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.342320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.342430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.342517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.342541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.049 qpair failed and we were unable to recover it. 00:30:41.049 [2024-11-16 17:50:18.342626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.342719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.049 [2024-11-16 17:50:18.342744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.342881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.342958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.342982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.343100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.343207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.343231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.343307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.343388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.343412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.343524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.343665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.343691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.343770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.343889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.343914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.344002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.344221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.344445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.344698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.344922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.344999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.345106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.345322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.345539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.345735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.345850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.345961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.346159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.346379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.346607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.346894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.346979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.347090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.347295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.347509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.347707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.347886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.347976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.348063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.348088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.050 [2024-11-16 17:50:18.348178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.348318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.050 [2024-11-16 17:50:18.348343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.050 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.348458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.348545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.348569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.348653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.348747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.348772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.348864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.348974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.348998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.349109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.349192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.349216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.349304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.349409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.349434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.349524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.349642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.349667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.349754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.349836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.349861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.349978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.350193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.350390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.350573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.350777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.350895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.350978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.351193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.351423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.351646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.351872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.351996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.352113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.352317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.352507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.352745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.051 [2024-11-16 17:50:18.352854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.051 qpair failed and we were unable to recover it. 00:30:41.051 [2024-11-16 17:50:18.352935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.353161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.353402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.353632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.353863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.353967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.354059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.354255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.354443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.354636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.354893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.354984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.355149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.355381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.355595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.355832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.355969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.356057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.356172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.356197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.356285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.356373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.356397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.356511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.356602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.356634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.356751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.356829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.356853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.356962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.357162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.357345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.357553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.357774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.357913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.358029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.358139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.358163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.358248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.358383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.358407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.052 [2024-11-16 17:50:18.358495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.358581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.052 [2024-11-16 17:50:18.358605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.052 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.358712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.358796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.358825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.358944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.359140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.359388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.359636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.359858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.359966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.360043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.360262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.360440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.360666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.360896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.360987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.361102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.361320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.361541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.361747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.361889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.362002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.362106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.362130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.362222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.362335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.362359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.362451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.362532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.362556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.362641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.362750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.053 [2024-11-16 17:50:18.362775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.053 qpair failed and we were unable to recover it. 00:30:41.053 [2024-11-16 17:50:18.362866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.362948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.362972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.363079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.363217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.363241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.363333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.363405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.363429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.363543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.363630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.363654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.363749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.363832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.363857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.363995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.364103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.364128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.364239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.364318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.364344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.364461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.364572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.364596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.364695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.364782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.364806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.364923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.365113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.365309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.365503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.365788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.365894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.365999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.366228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.366422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.366672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.366864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.366983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.367094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.367326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.367553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.367804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.054 [2024-11-16 17:50:18.367922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.054 qpair failed and we were unable to recover it. 00:30:41.054 [2024-11-16 17:50:18.368063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.368155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.368180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.368291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.368371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.368396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.368504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.368625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.368650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.368744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.368855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.368879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.368995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.369192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.369383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.369658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.369852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.369987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.370092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.370183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.370211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.370327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.370441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.370467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.370608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.370741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.370766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.370878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.370959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.370985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.371075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.371300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.371504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.371706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.371905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.371982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.372112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.372308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.372539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.372756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.372870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.372963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.373075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.373099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.373215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.373326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.055 [2024-11-16 17:50:18.373351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.055 qpair failed and we were unable to recover it. 00:30:41.055 [2024-11-16 17:50:18.373463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.373602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.373634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.373735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.373846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.373872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.373972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.374079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.374103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.374195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.374306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.374331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.374417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.374561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.374586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.374686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.374777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.374802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.374911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.375015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.375047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.375235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.375349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.375383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.375552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.375663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.375694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.375849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.375989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.376019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.376187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.376303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.376351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.376490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.376578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.376605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.376717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.376800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.376824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.376907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.377163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.377381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.377631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.377906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.377990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.378035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.378257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.378376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.378403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.378526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.378644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.378687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.378781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.378880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.378906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.379024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.379143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.379170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.379362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.379458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.379486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.379594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.379692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.379717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.379833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.379908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.379932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.380013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.380121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.380144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.380238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.380331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.056 [2024-11-16 17:50:18.380363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.056 qpair failed and we were unable to recover it. 00:30:41.056 [2024-11-16 17:50:18.380484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.380577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.380604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.380754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.380873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.380897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.381004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.381097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.381124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.381342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.381469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.381495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.381638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.381724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.381749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.381880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.382133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.382375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.382663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.382914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.382995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.383019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.383165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.383281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.383305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.383406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.383491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.383518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.383613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.383770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.383795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.383938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.384024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.384049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.384164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.384244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.384269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.384374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.384510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.384537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.384695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.384778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.384803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.384938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.385178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.385380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.385640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.385862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.385975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.386090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.386176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.386200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.386307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.386422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.386450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.386542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.386644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.386686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.386801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.386882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.386906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.386996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.387082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.387106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.387235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.387358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.387385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.057 qpair failed and we were unable to recover it. 00:30:41.057 [2024-11-16 17:50:18.387507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.057 [2024-11-16 17:50:18.387631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.387672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.387778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.387865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.387889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.388000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.388114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.388139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.388288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.388410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.388437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.388531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.388644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.388669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.388759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.388836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.388860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.388974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.389088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.389113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.389220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.389311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.389339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.389490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.389610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.389658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.389748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.389887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.389912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.390028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.390170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.390195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.390290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.390437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.390464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.390586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.390708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.390733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.390842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.390980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.391093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.391332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.391562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.391811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.391948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.392026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.392139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.392164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.392251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.392361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.392385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.392472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.392558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.392582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.392703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.392791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.392815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.392923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.393038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.058 [2024-11-16 17:50:18.393067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.058 qpair failed and we were unable to recover it. 00:30:41.058 [2024-11-16 17:50:18.393154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.393239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.393264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.393407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.393496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.393521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.393632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.393750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.393775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.393856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.393969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.393994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.394107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.394194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.394218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.394323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.394430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.394455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.394546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.394635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.394661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.394767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.394891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.394915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.395000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.395107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.395133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.395253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.395334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.395359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.395450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.395535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.395560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.395697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.395794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.395820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.395910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.396134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.396325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.396520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.396721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.396917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.396997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.397133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.397350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.397573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.397806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.397925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.398039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.398148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.398173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.398261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.398340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.398364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.398491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.398576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.398602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.398733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.398875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.398900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.399017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.399153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.059 [2024-11-16 17:50:18.399177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.059 qpair failed and we were unable to recover it. 00:30:41.059 [2024-11-16 17:50:18.399265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.399358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.399383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.399509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.399649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.399675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.399756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.399869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.399894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.400006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.400086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.400111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.400205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.400317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.400341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.400431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.400575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.400600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.400694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.400777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.400803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.400903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.401040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.401065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.401155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.401263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.401287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.401376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.401460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.401485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.401564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.401666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.401691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.401888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.402140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.402376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.402594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.402850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.402979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.403097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.403179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.403204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.403315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.403401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.403444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.403539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.403661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.403704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.403789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.403912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.403936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.404021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.404137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.404162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.404256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.404347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.404373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.404484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.404598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.404631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.404757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.404845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.404874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.404986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.405100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.060 [2024-11-16 17:50:18.405124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.060 qpair failed and we were unable to recover it. 00:30:41.060 [2024-11-16 17:50:18.405204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.405315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.405340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.405428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.405513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.405538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.405625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.405745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.405770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.405857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.405962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.405987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.406124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.406230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.406255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.406368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.406450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.406475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.406558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.406641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.406667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.406755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.406868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.406893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.407002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.407198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.407396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.407634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.407868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.407982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.408092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.408325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.408576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.408776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.408889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.408988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.409182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.409435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.409680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.409916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.409999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.410023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.410140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.410248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.410273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.410355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.410468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.410493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.410601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.410687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.410713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.061 qpair failed and we were unable to recover it. 00:30:41.061 [2024-11-16 17:50:18.410805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.410984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.061 [2024-11-16 17:50:18.411009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.411120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.411236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.411261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.411374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.411466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.411491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.411608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.411739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.411764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.411900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.411987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.412098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.412323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.412513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.412729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.412841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.412956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.413183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.413431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.413649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.413905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.413992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.414016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.414142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.414256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.414285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.414401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.414541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.414565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.414651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.414761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.414787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.414907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.414995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.415113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.415390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.415653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.415836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.415945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.416056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.416171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.416195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.416284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.416367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.416392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.416482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.416564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.416589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.416701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.416809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.416834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.416953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.417029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.417053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.417174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.417265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.417289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.417396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.417475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.417500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.062 qpair failed and we were unable to recover it. 00:30:41.062 [2024-11-16 17:50:18.417585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.062 [2024-11-16 17:50:18.417676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.417702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.417807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.417921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.417946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.418059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.418169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.418195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.418336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.418413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.418438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.418518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.418630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.418657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.418744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.418826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.418852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.418969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.419049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.419080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.419220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.419305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.419330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.419430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.419555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.419580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.419679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.419769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.419795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.419903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.420121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.420336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.420530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.420752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.420865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.420945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.421181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.421439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.421661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.421862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.421974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.422090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.422171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.422196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.422282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.422368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.422393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.422507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.422593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.422626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.422756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.422869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.422894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.063 qpair failed and we were unable to recover it. 00:30:41.063 [2024-11-16 17:50:18.422980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.063 [2024-11-16 17:50:18.423060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.423084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.423199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.423314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.423338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.423474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.423587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.423612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.423707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.423799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.423825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.423964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.424164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.424429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.424652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.424884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.424994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.425107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.425305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.425556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.425775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.425909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.425993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.426114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.426139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.426245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.426334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.426358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.426468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.426573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.426598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.426709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.426825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.426850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.426968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.427081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.427106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.427193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.427304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.427329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.427441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.427527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.427552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.427647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.427761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.427786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.427901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.428119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.428334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.428610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.428820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.428952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.429031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.429109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.429135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.429215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.429306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.429331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.429408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.429523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.429547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.429639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.429732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.064 [2024-11-16 17:50:18.429757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.064 qpair failed and we were unable to recover it. 00:30:41.064 [2024-11-16 17:50:18.429875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.429959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.429984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.430097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.430222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.430247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.430355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.430479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.430504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.430648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.430757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.430782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.430889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.430962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.430987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.431065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.431182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.431207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.431319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.431438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.431462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.431546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.431653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.431679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.431764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.431855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.431880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.431997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.432186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.432401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.432628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.432827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.432965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.433046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.433157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.433183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.433281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.433389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.433413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.433496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.433613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.433646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.433759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.433842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.433866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.433948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.434082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.434107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.434188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.434325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.434350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.434433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.434545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.434573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.434683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.434799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.434824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.434934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.435156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.435393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.435605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.435841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.435985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.436009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.436116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.436226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.436251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.436337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.436453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.436478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.436594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.436718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.436743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.065 qpair failed and we were unable to recover it. 00:30:41.065 [2024-11-16 17:50:18.436857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.065 [2024-11-16 17:50:18.436949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.436973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.437060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.437177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.437202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.437343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.437450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.437474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.437599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.437689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.437718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.437832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.437950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.437975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.438093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.438174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.438199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.438347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.438453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.438478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.438561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.438671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.438698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.438784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.438858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.438883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.438994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.439204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.439426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.439626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.439853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.439988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.440073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.440151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.440175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.440295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.440373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.440399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.440493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.440633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.440658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.440771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.440860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.440884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.440991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.441194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.441399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.441577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.441813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.441943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.442069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.442156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.442181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.442271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.442396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.442424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.442510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.442641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.442685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.442800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.442888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.442913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.443009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.443221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.443414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.443645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.066 qpair failed and we were unable to recover it. 00:30:41.066 [2024-11-16 17:50:18.443836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.066 [2024-11-16 17:50:18.443961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.443986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.444079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.444189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.444214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.444312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.444420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.444445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.444533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.444653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.444679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.444799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.444888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.444913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.445009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.445232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.445424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.445634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.445907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.445994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.446018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.446133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.446239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.446263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.446347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.446485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.446512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.446600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.446720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.446745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.446886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.447157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.447376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.447601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.447825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.447956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.448074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.448156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.448180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.448318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.448428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.448452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.448577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.448671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.448696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.448778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.448863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.448889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.448981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.449204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.449402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.449629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.449853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.449965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.450058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.450173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.450199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.067 qpair failed and we were unable to recover it. 00:30:41.067 [2024-11-16 17:50:18.450286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.067 [2024-11-16 17:50:18.450399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.450423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.450531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.450621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.450651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.450764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.450845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.450870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.450962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.451240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.451441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.451647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.451892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.451996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.452137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.452342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.452645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.452838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.452978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.453092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.453200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.453225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.453341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.453528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.453553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.453637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.453730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.453755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.453943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.454028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.454053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.454152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.454292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.454317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.454399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.454486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.454511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.454627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.454709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.454734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.454846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.455033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.455058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.455168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.455247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.455273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.455359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.455472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.068 [2024-11-16 17:50:18.455496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.068 qpair failed and we were unable to recover it. 00:30:41.068 [2024-11-16 17:50:18.455600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.455740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.455765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.455954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.456092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.456117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.456235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.456423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.456447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.456563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.456651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.456676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.456811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.456909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.456933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.457076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.457162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.457186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.457265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.457379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.457404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.457483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.457596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.457628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.457745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.457838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.457862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.457977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.458171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.458399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.458595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.458829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.458942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.459057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.459138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.459167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.459258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.459341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.459384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.459494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.459623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.459652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.459787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.459875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.459900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.459987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.460183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.460373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.460613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.460851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.460960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.461065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.461149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.461174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.461363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.461475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.461500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.461613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.461705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.461731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.461821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.462011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.462036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.462146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.462260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.069 [2024-11-16 17:50:18.462285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.069 qpair failed and we were unable to recover it. 00:30:41.069 [2024-11-16 17:50:18.462364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.462451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.462476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.462556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.462676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.462703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.462789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.462905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.462930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.463014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.463105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.463129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.463220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.463332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.463356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.463468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.463575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.463600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.463696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.463884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.463909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.464048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.464124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.464149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.464267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.464404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.464428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.464542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.464670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.464696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.464884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.464997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.465142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.465361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.465600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.465822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.465941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.466052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.466255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.466470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.466715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.466914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.466987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.467012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.467121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.467209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.467234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.467346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.467435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.467460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.467586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.467706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.467733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.467814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.468218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.468406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.468653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.468858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.468974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.469057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.469131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.070 [2024-11-16 17:50:18.469156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.070 qpair failed and we were unable to recover it. 00:30:41.070 [2024-11-16 17:50:18.469270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.469355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.469380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.469497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.469609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.469640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.469730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.469865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.469889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.469983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.470096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.470121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.470232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.470318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.470344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.470449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.470522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.470546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.470639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.470740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.470774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.470982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.471102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.471128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.471270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.471351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.471381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.471498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.471585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.471611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.471736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.471924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.471949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.472062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.472173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.472199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.472280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.472391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.472416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.472549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.472651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.472693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.472812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.472896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.472920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.473032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.473221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.473246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.473359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.473485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.473510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.473592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.473705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.473730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.473810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.473900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.473925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.474015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.474092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.474118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.474257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.474337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.474362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.474484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.474575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.474600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.474707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.474817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.474842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.474923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.475150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.475391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.475569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.475765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.475925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.071 [2024-11-16 17:50:18.476013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.476092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.071 [2024-11-16 17:50:18.476117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.071 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.476218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.476296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.476321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.476403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.476476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.476501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.476586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.476675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.476700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.476890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.476981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.477099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.477335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.477530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.477760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.477873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.477964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.478214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.478438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.478696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.478907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.478988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.479013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.479123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.479204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.479229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.479310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.479396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.479422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.479509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.479647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.072 [2024-11-16 17:50:18.479673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.072 qpair failed and we were unable to recover it. 00:30:41.072 [2024-11-16 17:50:18.479785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.479875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.479901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.479995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.480106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.480131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.480248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.480325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.480351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.480461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.480574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.480599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.480735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.480924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.480953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.481036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.481226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.481250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.481389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.481509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.481534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.481665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.481751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.481776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.481865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.481977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.482001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.482148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.482259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.482284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.482362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.482474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.482499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.355 qpair failed and we were unable to recover it. 00:30:41.355 [2024-11-16 17:50:18.482579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.355 [2024-11-16 17:50:18.482673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.482699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.482782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.482863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.482888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.482965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.483168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.483398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.483584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.483792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.483953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.484039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.484153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.484178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.484293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.484375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.484416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.484501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.484589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.484628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.484763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.484852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.484876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.484994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.485081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.485106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.485221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.485296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.485321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.485412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.485486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.485510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.485605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.485734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.485759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.485833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.486137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.486359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.486543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.356 qpair failed and we were unable to recover it. 00:30:41.356 [2024-11-16 17:50:18.486784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.356 [2024-11-16 17:50:18.486889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.486913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.357 qpair failed and we were unable to recover it. 00:30:41.357 [2024-11-16 17:50:18.486998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.357 qpair failed and we were unable to recover it. 00:30:41.357 [2024-11-16 17:50:18.487240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.357 qpair failed and we were unable to recover it. 00:30:41.357 [2024-11-16 17:50:18.487440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.357 qpair failed and we were unable to recover it. 00:30:41.357 [2024-11-16 17:50:18.487630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.357 qpair failed and we were unable to recover it. 00:30:41.357 [2024-11-16 17:50:18.487837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.487969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.357 qpair failed and we were unable to recover it. 00:30:41.357 [2024-11-16 17:50:18.488051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.357 [2024-11-16 17:50:18.488139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.488163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.358 qpair failed and we were unable to recover it. 00:30:41.358 [2024-11-16 17:50:18.488251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.488363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.488388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.358 qpair failed and we were unable to recover it. 00:30:41.358 [2024-11-16 17:50:18.488469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.488556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.488581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.358 qpair failed and we were unable to recover it. 00:30:41.358 [2024-11-16 17:50:18.488675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.488758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.488784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.358 qpair failed and we were unable to recover it. 00:30:41.358 [2024-11-16 17:50:18.488874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.488999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.489024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.358 qpair failed and we were unable to recover it. 00:30:41.358 [2024-11-16 17:50:18.489106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.489217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.358 [2024-11-16 17:50:18.489242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.359 qpair failed and we were unable to recover it. 00:30:41.359 [2024-11-16 17:50:18.489328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.489409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.489433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.359 qpair failed and we were unable to recover it. 00:30:41.359 [2024-11-16 17:50:18.489549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.489662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.489688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.359 qpair failed and we were unable to recover it. 00:30:41.359 [2024-11-16 17:50:18.489780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.489885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.489910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.359 qpair failed and we were unable to recover it. 00:30:41.359 [2024-11-16 17:50:18.489984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.490071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.490095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.359 qpair failed and we were unable to recover it. 00:30:41.359 [2024-11-16 17:50:18.490186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.490267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.490293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.359 qpair failed and we were unable to recover it. 00:30:41.359 [2024-11-16 17:50:18.490398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.490485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.359 [2024-11-16 17:50:18.490509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.359 qpair failed and we were unable to recover it. 00:30:41.359 [2024-11-16 17:50:18.490630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.490711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.490735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.360 qpair failed and we were unable to recover it. 00:30:41.360 [2024-11-16 17:50:18.490818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.490930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.490954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.360 qpair failed and we were unable to recover it. 00:30:41.360 [2024-11-16 17:50:18.491046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.491126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.491151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.360 qpair failed and we were unable to recover it. 00:30:41.360 [2024-11-16 17:50:18.491236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.491347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.491372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.360 qpair failed and we were unable to recover it. 00:30:41.360 [2024-11-16 17:50:18.491463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.491571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.360 [2024-11-16 17:50:18.491596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.361 qpair failed and we were unable to recover it. 00:30:41.361 [2024-11-16 17:50:18.491794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.361 [2024-11-16 17:50:18.491934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.361 [2024-11-16 17:50:18.491958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.361 qpair failed and we were unable to recover it. 00:30:41.361 [2024-11-16 17:50:18.492050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.361 [2024-11-16 17:50:18.492163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.361 [2024-11-16 17:50:18.492187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.361 qpair failed and we were unable to recover it. 00:30:41.361 [2024-11-16 17:50:18.492268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.361 [2024-11-16 17:50:18.492348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.361 [2024-11-16 17:50:18.492376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.361 qpair failed and we were unable to recover it. 00:30:41.361 [2024-11-16 17:50:18.492492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.361 [2024-11-16 17:50:18.492572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.361 [2024-11-16 17:50:18.492596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.361 qpair failed and we were unable to recover it. 00:30:41.361 [2024-11-16 17:50:18.492684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.362 [2024-11-16 17:50:18.492803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.362 [2024-11-16 17:50:18.492827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.362 qpair failed and we were unable to recover it. 00:30:41.362 [2024-11-16 17:50:18.492919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.362 [2024-11-16 17:50:18.493056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.362 [2024-11-16 17:50:18.493080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.362 qpair failed and we were unable to recover it. 00:30:41.362 [2024-11-16 17:50:18.493186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.362 [2024-11-16 17:50:18.493272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.362 [2024-11-16 17:50:18.493298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.362 qpair failed and we were unable to recover it. 00:30:41.362 [2024-11-16 17:50:18.493443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.362 [2024-11-16 17:50:18.493536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.362 [2024-11-16 17:50:18.493561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.363 qpair failed and we were unable to recover it. 00:30:41.363 [2024-11-16 17:50:18.493668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.363 [2024-11-16 17:50:18.493757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.363 [2024-11-16 17:50:18.493782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.363 qpair failed and we were unable to recover it. 00:30:41.363 [2024-11-16 17:50:18.493860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.363 [2024-11-16 17:50:18.493944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.363 [2024-11-16 17:50:18.493969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.363 qpair failed and we were unable to recover it. 00:30:41.363 [2024-11-16 17:50:18.494058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.363 [2024-11-16 17:50:18.494150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.363 [2024-11-16 17:50:18.494175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.363 qpair failed and we were unable to recover it. 00:30:41.363 [2024-11-16 17:50:18.494279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.363 [2024-11-16 17:50:18.494367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.363 [2024-11-16 17:50:18.494391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.363 qpair failed and we were unable to recover it. 00:30:41.364 [2024-11-16 17:50:18.494472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.494553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.494578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.364 qpair failed and we were unable to recover it. 00:30:41.364 [2024-11-16 17:50:18.494704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.494797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.494821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.364 qpair failed and we were unable to recover it. 00:30:41.364 [2024-11-16 17:50:18.494910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.495024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.495048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.364 qpair failed and we were unable to recover it. 00:30:41.364 [2024-11-16 17:50:18.495132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.495272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.495296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.364 qpair failed and we were unable to recover it. 00:30:41.364 [2024-11-16 17:50:18.495386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.495470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.495495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.364 qpair failed and we were unable to recover it. 00:30:41.364 [2024-11-16 17:50:18.495579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.495689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.364 [2024-11-16 17:50:18.495716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.365 qpair failed and we were unable to recover it. 00:30:41.365 [2024-11-16 17:50:18.495807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.365 [2024-11-16 17:50:18.495892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.365 [2024-11-16 17:50:18.495917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.365 qpair failed and we were unable to recover it. 00:30:41.365 [2024-11-16 17:50:18.496002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.365 [2024-11-16 17:50:18.496121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.365 [2024-11-16 17:50:18.496145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.365 qpair failed and we were unable to recover it. 00:30:41.365 [2024-11-16 17:50:18.496232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.365 [2024-11-16 17:50:18.496318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.365 [2024-11-16 17:50:18.496343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.365 qpair failed and we were unable to recover it. 00:30:41.365 [2024-11-16 17:50:18.496436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.365 [2024-11-16 17:50:18.496549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.365 [2024-11-16 17:50:18.496574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.365 qpair failed and we were unable to recover it. 00:30:41.365 [2024-11-16 17:50:18.496702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.496807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.496831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.366 qpair failed and we were unable to recover it. 00:30:41.366 [2024-11-16 17:50:18.496928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.366 qpair failed and we were unable to recover it. 00:30:41.366 [2024-11-16 17:50:18.497182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.366 qpair failed and we were unable to recover it. 00:30:41.366 [2024-11-16 17:50:18.497382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.366 qpair failed and we were unable to recover it. 00:30:41.366 [2024-11-16 17:50:18.497609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.366 qpair failed and we were unable to recover it. 00:30:41.366 [2024-11-16 17:50:18.497842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.366 [2024-11-16 17:50:18.497929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.497955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.367 qpair failed and we were unable to recover it. 00:30:41.367 [2024-11-16 17:50:18.498039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.498132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.498157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.367 qpair failed and we were unable to recover it. 00:30:41.367 [2024-11-16 17:50:18.498272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.498356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.498381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.367 qpair failed and we were unable to recover it. 00:30:41.367 [2024-11-16 17:50:18.498571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.498698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.498723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.367 qpair failed and we were unable to recover it. 00:30:41.367 [2024-11-16 17:50:18.498838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.498929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.498954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.367 qpair failed and we were unable to recover it. 00:30:41.367 [2024-11-16 17:50:18.499046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.499125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.499149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.367 qpair failed and we were unable to recover it. 00:30:41.367 [2024-11-16 17:50:18.499236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.499346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.499371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.367 qpair failed and we were unable to recover it. 00:30:41.367 [2024-11-16 17:50:18.499491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.367 [2024-11-16 17:50:18.499603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.499636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.368 qpair failed and we were unable to recover it. 00:30:41.368 [2024-11-16 17:50:18.499753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.499865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.499889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.368 qpair failed and we were unable to recover it. 00:30:41.368 [2024-11-16 17:50:18.499979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.500064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.500089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.368 qpair failed and we were unable to recover it. 00:30:41.368 [2024-11-16 17:50:18.500172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.500259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.500283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.368 qpair failed and we were unable to recover it. 00:30:41.368 [2024-11-16 17:50:18.500473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.500625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.500651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.368 qpair failed and we were unable to recover it. 00:30:41.368 [2024-11-16 17:50:18.500739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.500824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.500850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.368 qpair failed and we were unable to recover it. 00:30:41.368 [2024-11-16 17:50:18.500959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.501038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.368 [2024-11-16 17:50:18.501063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.368 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.501146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.501239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.501264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.369 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.501337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.501451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.501492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.369 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.501600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.501717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.501742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.369 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.501868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.501948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.501972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.369 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.502058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.502171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.502196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.369 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.502287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.502391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.502416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.369 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.502507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.502593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.502624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.369 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.502710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.502795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.369 [2024-11-16 17:50:18.502819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.369 qpair failed and we were unable to recover it. 00:30:41.369 [2024-11-16 17:50:18.502923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.370 [2024-11-16 17:50:18.503011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.370 [2024-11-16 17:50:18.503035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.370 qpair failed and we were unable to recover it. 00:30:41.370 [2024-11-16 17:50:18.503151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.370 [2024-11-16 17:50:18.503233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.370 [2024-11-16 17:50:18.503258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.370 qpair failed and we were unable to recover it. 00:30:41.370 [2024-11-16 17:50:18.503347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.370 [2024-11-16 17:50:18.503433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.370 [2024-11-16 17:50:18.503458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.370 qpair failed and we were unable to recover it. 00:30:41.370 [2024-11-16 17:50:18.503563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.370 [2024-11-16 17:50:18.503681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.503706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.371 qpair failed and we were unable to recover it. 00:30:41.371 [2024-11-16 17:50:18.503793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.503877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.503907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.371 qpair failed and we were unable to recover it. 00:30:41.371 [2024-11-16 17:50:18.503996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.504135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.504160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.371 qpair failed and we were unable to recover it. 00:30:41.371 [2024-11-16 17:50:18.504246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.504329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.504354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.371 qpair failed and we were unable to recover it. 00:30:41.371 [2024-11-16 17:50:18.504499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.504613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.504644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.371 qpair failed and we were unable to recover it. 00:30:41.371 [2024-11-16 17:50:18.504733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.504818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.371 [2024-11-16 17:50:18.504844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.371 qpair failed and we were unable to recover it. 00:30:41.371 [2024-11-16 17:50:18.505034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.372 [2024-11-16 17:50:18.505222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.372 [2024-11-16 17:50:18.505247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.372 qpair failed and we were unable to recover it. 00:30:41.372 [2024-11-16 17:50:18.505361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.372 [2024-11-16 17:50:18.505476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.372 [2024-11-16 17:50:18.505501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.372 qpair failed and we were unable to recover it. 00:30:41.372 [2024-11-16 17:50:18.505614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.372 [2024-11-16 17:50:18.505707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.372 [2024-11-16 17:50:18.505733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.372 qpair failed and we were unable to recover it. 00:30:41.372 [2024-11-16 17:50:18.505825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.372 [2024-11-16 17:50:18.505917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.372 [2024-11-16 17:50:18.505941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.372 qpair failed and we were unable to recover it. 00:30:41.372 [2024-11-16 17:50:18.506055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.506144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.506168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.373 qpair failed and we were unable to recover it. 00:30:41.373 [2024-11-16 17:50:18.506283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.506371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.506396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.373 qpair failed and we were unable to recover it. 00:30:41.373 [2024-11-16 17:50:18.506491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.506606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.506636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.373 qpair failed and we were unable to recover it. 00:30:41.373 [2024-11-16 17:50:18.506727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.506803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.506828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.373 qpair failed and we were unable to recover it. 00:30:41.373 [2024-11-16 17:50:18.507017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.373 [2024-11-16 17:50:18.507157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.507182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.374 qpair failed and we were unable to recover it. 00:30:41.374 [2024-11-16 17:50:18.507265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.507343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.507368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.374 qpair failed and we were unable to recover it. 00:30:41.374 [2024-11-16 17:50:18.507489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.507579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.507604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.374 qpair failed and we were unable to recover it. 00:30:41.374 [2024-11-16 17:50:18.507718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.507799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.507824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.374 qpair failed and we were unable to recover it. 00:30:41.374 [2024-11-16 17:50:18.507938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.508046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.508070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.374 qpair failed and we were unable to recover it. 00:30:41.374 [2024-11-16 17:50:18.508259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.508341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.508365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.374 qpair failed and we were unable to recover it. 00:30:41.374 [2024-11-16 17:50:18.508479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.508592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.374 [2024-11-16 17:50:18.508626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.508731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.508848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.508873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.508957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.509177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.509375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.509633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.509860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.509962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.510059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.510172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.510198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.510317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.510398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.510422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.375 [2024-11-16 17:50:18.510530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.510636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.375 [2024-11-16 17:50:18.510661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.375 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.510749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.510834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.510859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.510981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.511066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.511091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.511279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.511393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.511418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.511537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.511642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.511668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.511750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.511834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.511859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.512049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.512270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.512470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.512679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.512879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.512978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.513064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.513148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.513172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.513281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.513364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.513389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.513514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.513664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.513710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.513802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.513920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.513945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.514024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.514104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.514128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.514248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.514363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.514387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.514504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.514592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.514621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.514719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.514792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.514816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.515006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.515225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.515468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.515672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.515867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.515972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.516092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.516195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.516219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.516309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.516395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.516420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.516539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.516648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.516673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.516763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.516951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.516975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.517098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.517233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.517258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.517340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.517418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.517443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.517560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.517675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.517701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.517789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.517928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.517952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.518141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.518254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.518279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.518360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.518477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.518502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.518588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.518704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.376 [2024-11-16 17:50:18.518729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.376 qpair failed and we were unable to recover it. 00:30:41.376 [2024-11-16 17:50:18.518816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.518914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.518938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.519028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.519143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.519169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.519280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.519356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.519381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.519489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.519567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.519592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.519700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.519816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.519840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.519981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.520205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.520453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.520634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.520860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.520999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.521091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.521183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.521212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.521335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.521439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.521472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.521565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.521666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.521694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.521815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.521931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.521956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.522073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.522160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.522185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.522301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.522390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.522417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.522622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.522738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.522763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.522910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.523023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.523047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.523159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.523245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.523270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.523376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.523465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.523506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.523663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.523753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.523779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.523892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.524108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.524411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.524638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.524881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.524983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.525068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.525153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.525179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.525286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.525369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.525394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.525480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.525571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.525595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.525745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.525867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.525896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.525985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.526094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.526118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.526231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.526327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.526352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.526460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.526543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.526569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.526689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.526773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.526797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.377 qpair failed and we were unable to recover it. 00:30:41.377 [2024-11-16 17:50:18.526889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.377 [2024-11-16 17:50:18.527022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.527129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.527352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.527574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.527802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.527915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.528005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.528108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.528132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.528254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.528366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.528390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.528486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.528611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.528643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.528781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.528863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.528889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.529028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.529136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.529161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.529279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.529366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.529394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.529518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.529634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.529660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.529734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.529829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.529854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.529941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.530187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.530386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.530603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.530824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.530922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.531006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.531116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.531141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.531267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.531373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.531397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.531515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.531629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.531655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.531742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.531830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.531854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.531979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.532118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.532142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.532256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.532364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.532390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.532500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.532639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.532665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.532747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.532875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.532900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.532993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.533084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.533109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.533215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.533330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.533354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.533470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.533555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.533580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.533694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.533789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.533813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.533898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.534013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.534038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.534111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.534184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.534209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.534325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.534436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.534462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.378 qpair failed and we were unable to recover it. 00:30:41.378 [2024-11-16 17:50:18.534569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.534680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.378 [2024-11-16 17:50:18.534705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.534851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.534926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.534951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.535066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.535170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.535194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.535279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.535395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.535420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.535514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.535632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.535658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.535741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.535830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.535854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.535963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.536153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.536398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.536625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.536862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.536993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.537114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.537224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.537249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.537367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.537506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.537531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.537626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.537702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.537731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.537808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.537892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.537916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.538004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.538109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.538134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.538276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.538368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.538393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.538504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.538597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.538630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.538711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.538825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.538849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.538933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.539217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.539440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.539660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.539887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.539996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.379 qpair failed and we were unable to recover it. 00:30:41.379 [2024-11-16 17:50:18.540143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.379 [2024-11-16 17:50:18.540252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.540277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.540363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.540478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.540503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.540593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.540688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.540713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.540805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.540885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.540909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.540995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.541102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.541126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.541217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.541362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.541386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.541497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.541634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.541677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.541811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.541919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.541944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.542062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.542182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.542207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.542356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.542468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.542493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.542582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.542694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.542720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.542845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.542960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.542985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.543123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.543229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.543253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.543342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.543432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.543456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.543569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.543687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.543713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.543825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.543941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.543966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.544103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.544212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.544237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.544348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.544455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.544480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.544562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.544666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.544691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.544772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.544866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.544891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.545037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.545155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.545181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.545273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.545411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.545435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.545553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.545676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.545702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.545844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.545952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.545977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.546092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.546210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.546235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.546349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.546456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.546481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.546599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.546747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.546772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.546895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.546986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.547137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.547345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.547578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.547846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.547988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.548101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.548190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.548215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.548301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.548415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.548440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.548515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.548624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.548649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.380 qpair failed and we were unable to recover it. 00:30:41.380 [2024-11-16 17:50:18.548764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.380 [2024-11-16 17:50:18.548854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.548879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.548990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.549102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.549127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.549217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.549329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.549354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.549432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.549573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.549602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.549744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.549863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.549888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.550025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.550140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.550169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.550251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.550363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.550388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.550508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.550628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.550653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.550743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.550889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.550914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.551032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.551147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.551172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.381 qpair failed and we were unable to recover it. 00:30:41.381 [2024-11-16 17:50:18.551286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.381 [2024-11-16 17:50:18.551411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.551435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.551553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.551691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.551716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.551828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.551910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.551934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.552040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.552116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.552140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.552221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.552366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.552391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.552514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.552626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.552651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.552744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.552830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.552855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.552974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.553077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.553102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.553193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.553306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.382 [2024-11-16 17:50:18.553331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.382 qpair failed and we were unable to recover it. 00:30:41.382 [2024-11-16 17:50:18.553447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.383 [2024-11-16 17:50:18.553556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.383 [2024-11-16 17:50:18.553581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.383 qpair failed and we were unable to recover it. 00:30:41.383 [2024-11-16 17:50:18.553712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.383 [2024-11-16 17:50:18.553789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.383 [2024-11-16 17:50:18.553815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.383 qpair failed and we were unable to recover it. 00:30:41.383 [2024-11-16 17:50:18.553900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.383 [2024-11-16 17:50:18.554016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.383 [2024-11-16 17:50:18.554041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.383 qpair failed and we were unable to recover it. 00:30:41.383 [2024-11-16 17:50:18.554123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.383 [2024-11-16 17:50:18.554239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.554264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.384 qpair failed and we were unable to recover it. 00:30:41.384 [2024-11-16 17:50:18.554354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.554479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.554504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.384 qpair failed and we were unable to recover it. 00:30:41.384 [2024-11-16 17:50:18.554626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.554710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.554734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.384 qpair failed and we were unable to recover it. 00:30:41.384 [2024-11-16 17:50:18.554823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.554934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.554959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.384 qpair failed and we were unable to recover it. 00:30:41.384 [2024-11-16 17:50:18.555051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.555139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.555163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.384 qpair failed and we were unable to recover it. 00:30:41.384 [2024-11-16 17:50:18.555267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.555372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.555396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.384 qpair failed and we were unable to recover it. 00:30:41.384 [2024-11-16 17:50:18.555503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.384 [2024-11-16 17:50:18.555591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.555623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.385 qpair failed and we were unable to recover it. 00:30:41.385 [2024-11-16 17:50:18.555704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.555855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.555880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.385 qpair failed and we were unable to recover it. 00:30:41.385 [2024-11-16 17:50:18.555955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.385 qpair failed and we were unable to recover it. 00:30:41.385 [2024-11-16 17:50:18.556142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.385 qpair failed and we were unable to recover it. 00:30:41.385 [2024-11-16 17:50:18.556339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.385 qpair failed and we were unable to recover it. 00:30:41.385 [2024-11-16 17:50:18.556594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.385 qpair failed and we were unable to recover it. 00:30:41.385 [2024-11-16 17:50:18.556789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.385 [2024-11-16 17:50:18.556894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.385 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.557019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.557155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.557180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.557256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.557339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.557365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.557452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.557533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.557558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.557660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.557764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.557788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.557899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.558102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.558335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.558560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.558794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.558907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.386 qpair failed and we were unable to recover it. 00:30:41.386 [2024-11-16 17:50:18.558997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.386 [2024-11-16 17:50:18.559105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.559245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.559469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.559673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.559851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.559956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.560074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.560154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.560179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.560268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.560353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.560379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.560499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.560608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.560641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.560757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.560841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.560866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.560963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.561082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.561111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.561210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.561327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.561356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.561456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.561578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.561644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.561740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.561828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.561855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.561973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.562188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.562408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.562603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.562813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.562939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.563074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.563180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.563205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.563288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.563395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.563421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.563508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.563626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.563653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.563743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.563820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.563846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.563956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.564192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.564434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.564611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.564859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.564967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.565105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.565188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.565213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.565336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.565447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.565473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.565568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.565711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.565742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.565844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.565944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.565972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.566067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.566154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.566182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.566324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.566438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.566464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.566577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.566673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.566700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.566815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.566896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.387 [2024-11-16 17:50:18.566922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.387 qpair failed and we were unable to recover it. 00:30:41.387 [2024-11-16 17:50:18.567000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.567087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.567113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.567230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.567309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.567335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.567421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.567531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.567557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.567650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.567758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.567784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.567925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.568222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.568449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.568659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.568874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.568985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.569120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.569226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.569252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.569330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.569421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.569446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.569560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.569678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.569708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.569810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.569960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.569988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.570103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.570197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.570223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.570341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.570414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.570440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.570554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.570686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.570715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.570853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.570991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.571109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.571302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.571527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.571779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.571891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.571973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.572084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.572111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.572194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.572277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.572302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.572395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.572485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.572511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.572685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.572807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.388 [2024-11-16 17:50:18.572833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.388 qpair failed and we were unable to recover it. 00:30:41.388 [2024-11-16 17:50:18.572918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.573030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.573056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.573193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.573312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.573352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.573464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.573552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.573578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.573684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.573767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.573793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.573939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.574186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.574386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.574612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.574860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.574970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.575131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.575219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.575249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.575378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.575482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.575508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.575611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.575723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.575752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.575860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.575940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.575967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.576099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.576214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.576243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.576384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.576464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.576489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.576583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.576701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.576745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.576875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.576989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.577016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.577182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.577309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.577337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.577493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.577645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.577672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.577788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.577896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.577924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.578085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.578205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.578231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.578342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.578431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.578457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.578560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.578662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.578692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.578828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.578932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.578958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.579071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.579193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.579219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.579360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.579493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.579522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.579652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.579767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.579796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.579910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.579996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.580024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.580183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.580272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.580298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.580409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.580518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.580561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.580658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.580790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.580815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.580899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.581066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.581095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.581197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.581284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.581310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.581406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.581524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.581568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.581754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.581838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.389 [2024-11-16 17:50:18.581868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.389 qpair failed and we were unable to recover it. 00:30:41.389 [2024-11-16 17:50:18.581988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.582111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.582139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.582235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.582325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.582351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.582456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.582545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.582570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.582663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.582803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.582829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.582944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.583046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.583075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.583173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.583282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.583308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.583465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.583557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.583586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.583733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.583839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.583865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.584027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.584147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.584173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.584315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.584456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.584503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.584596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.584730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.584759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.584891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.585157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.585411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.585601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.585827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.585942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.586088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.586193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.586219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.586333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.586446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.586472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.586603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.586713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.586757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.586849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.586970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.586995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.587120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.587232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.587275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.587438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.587577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.587603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.587726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.587860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.587889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.587982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.588078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.588106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.588205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.588324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.588350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.588489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.588603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.588637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.588755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.588875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.588903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.588996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.589115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.589144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.589228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.589310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.589338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.589500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.589611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.589645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.589802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.589914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.589940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.590077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.590172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.590200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.590368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.590475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.590501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.590579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.590672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.590698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.590786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.590889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.590914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.591003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.591085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.591110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.390 qpair failed and we were unable to recover it. 00:30:41.390 [2024-11-16 17:50:18.591218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.591320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.390 [2024-11-16 17:50:18.591349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.591453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.591593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.591627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.591762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.591879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.591907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.592003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.592116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.592157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.592248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.592339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.592365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.592472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.592589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.592623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.592757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.592880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.592911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.593064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.593170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.593198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.593282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.593368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.593398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.593532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.593638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.593665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.593762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.593882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.593910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.594007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.594125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.594153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.594322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.594436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.594464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.594606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.594729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.594755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.594895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.594993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.595027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.595117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.595260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.595286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.595420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.595537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.595565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.595670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.595809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.595835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.595923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.596062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.596088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.596184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.596305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.596347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.596435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.596549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.596593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.596769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.596887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.596913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.597056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.597226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.597252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.597364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.597507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.597532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.597689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.597806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.597835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.597948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.598067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.598094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.598228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.598362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.598387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.598510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.598638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.598667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.598766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.598890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.598919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.599090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.599231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.599271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.599396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.599491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.599526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.599655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.599757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.599785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.599905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.600065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.600091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.600205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.600291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.600316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.600438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.600548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.600573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.600701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.600866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.600895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.391 qpair failed and we were unable to recover it. 00:30:41.391 [2024-11-16 17:50:18.601014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.391 [2024-11-16 17:50:18.601107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.601136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.601266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.601370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.601397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.601552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.601661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.601690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.601839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.601988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.602016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.602134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.602264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.602293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.602469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.602587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.602612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.602720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.602851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.602888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.602974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.603088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.603114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.603219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.603342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.603386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.603504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.603611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.603645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.603772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.603858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.603888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.603998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.604108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.604134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.604224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.604345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.604371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.604478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.604640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.604674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.604808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.604959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.604987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.605105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.605231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.605260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.605417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.605504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.605530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.605645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.605752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.605777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.605912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.606028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.606056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.606209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.606363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.606392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.606513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.606674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.606703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.606813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.606900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.606925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.607034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.607180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.607206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.607313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.607443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.607471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.607567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.607720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.607746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.392 [2024-11-16 17:50:18.607888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.608027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.392 [2024-11-16 17:50:18.608068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.392 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.608170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.608324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.608352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.608501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.608628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.608657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.608783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.608869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.608899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.609021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.609137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.609167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.609281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.609451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.609479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.609642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.609760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.609785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.609895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.610031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.610060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.610218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.610326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.610352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.610500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.610610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.610642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.610743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.610859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.610884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.610998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.611115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.611140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.611258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.611409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.611435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.611567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.611703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.611732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.611872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.612011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.612037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.612194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.612316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.612342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.612460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.612572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.612598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.612738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.612876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.612905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.612996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.613125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.613154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.613286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.613425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.613451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.613567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.613650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.613677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.613794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.613913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.613938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.614070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.614201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.614227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.614344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.614465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.614491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.614578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.614695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.614722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.614828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.614947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.614975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.615129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.615241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.615268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.615372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.615501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.615527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.615643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.615738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.615763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.615906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.616028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.393 [2024-11-16 17:50:18.616056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.393 qpair failed and we were unable to recover it. 00:30:41.393 [2024-11-16 17:50:18.616159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.616266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.616291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.616381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.616507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.616536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.616646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.616770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.616796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.616885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.617030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.617056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.617138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.617211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.617237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.617320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.617481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.617509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.617650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.617791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.617817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.617931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.618118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.618144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.618251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.618428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.618453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.618568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.618676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.618703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.618847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.618930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.618956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.619094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.619223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.619253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.619386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.619472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.619498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.619612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.619752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.619781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.619885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.619997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.620023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.620181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.620305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.620338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.620421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.620550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.620576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.620678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.620790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.620834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.620994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.621108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.621134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.621259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.621375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.621416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.621521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.621663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.621690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.621772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.621890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.621916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.622099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.622207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.622233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.622361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.622514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.622542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.622710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.622816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.622842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.622950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.623085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.623115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.623239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.623354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.623380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.623511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.623662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.623691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.623815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.623938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.623966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.624086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.624168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.624197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.624325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.624440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.624466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.624551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.624659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.624685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.624780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.624892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.624919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.625018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.625175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.625201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.394 [2024-11-16 17:50:18.625348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.625463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.394 [2024-11-16 17:50:18.625489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.394 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.625635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.625714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.625758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.625882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.626045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.626070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.626191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.626328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.626356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.626489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.626640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.626667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.626810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.626945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.626970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.627087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.627168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.627212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.627367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.627493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.627521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.627661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.627769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.627795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.627890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.627994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.628022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.628153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.628305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.628333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.628459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.628609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.628671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.628804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.628926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.628952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.629062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.629146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.629189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.629347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.629466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.629491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.629608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.629702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.629728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.629849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.629955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.629980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.630058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.630191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.630218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.630352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.630508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.630533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.630639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.630724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.630750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.630857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.630931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.630957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.631092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.631181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.631211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.631349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.631468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.631494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.631606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.631755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.631784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.631922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.632031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.632058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.632151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.632264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.632290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.632433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.632571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.632600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.632751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.632881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.632907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.633039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.633152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.633177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.633260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.633343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.633369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.633477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.633561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.633587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.633725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.633851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.633879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.634007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.634146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.634178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.634320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.634415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.634444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.634549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.634661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.634688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.634805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.634909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.634936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.395 qpair failed and we were unable to recover it. 00:30:41.395 [2024-11-16 17:50:18.635030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.395 [2024-11-16 17:50:18.635115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.635140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.635279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.635352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.635395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.635531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.635652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.635681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.635797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.635882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.635911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.636048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.636185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.636211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.636379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.636493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.636521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.636604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.636736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.636765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.636924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.637047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.637075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.637246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.637382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.637407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.637547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.637697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.637724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.637868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.637976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.638092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.638335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.638585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.638812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.638970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.639065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.639217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.639246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.639350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.639436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.639462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.639609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.639728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.639756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.639839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.639966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.639994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.640120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.640202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.640231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.640361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.640465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.640491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.640608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.640712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.640740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.640863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.641006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.641032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.641147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.641289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.641315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.641433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.641515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.641541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.641683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.641795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.641823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.641921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.642016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.642059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.642181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.642320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.642347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.642430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.642534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.642571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.396 qpair failed and we were unable to recover it. 00:30:41.396 [2024-11-16 17:50:18.642729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.396 [2024-11-16 17:50:18.642857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.642885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.643048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.643138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.643166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.643282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.643408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.643436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.643573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.643681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.643708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.643817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.643935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.643979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.644073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.644189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.644217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.644370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.644456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.644484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.644589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.644716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.644742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.644817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.644916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.644943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.645055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.645167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.645193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.645336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.645495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.645523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.645662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.645806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.645832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.646024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.646178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.646206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.646329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.646436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.646462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.646541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.646694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.646723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.646834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.646924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.646952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.647044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.647172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.647200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.647339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.647480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.647506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.647663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.647778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.647811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.647936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.648078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.648104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.648234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.648330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.648359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.648508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.648655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.648687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.648772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.648882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.648908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.649014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.649149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.649174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.649299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.649393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.649423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.649588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.649714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.649740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.649842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.649967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.649996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.650098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.650176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.650202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.650316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.650421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.650447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.650561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.650716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.650745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.650867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.650994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.651020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.651100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.651205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.651231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-16 17:50:18.651344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.651480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.397 [2024-11-16 17:50:18.651523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.651612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.651702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.651728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.651847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.651974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.652003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.652131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.652261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.652288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.652415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.652541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.652570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.652713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.652828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.652854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.652976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.653126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.653154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.653323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.653408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.653434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.653571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.653697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.653742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.653830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.653997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.654025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.654180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.654267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.654296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.654458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.654598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.654633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.654782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.654879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.654933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.655043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.655125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.655150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.655249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.655384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.655412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.655547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.655643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.655670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.655807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.655926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.655951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.656106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.656236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.656269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.656411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.656558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.656587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.656716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.656832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.656858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.657013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.657116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.657142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.657258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.657398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.657442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.657579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.657680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.657706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.657789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.657910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.657936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.658046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.658162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.658188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.658261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.658413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.658438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.658544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.658637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.658664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.658783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.658901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.658931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.659051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.659178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.659208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-16 17:50:18.659356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.398 [2024-11-16 17:50:18.659495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.659521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.659629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.659765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.659791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.659934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.660016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.660042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.660193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.660314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.660343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.660462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.660559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.660585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.660720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.660847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.660877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.661020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.661144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.661170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.661283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.661365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.661391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.661512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.661624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.661665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.661797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.661957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.661984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.662078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.662158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.662185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.662347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.662444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.662473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.662576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.662721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.662747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.662852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.663007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.663035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.663207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.663343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.663369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.663467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.663589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.663626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.663805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.663939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.663967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.664094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.664222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.664265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.664350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.664460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.664486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.664577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.664733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.664762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.664919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.665038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.665067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.665178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.665284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.665310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.665390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.665475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.665501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.665610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.665738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.665768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.665876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.666024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.666050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.666167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.666297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.666325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.666458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.666605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.666685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.666792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.666880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.666918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.667006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.667131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.667159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.667289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.667387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.667415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.667572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.667694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.667719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.667860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.667942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.667968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-16 17:50:18.668060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.668141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.399 [2024-11-16 17:50:18.668167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.668297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.668413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.668439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.668565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.668657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.668682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.668809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.668963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.668989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.669083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.669205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.669231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.669323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.669442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.669468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.669576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.669706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.669730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.669822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.669963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.669989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.670118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.670215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.670242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.670341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.670457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.670484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.670649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.670735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.670760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.670873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.670978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.671087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.671308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.671522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.671752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.671875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.671974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.672089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.672116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.672237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.672363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.672392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.672515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.672600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.672632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.672728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.672841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.672873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.672963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.673068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.673092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.673213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.673294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.673319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.673405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.673480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.673504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.673644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.673783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.673807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.673885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.674009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.674034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.674152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.674262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.674287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.674429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.674539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.674565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.674742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.674854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.674887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.674986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.675120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.675146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.675227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.675328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.675356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.400 qpair failed and we were unable to recover it. 00:30:41.400 [2024-11-16 17:50:18.675454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.400 [2024-11-16 17:50:18.675537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.675563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.675681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.675788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.675814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.675899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.675985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.676098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.676339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.676601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.676811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.676949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.677046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.677129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.677155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.677284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.677398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.677424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.677548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.677658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.677688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.677846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.677985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.678099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.678287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.678610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.678850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.678998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.679109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.679184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.679210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.679336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.679447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.679472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.679557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.679651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.679680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.679770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.679899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.679924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.680027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.680174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.680203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.680303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.680411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.680437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.680514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.680631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.680670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.680756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.680842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.680877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.680983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.681089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.681115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.681203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.681310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.681336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.681450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.681542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.681567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.681686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.681812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.681837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.681925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.682173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.682378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.682603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.682854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.682993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.683021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.683154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.683272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.683297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.683377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.683493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.683518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.683592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.683726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.683752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.683869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.684013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.684039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.684157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.684264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.684290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.401 qpair failed and we were unable to recover it. 00:30:41.401 [2024-11-16 17:50:18.684369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.401 [2024-11-16 17:50:18.684473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.684499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.684609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.684702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.684735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.684845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.684977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.685005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.685161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.685298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.685323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.685434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.685542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.685568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.685715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.685838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.685890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.686001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.686094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.686119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.686195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.686311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.686337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.686450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.686558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.686601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.686757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.686846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.686879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.686966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.687054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.687081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.687191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.687301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.687327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.687507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.687628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.687665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.687764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.687874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.687899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.687984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.688097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.688122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.688229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.688341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.688366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.688493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.688606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.688640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.688756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.688837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.688874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.688988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.689113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.689142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.689254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.689337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.689362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.689469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.689577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.689602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.689703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.689797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.689822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.689943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.690058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.690084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.690170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.690285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.690310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.690390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.690502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.690527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.690639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.690747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.690777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.690911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.691187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.691411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.691655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.691867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.691995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.692022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.692130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.692224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.692250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.692405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.692502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.692531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.692614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.692785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.692813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.692905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.692994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.693023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.402 qpair failed and we were unable to recover it. 00:30:41.402 [2024-11-16 17:50:18.693129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.693235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.402 [2024-11-16 17:50:18.693261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.693352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.693451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.693476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.693559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.693704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.693730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.693823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.693925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.693953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.694105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.694240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.694266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.694359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.694446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.694472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.694591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.694747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.694773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.694859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.694981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.695103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.695356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.695585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.695847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.695958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.696073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.696163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.696189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.696293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.696387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.696415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.696539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.696645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.696674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.696807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.696904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.696930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.697020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.697139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.697165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.697282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.697365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.697395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.697505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.697641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.697670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.697761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.697886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.697914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.698015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.698210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.698435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.698670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.698870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.698984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.699009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.699094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.699206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.699232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.699339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.699429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.699454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.699597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.699743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.699772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.699886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.699975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.700001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.700122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.700237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.700263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.700355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.700467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.700492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.700662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.700816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.700842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.700962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.701040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.701066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.701150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.701267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.701293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.403 [2024-11-16 17:50:18.701396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.701518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.403 [2024-11-16 17:50:18.701546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.403 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.701634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.701732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.701760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.701870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.702114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.702330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.702606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.702861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.702969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.703086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.703200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.703225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.703317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.703407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.703432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.703562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.703654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.703682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.703828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.703914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.703939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.704018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.704095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.704121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.704225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.704305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.704333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.704460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.704576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.704604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.704719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.704835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.704861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.404 [2024-11-16 17:50:18.704995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.705087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.404 [2024-11-16 17:50:18.705115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.404 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.705214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.705358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.705383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.705493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.705585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.705611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.705731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.705844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.705869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.706012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.706110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.706138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.706259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.706351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.706380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.706475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.706563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.706591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.706735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.706895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.706924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.707057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.707214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.707245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.707394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.707535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.707567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.707654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.707827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.707873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.708011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.708136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.708162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.708279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.708362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.708388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.708477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.708625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.708653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.708789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.708905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.708931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.709048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.709164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.709191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.709316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.709403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.709429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.709509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.709600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.709637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.709759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.709868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.709894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.709987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.710128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.405 [2024-11-16 17:50:18.710162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.405 qpair failed and we were unable to recover it. 00:30:41.405 [2024-11-16 17:50:18.710281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.710368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.710396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.710519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.710605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.710641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.710763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.710872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.710898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.711016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.711159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.711186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.711308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.711402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.711429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.711515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.711653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.711681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.711795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.711914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.711940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.712061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.712204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.712230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.712344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.712457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.712484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.712571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.712665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.712696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.712821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.712899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.712925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.713014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.713135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.713162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.713273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.713383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.713410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.713540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.713626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.713654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.713766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.713873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.713903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.714042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.714122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.714150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.714259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.714376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.714403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.714516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.714602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.714633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.714759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.714853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.714879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.714990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.715101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.715132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.715251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.715360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.715390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.715498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.715589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.715623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.715714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.715823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.715850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.715943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.716061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.716087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.716203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.716302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.716328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.716442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.716555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.716580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.716704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.716790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.716816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.716933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.717010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.717037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.717153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.717265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.717291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.717407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.717549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.717576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.717683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.717773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.717801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.717913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.718061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.718088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.718181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.718272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.718299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.406 qpair failed and we were unable to recover it. 00:30:41.406 [2024-11-16 17:50:18.718441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.406 [2024-11-16 17:50:18.718555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.718582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.718709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.718829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.718856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.719002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.719134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.719160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.719275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.719381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.719408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.719495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.719608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.719656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.719740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.719848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.719875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.719968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.720044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.720074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.720228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.720315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.720342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.720434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.720568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.720594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.720712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.720822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.720856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.721008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.721103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.721134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.721230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.721328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.721359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.721511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.721643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.721700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.721835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.722003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.722033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.722165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.722271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.722302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.722409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.722540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.722570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.722695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.722872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.722906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.723049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.723185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.723215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.723371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.723474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.723509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.723610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.723733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.723763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.723855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.723969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.724001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.724155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.724284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.724315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.724463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.724572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.724607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.724774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.724897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.724926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.725048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.725198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.725226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.725369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.725541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.725570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.725678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.725806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.725835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.725946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.726106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.726137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.726293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.726427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.726460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.726597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.726756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.726787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.726907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.727191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.727401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.727605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.727893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.727980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.728006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.728130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.728254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.728286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.407 qpair failed and we were unable to recover it. 00:30:41.407 [2024-11-16 17:50:18.728382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.728499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.407 [2024-11-16 17:50:18.728529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.728666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.728769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.728798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.728941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.729068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.729096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.729219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.729323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.729354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.729510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.729604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.729645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.729821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.729940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.729967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.730063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.730149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.730195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.730366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.730494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.730529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.730674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.730758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.730790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.730921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.731031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.731058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.731180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.731299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.731332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.731434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.731527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.731559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.731688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.731779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.731811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.731947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.732114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.732148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.732305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.732437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.732470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.732607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.732721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.732750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.732852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.732971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.733004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.733141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.733239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.733271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.733371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.733464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.733494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.733630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.733772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.733802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.733907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.733995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.734023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.734140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.734291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.734338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.734481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.734625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.734655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.734754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.734842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.734869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.734955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.735096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.735122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.735263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.735354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.735381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.735475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.735575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.735603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.735710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.735824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.735852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.735939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.736048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.736075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.736168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.736285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.736315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.736400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.736484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.736512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.736637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.736758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.736785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.736873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.737022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.737049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.737137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.737257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.408 [2024-11-16 17:50:18.737284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.408 qpair failed and we were unable to recover it. 00:30:41.408 [2024-11-16 17:50:18.737400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.737514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.737540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.737641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.737729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.737756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.737854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.737965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.737996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.738086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.738198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.738225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.738315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.738430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.738457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.738537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.738652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.738679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.738801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.738887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.738914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.739053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.739192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.739220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.739361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.739475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.739502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.739621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.739723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.739753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.739920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.740117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.740351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.740606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.740820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.740953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.741039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.741150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.741176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.741318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.741429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.741459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.409 [2024-11-16 17:50:18.741558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.741691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.409 [2024-11-16 17:50:18.741719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.409 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.741809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.741904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.741933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.742047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.742165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.742191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.742281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.742397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.742423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.742512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.742630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.742665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.742754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.742845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.742877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.742964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.743229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.743428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.743657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.743843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.743974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.744087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.744377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.744577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.744868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.744990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.745080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.745194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.745220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.745360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.745449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.410 [2024-11-16 17:50:18.745475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.410 qpair failed and we were unable to recover it. 00:30:41.410 [2024-11-16 17:50:18.745560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.745672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.745699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.411 qpair failed and we were unable to recover it. 00:30:41.411 [2024-11-16 17:50:18.745818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.745941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.745968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.411 qpair failed and we were unable to recover it. 00:30:41.411 [2024-11-16 17:50:18.746083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.746194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.746221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.411 qpair failed and we were unable to recover it. 00:30:41.411 [2024-11-16 17:50:18.746326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.746408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.746440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.411 qpair failed and we were unable to recover it. 00:30:41.411 [2024-11-16 17:50:18.746530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.746673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.746701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.411 qpair failed and we were unable to recover it. 00:30:41.411 [2024-11-16 17:50:18.746789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.746875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.746901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.411 qpair failed and we were unable to recover it. 00:30:41.411 [2024-11-16 17:50:18.747016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.747152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.747178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.411 qpair failed and we were unable to recover it. 00:30:41.411 [2024-11-16 17:50:18.747274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.411 [2024-11-16 17:50:18.747358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.747386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.412 [2024-11-16 17:50:18.747505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.747595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.747634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.412 [2024-11-16 17:50:18.747766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.747877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.747904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.412 [2024-11-16 17:50:18.748026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.748113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.748139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.412 [2024-11-16 17:50:18.748283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.748383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.748410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.412 [2024-11-16 17:50:18.748552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.748688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.748733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.412 [2024-11-16 17:50:18.748826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.748946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.748977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.412 [2024-11-16 17:50:18.749069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.749189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.749216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.412 [2024-11-16 17:50:18.749305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.749417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.412 [2024-11-16 17:50:18.749443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.412 qpair failed and we were unable to recover it. 00:30:41.413 [2024-11-16 17:50:18.749565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.749715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.749743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.413 qpair failed and we were unable to recover it. 00:30:41.413 [2024-11-16 17:50:18.749863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.749960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.749987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.413 qpair failed and we were unable to recover it. 00:30:41.413 [2024-11-16 17:50:18.750108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.750221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.750247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.413 qpair failed and we were unable to recover it. 00:30:41.413 [2024-11-16 17:50:18.750389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.750477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.750503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.413 qpair failed and we were unable to recover it. 00:30:41.413 [2024-11-16 17:50:18.750590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.750697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.750726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.413 qpair failed and we were unable to recover it. 00:30:41.413 [2024-11-16 17:50:18.750825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.750952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.750978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.413 qpair failed and we were unable to recover it. 00:30:41.413 [2024-11-16 17:50:18.751064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.751156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.413 [2024-11-16 17:50:18.751183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.414 qpair failed and we were unable to recover it. 00:30:41.414 [2024-11-16 17:50:18.751300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.751419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.751453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.414 qpair failed and we were unable to recover it. 00:30:41.414 [2024-11-16 17:50:18.751556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.751676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.751703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.414 qpair failed and we were unable to recover it. 00:30:41.414 [2024-11-16 17:50:18.751793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.751918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.751944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.414 qpair failed and we were unable to recover it. 00:30:41.414 [2024-11-16 17:50:18.752026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.752105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.752132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.414 qpair failed and we were unable to recover it. 00:30:41.414 [2024-11-16 17:50:18.752225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.752344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.752371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.414 qpair failed and we were unable to recover it. 00:30:41.414 [2024-11-16 17:50:18.752457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.752569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.752595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.414 qpair failed and we were unable to recover it. 00:30:41.414 [2024-11-16 17:50:18.752728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.414 [2024-11-16 17:50:18.752844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.752881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.753024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.753143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.753169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.753292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.753383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.753411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.753511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.753651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.753683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.753777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.753895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.753925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.754037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.754176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.754205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.754300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.754389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.754414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.754500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.754579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.754604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.754728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.754846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.754879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.415 [2024-11-16 17:50:18.754969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.755108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.415 [2024-11-16 17:50:18.755134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.415 qpair failed and we were unable to recover it. 00:30:41.416 [2024-11-16 17:50:18.755225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.755336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.755362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.416 qpair failed and we were unable to recover it. 00:30:41.416 [2024-11-16 17:50:18.755479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.755588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.755614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.416 qpair failed and we were unable to recover it. 00:30:41.416 [2024-11-16 17:50:18.755716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.755805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.755833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.416 qpair failed and we were unable to recover it. 00:30:41.416 [2024-11-16 17:50:18.755922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.756067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.756093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.416 qpair failed and we were unable to recover it. 00:30:41.416 [2024-11-16 17:50:18.756211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.756352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.416 [2024-11-16 17:50:18.756379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.416 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.756480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.756564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.756592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.756691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.756806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.756833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.756950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.757164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.757365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.757582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.757841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.757991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.758076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.758168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.758193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.758303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.758400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.758426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.758510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.758592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.758627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.758766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.758885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.758911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.758998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.759088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.759114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.759205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.759321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.759350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.759442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.759558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.759584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.759711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.759786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.759811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.759932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.760047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.760074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.760189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.760306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.760332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.760446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.760539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.760566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.417 qpair failed and we were unable to recover it. 00:30:41.417 [2024-11-16 17:50:18.760705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.760850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.417 [2024-11-16 17:50:18.760891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.761007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.761129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.761157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.761275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.761367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.761394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.761514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.761628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.761666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.761789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.761880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.761906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.762014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.762126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.762154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.762273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.762415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.762442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.762557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.762686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.762713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.762800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.762939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.762969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.763129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.763217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.763243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.763363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.763479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.763509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.763633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.763736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.763762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.763847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.763939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.763965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.764050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.764145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.764172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.764275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.764388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.764415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.764504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.764594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.764630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.764730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.764839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.764877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.764958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.765183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.765402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.765633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.765885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.765992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.766136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.766361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.766612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.766840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.766964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.767081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.767190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.767217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.767331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.767420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.767447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.767587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.767691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.767718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.767806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.767944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.767971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.768090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.768197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.768224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.418 qpair failed and we were unable to recover it. 00:30:41.418 [2024-11-16 17:50:18.768364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.418 [2024-11-16 17:50:18.768473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.768500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.768598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.768695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.768723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.768843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.768928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.768954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.769096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.769235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.769262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.769342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.769457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.769482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.769596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.769717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.769762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.769847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.769976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.770087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.770380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.770591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.770830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.419 [2024-11-16 17:50:18.770939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.419 qpair failed and we were unable to recover it. 00:30:41.419 [2024-11-16 17:50:18.771035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.771112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.771138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.420 qpair failed and we were unable to recover it. 00:30:41.420 [2024-11-16 17:50:18.771245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.771322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.771348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.420 qpair failed and we were unable to recover it. 00:30:41.420 [2024-11-16 17:50:18.771456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.771593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.771628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.420 qpair failed and we were unable to recover it. 00:30:41.420 [2024-11-16 17:50:18.771763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.771855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.771889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.420 qpair failed and we were unable to recover it. 00:30:41.420 [2024-11-16 17:50:18.772010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.772156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.772182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.420 qpair failed and we were unable to recover it. 00:30:41.420 [2024-11-16 17:50:18.772268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.772365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.772391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.420 qpair failed and we were unable to recover it. 00:30:41.420 [2024-11-16 17:50:18.772477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.772556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.772582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.420 qpair failed and we were unable to recover it. 00:30:41.420 [2024-11-16 17:50:18.772707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.420 [2024-11-16 17:50:18.772815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.772843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.421 qpair failed and we were unable to recover it. 00:30:41.421 [2024-11-16 17:50:18.772994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.773109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.773135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.421 qpair failed and we were unable to recover it. 00:30:41.421 [2024-11-16 17:50:18.773213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.773324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.773351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.421 qpair failed and we were unable to recover it. 00:30:41.421 [2024-11-16 17:50:18.773463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.773587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.773614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.421 qpair failed and we were unable to recover it. 00:30:41.421 [2024-11-16 17:50:18.773770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.773898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.421 [2024-11-16 17:50:18.773925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.421 qpair failed and we were unable to recover it. 00:30:41.422 [2024-11-16 17:50:18.774048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.774139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.774166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.422 qpair failed and we were unable to recover it. 00:30:41.422 [2024-11-16 17:50:18.774308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.774427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.774452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.422 qpair failed and we were unable to recover it. 00:30:41.422 [2024-11-16 17:50:18.774540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.774659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.774686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.422 qpair failed and we were unable to recover it. 00:30:41.422 [2024-11-16 17:50:18.774827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.774959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.774985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.422 qpair failed and we were unable to recover it. 00:30:41.422 [2024-11-16 17:50:18.775103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.775188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.775214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.422 qpair failed and we were unable to recover it. 00:30:41.422 [2024-11-16 17:50:18.775339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.422 [2024-11-16 17:50:18.775418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.775444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.423 qpair failed and we were unable to recover it. 00:30:41.423 [2024-11-16 17:50:18.775528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.775627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.775664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.423 qpair failed and we were unable to recover it. 00:30:41.423 [2024-11-16 17:50:18.775756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.775871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.775899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.423 qpair failed and we were unable to recover it. 00:30:41.423 [2024-11-16 17:50:18.775994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.776085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.776112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.423 qpair failed and we were unable to recover it. 00:30:41.423 [2024-11-16 17:50:18.776222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.776333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.776360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.423 qpair failed and we were unable to recover it. 00:30:41.423 [2024-11-16 17:50:18.776443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.776583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.776610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.423 qpair failed and we were unable to recover it. 00:30:41.423 [2024-11-16 17:50:18.776789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.776903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.423 [2024-11-16 17:50:18.776930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.423 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.777017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.777155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.777182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.424 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.777328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.777449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.777476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.424 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.777626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.777763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.777807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.424 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.777933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.778061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.778107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.424 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.778223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.778339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.778365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.424 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.778508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.778593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.778627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.424 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.778772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.778861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.778887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.424 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.778994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.779110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.779136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.424 qpair failed and we were unable to recover it. 00:30:41.424 [2024-11-16 17:50:18.779245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.424 [2024-11-16 17:50:18.779361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.779387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.425 qpair failed and we were unable to recover it. 00:30:41.425 [2024-11-16 17:50:18.779467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.779584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.779610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.425 qpair failed and we were unable to recover it. 00:30:41.425 [2024-11-16 17:50:18.779703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.779819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.779845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.425 qpair failed and we were unable to recover it. 00:30:41.425 [2024-11-16 17:50:18.779961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.780040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.780066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.425 qpair failed and we were unable to recover it. 00:30:41.425 [2024-11-16 17:50:18.780147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.780236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.780261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.425 qpair failed and we were unable to recover it. 00:30:41.425 [2024-11-16 17:50:18.780403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.780516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.780543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.425 qpair failed and we were unable to recover it. 00:30:41.425 [2024-11-16 17:50:18.780648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.780758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.780785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.425 qpair failed and we were unable to recover it. 00:30:41.425 [2024-11-16 17:50:18.780898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.425 [2024-11-16 17:50:18.781019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.781045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.426 qpair failed and we were unable to recover it. 00:30:41.426 [2024-11-16 17:50:18.781161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.781281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.781308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.426 qpair failed and we were unable to recover it. 00:30:41.426 [2024-11-16 17:50:18.781424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.781534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.781562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.426 qpair failed and we were unable to recover it. 00:30:41.426 [2024-11-16 17:50:18.781661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.781766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.781793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.426 qpair failed and we were unable to recover it. 00:30:41.426 [2024-11-16 17:50:18.781880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.782021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.782047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.426 qpair failed and we were unable to recover it. 00:30:41.426 [2024-11-16 17:50:18.782136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.782279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.782306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.426 qpair failed and we were unable to recover it. 00:30:41.426 [2024-11-16 17:50:18.782386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.782501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.426 [2024-11-16 17:50:18.782527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.426 qpair failed and we were unable to recover it. 00:30:41.426 [2024-11-16 17:50:18.782622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.782706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.782733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.782854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.782939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.782966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.783088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.783173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.783199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.783288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.783370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.783396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.783486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.783607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.783641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.783752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.783869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.783896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.784048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.784136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.784163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.784272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.784364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.784391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.784512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.784603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.784663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.784775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.784900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.784926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.785041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.785183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.785209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.427 qpair failed and we were unable to recover it. 00:30:41.427 [2024-11-16 17:50:18.785298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.427 [2024-11-16 17:50:18.785405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.785432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.785528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.785625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.785653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.785744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.785887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.785914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.786025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.786141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.786171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.786252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.786365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.786392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.786471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.786579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.786605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.786740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.786886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.786913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.787022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.787139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.787167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.787253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.787369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.787396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.787539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.787658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.787686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.787767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.787883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.787911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.788032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.788146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.788173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.788284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.788399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.788425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.788500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.788621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.788652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.788763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.788848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.788874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.788970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.789063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.789089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.789207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.789300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.789327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.789470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.789614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.789647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.789811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.789921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.789947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.790062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.790149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.790177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.790298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.790417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.790442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.790522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.790604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.790636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.790733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.790814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.790841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.790958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.791100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.791131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.791247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.791338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.791366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.791482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.791574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.791601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.791747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.791862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.791890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.792012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.792102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.792129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.792212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.792323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.792349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.428 qpair failed and we were unable to recover it. 00:30:41.428 [2024-11-16 17:50:18.792480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.428 [2024-11-16 17:50:18.792590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.792625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.792722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.792835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.792861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.792955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.793093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.793120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.793241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.793327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.793352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.793441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.793556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.793589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.793724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.793874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.793900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.794013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.794103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.794128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.794234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.794321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.794346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.794460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.794568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.794595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.794694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.794836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.794862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.794977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.795094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.795121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.795236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.795359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.795385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.795531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.795614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.795650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.795828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.795987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.796128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.796385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.796637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.796866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.796972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.797088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.797197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.797223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.797331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.797409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.797435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.797578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.797713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.797739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.797884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.797974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.798090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.798323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.798536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.798770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.798936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.799027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.799100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.799126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.799215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.799331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.799358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.799476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.799592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.799625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.799741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.799825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.799851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.799962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.800104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.800129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.800238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.800348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.800373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.800455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.800578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.800604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.800736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.800828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.800855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.800947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.801063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.801089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.801205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.801347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.801373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.801469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.801552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.429 [2024-11-16 17:50:18.801579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.429 qpair failed and we were unable to recover it. 00:30:41.429 [2024-11-16 17:50:18.801724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.801810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.801840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.801960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.802056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.802082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.802165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.802254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.802282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.802405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.802487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.802513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.802633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.802746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.802773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.802894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.803112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.803395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.803607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.803806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.803923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.804042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.804128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.804156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.804299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.804393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.804420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.804529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.804622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.804648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.804756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.804833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.804858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.805004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.805112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.805139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.805258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.805369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.805396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.805481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.805579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.805605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.805747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.805860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.805887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.805985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.806073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.806099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.806214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.806328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.806355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.806475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.806560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.806586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.806688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.806787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.806813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.806899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.807005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.807030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.807117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.807201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.807227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.807348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.807466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.807495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.807643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.807758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.807785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.807931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.808011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.808037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.808155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.808239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.808265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.808386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.808527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.808554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.808641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.808775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.808818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.808943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.809210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.809434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.809653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.809880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.809984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.810082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.810166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.810193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.810277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.810353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.810379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.810490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.810573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.810600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.810712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.810823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.810855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.810987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.811109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.811139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.811267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.811390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.811422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.811521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.811640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.811670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.811799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.811909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.811940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.812080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.812232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.812262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.430 qpair failed and we were unable to recover it. 00:30:41.430 [2024-11-16 17:50:18.812403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.430 [2024-11-16 17:50:18.812537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.812573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.812696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.812794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.812829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.812956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.813084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.813120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.813222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.813350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.813379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.813507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.813625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.813656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.813775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.813870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.813897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.814014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.814126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.814158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.814293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.814415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.814451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.814590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.814733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.814761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.814855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.814981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.815010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.815207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.815341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.815384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.815542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.815686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.815713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.815859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.815958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.815995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.816129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.816271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.816300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.816420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.816554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.816587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.816723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.816816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.816855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.816969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.817098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.817146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.817305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.817429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.817461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.817576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.817715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.817743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.817864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.817947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.817977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.818074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.818163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.818209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.818329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.818450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.818481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.818643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.818752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.818782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.818898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.819050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.819080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.819229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.819357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.819387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.819499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.819586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.819612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.819714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.819826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.819852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.819942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.820168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.820376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.820577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.820801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.820914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.820998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.821090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.821116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.821203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.821316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.821343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.821432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.821580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.821607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.821723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.821818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.821843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.821985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.822069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.822096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.822211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.822305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.822330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.822443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.822555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.431 [2024-11-16 17:50:18.822584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.431 qpair failed and we were unable to recover it. 00:30:41.431 [2024-11-16 17:50:18.822687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.822775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.822801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.822895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.822980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.823091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.823296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.823496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.823745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.823862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.823952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.824180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.824409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.824636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.824857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.824997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.825141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.825353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.825554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.825773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.825890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.825997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.826218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.826440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.826647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.713 [2024-11-16 17:50:18.826899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.826983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.713 [2024-11-16 17:50:18.827010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.713 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.827121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.827196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.827222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.827338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.827431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.827457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.827571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.827698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.827726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.827826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.827931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.827957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.828076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.828188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.828214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.828305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.828442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.828473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.828560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.828681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.828707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.828824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.828912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.828939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.829067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.829151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.829178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.829266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.829358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.829385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.829471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.829591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.829624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.829712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.829830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.829857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.830013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.830093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.830119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.830233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.830349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.830378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.830465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.830551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.830577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.830720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.830801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.830832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.830922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.831041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.831068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.831186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.831272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.831299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.831411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.831528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.831554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.831635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.831787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.831813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.831925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.832020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.832049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.832165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.832287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.832313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.832422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.832514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.832541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.832652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.832783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.832810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.832925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.833034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.833061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.833177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.833265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.833296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.833438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.833539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.833567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.833670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.833789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.714 [2024-11-16 17:50:18.833816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.714 qpair failed and we were unable to recover it. 00:30:41.714 [2024-11-16 17:50:18.833916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.833999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.834025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.834122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.834263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.834290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.834408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.834527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.834553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.834665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.834780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.834810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.834902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.835047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.835075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.835216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.835347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.835374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.835496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.835600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.835633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.835730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.835817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.835843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.835941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.836028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.836055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.836173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.836287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.836316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.836402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.836520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.836548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.836667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.836812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.836838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.836956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.837161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.837365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.837587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.837884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.837992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.838086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.838198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.838225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.838351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.838469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.838496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.838610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.838737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.838764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.838860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.838946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.838973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.839053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.839135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.839164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.839287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.839377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.839404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.839486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.839578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.839605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.839773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.839855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.839883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.840006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.840127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.840155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.840270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.840392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.840419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.840511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.840632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.840673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.715 qpair failed and we were unable to recover it. 00:30:41.715 [2024-11-16 17:50:18.840808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.715 [2024-11-16 17:50:18.840924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.840950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.841042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.841156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.841185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.841327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.841451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.841477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.841570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.841693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.841720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.841809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.841903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.841930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.842046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.842163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.842190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.842303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.842443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.842470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.842590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.842711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.842738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.842853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.843004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.843032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.843145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.843266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.843293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.843412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.843519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.843546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.843679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.843771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.843798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.843884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.844005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.844031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.844173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.844293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.844321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.844447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.844527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.844553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.844663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.844759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.844786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.844941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.845082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.845108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.845221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.845335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.845363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.845474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.845586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.845612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.845735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.845851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.845886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.846006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.846124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.846151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.846257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.846366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.846393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.846533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.846646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.846678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.846791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.846888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.846915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.847032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.847177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.847204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.847313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.847430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.847456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.847594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.847749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.847777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.847906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.848057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.848084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.716 [2024-11-16 17:50:18.848200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.848318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.716 [2024-11-16 17:50:18.848345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.716 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.848464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.848556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.848582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.848733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.848846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.848874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.848989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.849083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.849111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.849224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.849335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.849362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.849479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.849597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.849633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.849757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.849864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.849899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.850012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.850121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.850148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.850227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.850319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.850345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.850430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.850575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.850601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.850733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.850853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.850885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.851028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.851147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.851175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.851334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.851452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.851479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.851630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.851775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.851821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.851955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.852077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.852107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.852275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.852369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.852397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.852488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.852573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.852601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.852756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.852873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.852899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.853044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.853135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.853162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.853279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.853422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.853449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.853564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.853706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.853751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.853864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.854027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.854056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.854217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.854335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.854362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.854503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.854624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.854664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.854828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.854972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.717 [2024-11-16 17:50:18.854998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.717 qpair failed and we were unable to recover it. 00:30:41.717 [2024-11-16 17:50:18.855114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.855223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.855250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.855368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.855486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.855513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.855629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.855756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.855782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.855900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.856178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.856400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.856600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.856875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.856987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.857099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.857175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.857202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.857343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.857421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.857447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.857539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.857631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.857669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.857780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.857894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.857921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.858003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.858121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.858149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.858262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.858371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.858398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.858542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.858630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.858670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.858782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.858893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.858920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.859034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.859126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.859152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.859275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.859419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.859446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.859567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.859726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.859752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.859870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.859990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.860016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.860136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.860256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.860283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.860402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.860516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.860543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.860687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.860794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.860821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.860941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.861054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.861080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.861206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.861297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.861323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.861437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.861531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.861559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.861726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.861871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.861919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.862063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.862156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.862183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.718 qpair failed and we were unable to recover it. 00:30:41.718 [2024-11-16 17:50:18.862325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.718 [2024-11-16 17:50:18.862454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.862480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.862586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.862701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.862746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.862909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.863091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.863135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.863252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.863366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.863392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.863504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.863595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.863631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.863728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.863857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.863911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.864069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.864182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.864210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.864331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.864420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.864447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.864556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.864676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.864703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.864822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.864936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.864967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.865117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.865228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.865255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.865352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.865472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.865499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.865612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.865758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.865784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.865900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.866017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.866043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.866190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.866302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.866328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.866417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.866529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.866555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.866641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.866816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.866860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.866987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.867144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.867171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.867286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.867377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.867404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.867523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.867611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.867665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.867786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.867943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.867969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.868088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.868200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.868226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.868317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.868454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.868481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.868567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.868726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.868771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.868894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.868998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.869025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.869113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.869223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.869249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.869343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.869455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.869482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.869565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.869667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.869695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.719 qpair failed and we were unable to recover it. 00:30:41.719 [2024-11-16 17:50:18.869837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.869987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.719 [2024-11-16 17:50:18.870013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.870126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.870237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.870269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.870383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.870475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.870503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.870628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.870750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.870778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.870906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.870994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.871020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.871161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.871270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.871297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.871376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.871461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.871488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.871563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.871673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.871700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.871844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.871988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.872014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.872136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.872287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.872313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.872410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.872502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.872529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.872623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.872739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.872770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.872902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.872988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.873015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.873157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.873299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.873325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.873414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.873553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.873580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.873742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.873894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.873939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.874087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.874205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.874233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.874321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.874467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.874494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.874641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.874746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.874771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.874899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.875024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.875051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.875191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.875304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.875332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.875450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.875592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.875625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.875740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.875902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.875929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.876040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.876201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.876228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.876345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.876462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.876489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.876599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.876749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.876776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.876916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.877104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.877150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.877260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.877419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.877446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.877560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.877647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.720 [2024-11-16 17:50:18.877675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.720 qpair failed and we were unable to recover it. 00:30:41.720 [2024-11-16 17:50:18.877804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.877964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.878014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.878134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.878247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.878274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.878389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.878505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.878532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.878674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.878810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.878837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.878927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.879175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.879403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.879656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.879884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.879989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.880112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.880205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.880232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.880315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.880421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.880447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.880527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.880665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.880691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.880774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.880914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.880940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.881064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.881211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.881238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.881353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.881465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.881492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.881608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.881740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.881767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.881913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.881997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.882114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.882391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.882643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.882865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.882985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.883083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.883171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.883198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.883341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.883423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.883450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.883581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.883679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.883707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.883847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.883988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.884015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.884131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.884218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.884246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.884365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.884458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.884484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.884627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.884761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.884805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.721 qpair failed and we were unable to recover it. 00:30:41.721 [2024-11-16 17:50:18.884945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.885054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.721 [2024-11-16 17:50:18.885080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.885190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.885303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.885330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.885442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.885554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.885581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.885684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.885793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.885820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.885942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.886084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.886111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.886235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.886324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.886352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.886465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.886573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.886600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.886694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.886854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.886899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.887042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.887126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.887154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.887281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.887432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.887458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.887575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.887712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.887756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.887899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.888047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.888091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.888231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.888349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.888376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.888460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.888596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.888631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.888786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.888918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.888961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.889103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.889260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.889286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.889406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.889523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.889549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.889661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.889793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.889823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.889951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.890099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.890126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.890268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.890350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.890376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.890490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.890642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.890670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.890775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.890903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.890930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.891044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.891130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.891156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.891232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.891313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.891341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.891436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.891543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.722 [2024-11-16 17:50:18.891569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.722 qpair failed and we were unable to recover it. 00:30:41.722 [2024-11-16 17:50:18.891729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.891823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.891849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.891968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.892200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.892390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.892609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.892892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.892974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.893090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.893325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.893520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.893774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.893884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.893999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.894142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.894168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.894260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.894375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.894401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.894488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.894603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.894638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.894720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.894883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.894910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.895054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.895145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.895173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.895260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.895370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.895396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.895489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.895596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.895642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.895732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.895846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.895872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.895951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.896064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.896091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.896208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.896322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.896350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.896468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.896559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.896586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.896690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.896800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.896827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.896933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.897045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.897071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.897187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.897299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.897327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.897412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.897518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.897544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.897652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.897776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.897803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.897884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.898005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.898031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.898145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.898266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.898292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.723 qpair failed and we were unable to recover it. 00:30:41.723 [2024-11-16 17:50:18.898412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.898494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.723 [2024-11-16 17:50:18.898521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.898632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.898740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.898766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.898852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.898973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.898999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.899114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.899202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.899228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.899317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.899407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.899435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.899623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.899746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.899773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.899867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.899977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.900004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.900088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.900235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.900262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.900375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.900491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.900518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.900601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.900747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.900774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.900896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.900980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.901117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.901373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.901568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.901801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.901913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.902019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.902126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.902152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.902266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.902377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.902402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.902525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.902665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.902691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.902817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.902928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.902953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.903069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.903211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.903238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.903329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.903446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.903473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.903591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.903712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.903740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.903857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.904005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.904031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.904154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.904245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.904272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.904388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.904531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.904558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.904672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.904785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.904811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.904928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.905072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.905099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.905190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.905303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.905328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.905470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.905547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.724 [2024-11-16 17:50:18.905574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.724 qpair failed and we were unable to recover it. 00:30:41.724 [2024-11-16 17:50:18.905700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.905840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.905866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.905960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.906100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.906127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.906236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.906352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.906379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.906509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.906629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.906660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.906798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.906951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.906994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.907109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.907258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.907285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.907379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.907496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.907523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.907611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.907735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.907761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.907878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.907970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.907997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.908109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.908224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.908250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.908365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.908486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.908511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.908608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.908730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.908756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.908844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.908963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.908989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.909104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.909188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.909218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.909311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.909420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.909447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.909555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.909667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.909695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.909809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.909960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.909986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.910129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.910245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.910271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.910359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.910480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.910506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.910613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.910739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.910784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.910906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.911021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.911047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.911202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.911348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.911375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.911515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.911595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.911652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.911761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.911914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.911962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.912056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.912142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.912168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.912291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.912403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.912430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.912516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.912642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.912670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.725 qpair failed and we were unable to recover it. 00:30:41.725 [2024-11-16 17:50:18.912800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.725 [2024-11-16 17:50:18.912902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.912927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.913014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.913122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.913148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.913242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.913319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.913346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.913426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.913542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.913568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.913712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.913823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.913849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.913994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.914086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.914111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.914244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.914320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.914353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.914444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.914586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.914612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.914769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.914885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.914912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.915054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.915171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.915197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.915318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.915414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.915440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.915533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.915641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.915668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.915784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.915920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.915946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.916062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.916185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.916211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.916329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.916439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.916466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.916606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.916701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.916728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.916875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.916998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.917023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.917139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.917257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.917283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.917379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.917457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.917483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.917596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.917722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.917748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.917872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.917981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.918093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.918335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.918579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.918820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.918930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.919041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.919126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.919153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.919261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.919344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.919369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.919481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.919569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.726 [2024-11-16 17:50:18.919597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.726 qpair failed and we were unable to recover it. 00:30:41.726 [2024-11-16 17:50:18.919744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.919859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.919886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.919975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.920064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.920090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.920207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.920326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.920354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.920471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.920558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.920584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.920713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.920804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.920831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.920928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.921017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.921044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.921166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.921281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.921307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.921417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.921524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.921550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.921699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.921866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.921916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.922073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.922213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.922239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.922353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.922473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.922499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.922663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.922826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.922870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.923009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.923115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.923140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.923255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.923362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.923387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.923483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.923589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.923614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.923734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.923820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.923846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.923931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.924185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.924424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.924632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.924827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.924934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.925042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.925125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.925151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.727 qpair failed and we were unable to recover it. 00:30:41.727 [2024-11-16 17:50:18.925240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.925328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.727 [2024-11-16 17:50:18.925354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.925439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.925549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.925575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.925697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.925780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.925806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.925894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.926032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.926058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.926178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.926316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.926342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.926458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.926549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.926575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.926717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.926852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.926878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.927027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.927122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.927148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.927263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.927352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.927378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.927499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.927613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.927657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.927773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.927865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.927893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.928005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.928114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.928141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.928262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.928340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.928366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.928479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.928629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.928656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.928743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.928883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.928909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.929027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.929144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.929170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.929290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.929384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.929410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.929560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.929680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.929724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.929855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.930145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.930363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.930649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.930845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.930981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.931097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.931186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.931211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.931327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.931405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.931431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.931543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.931662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.931689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.931778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.931921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.931947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.728 [2024-11-16 17:50:18.932044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.932152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.728 [2024-11-16 17:50:18.932179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.728 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.932261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.932377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.932403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.932515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.932634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.932662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.932778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.932886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.932911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.932986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.933106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.933132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.933254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.933360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.933386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.933509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.933648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.933674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.933799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.933890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.933916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.934029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.934152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.934178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.934266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.934386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.934412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.934503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.934597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.934628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.934721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.934798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.934825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.934943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.935049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.935076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.935194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.935319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.935346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.935466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.935581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.935608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.935753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.935886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.935913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.936035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.936155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.936181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.936299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.936406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.936431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.936571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.936664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.936691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.936835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.936929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.936955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.937070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.937189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.937216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.937307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.937448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.937475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.937590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.937691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.937719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.937803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.937941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.937967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.938122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.938242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.938269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.938387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.938483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.938510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.938598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.938747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.938775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.938900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.939034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.939060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.729 qpair failed and we were unable to recover it. 00:30:41.729 [2024-11-16 17:50:18.939203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.729 [2024-11-16 17:50:18.939311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.939337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.939453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.939538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.939565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.939671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.939812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.939839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.939934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.940048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.940074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.940188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.940299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.940325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.940402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.940543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.940570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.940694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.940812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.940839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.940979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.941117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.941144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.941237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.941355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.941381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.941511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.941636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.941664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.941773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.941879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.941906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.942020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.942135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.942161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.942311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.942430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.942456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.942579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.942671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.942697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.942837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.942998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.943041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.943158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.943274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.943299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.943421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.943558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.943584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.943758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.943847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.943873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.943988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.944105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.944132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.944282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.944402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.944429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.944537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.944631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.944660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.944763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.944863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.944890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.945031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.945174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.945200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.945316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.945430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.945456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.945548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.945656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.945683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.945766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.945872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.945898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.730 [2024-11-16 17:50:18.946010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.946151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.730 [2024-11-16 17:50:18.946176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.730 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.946289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.946432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.946458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.946580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.946677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.946704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.946845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.946967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.946993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.947159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.947259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.947285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.947397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.947545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.947570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.947689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.947873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.947923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.948054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.948203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.948238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.948380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.948458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.948484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.948602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.948712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.948739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.948880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.949171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.949421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.949641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.949830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.949938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.950031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.950181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.950208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.950348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.950466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.950497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.950593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.950721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.950749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.950836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.950946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.950973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.951067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.951179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.951205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.951283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.951392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.951417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.951503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.951584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.951611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.951773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.951893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.951919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.952028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.952148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.952174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.952315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.952456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.952482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.952628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.952800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.952848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.731 qpair failed and we were unable to recover it. 00:30:41.731 [2024-11-16 17:50:18.952933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.953052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.731 [2024-11-16 17:50:18.953085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.953205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.953349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.953375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.953454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.953542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.953570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.953721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.953855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.953883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.954003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.954128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.954155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.954271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.954354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.954380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.954492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.954607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.954643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.954788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.954906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.954933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.955048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.955167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.955193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.955336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.955423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.955452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.955543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.955644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.955672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.955763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.955872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.955899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.956042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.956184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.956211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.956322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.956441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.956468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.956558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.956696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.956724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.956841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.956975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.957002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.957146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.957236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.957263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.957408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.957524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.957551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.957665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.957777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.957805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.957921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.958014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.958041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.958151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.958261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.958287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.958376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.958489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.958516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.732 qpair failed and we were unable to recover it. 00:30:41.732 [2024-11-16 17:50:18.958659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.958775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.732 [2024-11-16 17:50:18.958802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.958921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.959126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.959357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.959585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.959843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.959956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.960050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.960166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.960194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.960282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.960387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.960413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.960554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.960669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.960697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.960847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.960967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.960993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.961112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.961209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.961235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.961318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.961432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.961460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.961575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.961690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.961717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.961810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.961887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.961912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.962035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.962154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.962180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.962294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.962379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.962406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.962494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.962573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.962599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.962692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.962830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.962857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.962954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.963101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.963127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.963277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.963424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.963450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.963562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.963731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.963761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.963890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.964047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.964075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.964193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.964312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.964339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.964454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.964551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.964578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.964704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.964835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.964879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.964976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.965061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.965088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.733 qpair failed and we were unable to recover it. 00:30:41.733 [2024-11-16 17:50:18.965177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.965318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.733 [2024-11-16 17:50:18.965343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.965486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.965604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.965640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.965759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.965874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.965901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.966025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.966164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.966190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.966312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.966431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.966458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.966540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.966669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.966700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.966849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.966985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.967012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.967119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.967200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.967228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.967339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.967481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.967507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.967628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.967745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.967771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.967912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.967995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.968021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.968109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.968262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.968289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.968432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.968555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.968581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.968681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.968813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.968858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.968937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.969028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.969057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.969194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.969312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.969338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.969453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.969593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.969625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.969757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.969865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.969892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.970028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.970184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.970211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.970326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.970466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.970492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.970599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.970699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.970726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.970811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.970949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.970975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.971068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.971175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.971202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.971351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.971471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.971498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.971612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.971744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.971772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.971914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.972006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.972033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.972125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.972213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.972239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.972325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.972447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.972473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.734 qpair failed and we were unable to recover it. 00:30:41.734 [2024-11-16 17:50:18.972584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.734 [2024-11-16 17:50:18.972699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.972725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.972819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.972935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.972963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.973057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.973153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.973180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.973296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.973384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.973411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.973528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.973603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.973642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.973765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.973885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.973911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.973998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.974135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.974162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.974239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.974320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.974347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.974468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.974621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.974649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.974763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.974857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.974884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.975005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.975121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.975148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.975291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.975406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.975433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.975578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.975670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.975697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.975817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.975930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.975957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.976102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.976210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.976237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.976317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.976435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.976463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.976580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.976732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.976760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.976876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.977025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.977052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.977216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.977372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.977398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.977539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.977674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.977704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.977862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.978020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.978051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.978183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.978304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.978331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.978451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.978560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.978585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.978668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.978774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.978803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.978912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.979019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.735 [2024-11-16 17:50:18.979046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.735 qpair failed and we were unable to recover it. 00:30:41.735 [2024-11-16 17:50:18.979153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.979298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.979325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.979471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.979583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.979609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.979763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.979874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.979901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.980018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.980132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.980159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.980280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.980386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.980411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.980498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.980585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.980610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.980762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.980874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.980900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.981013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.981102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.981129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.981247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.981400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.981426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.981540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.981660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.981687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.981804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.981921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.981947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.982066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.982160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.982186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.982294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.982413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.982439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.982524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.982641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.982668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.982809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.982922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.982948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.983088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.983178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.983204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.983314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.983453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.983479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.983593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.983765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.983811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.983921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.984054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.984081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.984238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.984358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.984384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.984497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.984644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.984671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.984787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.984921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.984948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.985031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.985112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.985138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.985277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.985370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.985397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.985491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.985607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.985642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.736 qpair failed and we were unable to recover it. 00:30:41.736 [2024-11-16 17:50:18.985756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.736 [2024-11-16 17:50:18.985841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.985867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.985980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.986057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.986083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.986201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.986292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.986318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.986410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.986524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.986554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.986666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.986755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.986781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.986904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.987045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.987075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.987169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.987257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.987283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.987395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.987511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.987539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.987645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.987787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.987813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.987954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.988066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.988092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.988174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.988287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.988313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.988402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.988520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.988547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.988665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.988777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.988803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.988942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.989059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.989086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.989202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.989291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.989317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.989434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.989520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.989552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.989695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.989786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.989812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.989897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.990003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.990030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.990170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.990319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.990345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.990474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.990587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.990613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.990740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.990847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.990872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.990993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.991085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.991111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.991252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.991336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.991363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.737 qpair failed and we were unable to recover it. 00:30:41.737 [2024-11-16 17:50:18.991476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.991563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.737 [2024-11-16 17:50:18.991589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.991687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.992198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.992229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.992358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.992499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.992530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.992648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.992752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.992778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.992891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.992998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.993118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.993349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.993585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.993884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.993992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.994105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.994196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.994223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.994341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.994453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.994480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.994595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.994707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.994734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.994813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.994931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.994967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.995063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.995178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.995204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.995304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.995417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.995444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.995564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.995656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.995684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.995836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.995983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.996010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.996124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.996240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.996266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.996354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.996468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.996494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.996627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.996798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.996842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.738 qpair failed and we were unable to recover it. 00:30:41.738 [2024-11-16 17:50:18.997027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.738 [2024-11-16 17:50:18.997178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.997204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.997315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.997398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.997423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.997564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.997647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.997682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.997846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.997999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.998041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.998136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.998219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.998245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.998389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.998467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.998494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.998637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.998771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.998816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.998925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.999037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.999065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.999186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.999299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.999325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.999441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.999578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.999603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:18.999777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.999923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:18.999955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.000080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.000177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.000204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.000325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.000415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.000441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.000528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.000636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.000664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.000749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.000865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.000892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.000998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.001140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.001165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.001313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.001425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.001451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.001595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.001700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.001727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.001871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.001979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.002005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.002147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.002262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.002288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.739 [2024-11-16 17:50:19.002402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.002493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.739 [2024-11-16 17:50:19.002520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.739 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.002635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.002773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.002799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.002885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.002998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.003153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.003366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.003568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.003829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.003944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.004054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.004174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.004201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.004277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.004364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.004391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.004480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.004598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.004641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.004764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.005220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.005251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.005394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.005514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.005540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.005643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.005736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.005763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.005888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.005978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.006004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.006087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.006175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.006200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.006323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.006406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.006432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.006581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.006730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.006757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.006845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.006996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.007113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.007367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.007579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.007816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.007959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.008074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.008183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.008209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.740 qpair failed and we were unable to recover it. 00:30:41.740 [2024-11-16 17:50:19.008303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.740 [2024-11-16 17:50:19.008391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.008417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.008531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.008689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.008716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.008809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.008925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.008952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.009069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.009184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.009210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.009325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.009412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.009437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.009546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.009627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.009654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.009738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.009852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.009880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.009997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.010110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.010138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.010258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.010374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.010401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.010517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.010633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.010660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.010756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.010836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.010863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.010978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.011087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.011119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.011235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.011326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.011352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.011463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.011553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.011579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.011672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.011791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.011817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.011911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.012024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.012050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.012192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.012310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.012336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.012454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.012545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.012572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.012749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.012865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.012898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.013020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.013138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.013165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.013256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.013341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.013367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.013486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.013595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.013629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.741 qpair failed and we were unable to recover it. 00:30:41.741 [2024-11-16 17:50:19.013750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.741 [2024-11-16 17:50:19.013838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.013865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.013987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.014127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.014154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.014270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.014398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.014424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.014543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.014633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.014672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.014762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.014905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.014948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.015078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.015231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.015257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.015380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.015521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.015547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.015646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.015782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.015825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.015993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.016202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.016266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.016404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.016547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.016573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.016685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.016787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.016816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.016921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.017034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.017063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.017220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.017379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.017407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.017502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.017654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.017703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.017782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.017914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.017942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.018104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.018255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.018283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.018378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.018502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.018530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.018685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.018767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.018793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.018886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.019060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.019090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.019185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.019317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.019355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.742 qpair failed and we were unable to recover it. 00:30:41.742 [2024-11-16 17:50:19.019476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.019556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.742 [2024-11-16 17:50:19.019581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.019704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.019817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.019844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.019984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.020100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.020129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.020281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.020406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.020435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.020594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.020710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.020736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.020827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.020971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.020999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.021137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.021247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.021275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.021382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.021471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.021500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.021601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.021722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.021748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.021841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.022024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.022050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.022179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.022306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.022334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.022433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.022536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.022575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.022703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.022814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.022839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.022968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.023066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.023099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.023225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.023361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.023388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.023557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.023692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.023720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.023837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.023983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.024149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.024365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.024596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.743 [2024-11-16 17:50:19.024853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.743 [2024-11-16 17:50:19.024999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.743 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.025133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.025247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.025275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.025433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.025541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.025570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.025714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.025800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.025825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.025946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.026080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.026105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.026242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.026338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.026382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.026527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.026672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.026698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.026783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.026919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.026948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.027053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.027198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.027227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.027346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.027429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.027457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.027585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.027733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.027759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.027844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.027987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.028015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.028109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.028193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.028222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.028339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.028440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.028468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.028568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.028710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.028738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.028853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.029001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.029030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.029255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.029377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.029404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.029503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.029604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.029642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.029770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.029881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.029910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.030046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.030210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.030254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.030480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.030631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.030686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.030828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.030997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.031026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.031165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.031307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.031336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.031436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.031564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.031592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.031744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.031883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.031928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.032088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.032202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.032230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.032359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.032448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.032477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.032612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.032782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.032808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.032925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.033007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.744 [2024-11-16 17:50:19.033037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.744 qpair failed and we were unable to recover it. 00:30:41.744 [2024-11-16 17:50:19.033145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.033322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.033348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.033493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.033621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.033650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.033796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.033870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.033903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.033998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.034133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.034162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.034269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.034441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.034468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.034628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.034772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.034797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.034916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.035007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.035033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.035158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.035278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.035321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.035437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.035533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.035560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.035678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.035769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.035799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.035941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.036085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.036112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.036284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.036403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.036430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.036533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.036634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.036660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.036749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.036865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.036892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.036981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.037096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.037123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.037237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.037368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.037397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.037535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.037674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.037700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.037782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.037898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.037926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.038055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.038209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.038237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.038365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.038495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.038539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.038692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.038806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.038831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.038947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.039030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.039059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.039162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.039313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.039341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.039464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.039558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.039587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.039737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.039884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.039910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.040043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.040168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.040197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.040336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.040499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.040528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.040642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.040740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.040765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.745 qpair failed and we were unable to recover it. 00:30:41.745 [2024-11-16 17:50:19.040855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.745 [2024-11-16 17:50:19.040944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.040969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.041122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.041230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.041259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.041379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.041503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.041531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.041680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.041768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.041793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.041870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.042012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.042038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.042180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.042314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.042342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.042435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.042562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.042591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.042742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.042828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.042856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.042963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.043048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.043091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.043224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.043315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.043344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.043495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.043646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.043690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.043773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.043852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.043879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.043959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.044066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.044092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.044253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.044339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.044378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.044468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.044574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.044602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.044740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.044830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.044856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.045033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.045197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.045225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.045381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.045469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.045497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.045592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.045737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.045764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.045852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.045974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.046001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.046131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.046216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.046245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.046403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.046511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.046558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.046655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.046782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.046809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.046904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.050639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.050694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.050818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.050960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.050990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.051169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.051304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.051347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.051485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.051670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.051700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.051799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.051893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.051921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.746 qpair failed and we were unable to recover it. 00:30:41.746 [2024-11-16 17:50:19.052062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.746 [2024-11-16 17:50:19.052207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.052250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.052380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.052518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.052547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.052686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.052780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.052806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.052949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.053058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.053086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.053334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.053440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.053470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.053595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.053747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.053775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.053866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.054003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.054039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.054160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.054296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.054326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.054504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.054596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.054631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.054746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.054851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.054882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.055012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.055140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.055171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.055303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.055415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.055443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.055550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.055640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.055668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.056398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.056546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.056577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.056713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.056805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.056831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.056941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.057048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.057077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.057178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.057310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.057339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.057440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.057563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.057591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.057727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.057806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.057832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.057996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.058109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.058136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.058332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.058474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.058501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.058624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.058703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.058730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.058813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.058897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.058924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.059014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.059106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.059132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.059265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.059380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.747 [2024-11-16 17:50:19.059407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.747 qpair failed and we were unable to recover it. 00:30:41.747 [2024-11-16 17:50:19.059487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.059570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.059595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.059690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.059780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.059806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.059916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.060141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.060381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.060648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.060850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.060991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.061111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.061251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.061277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.061392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.061507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.061533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.061679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.061823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.061855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.061966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.062099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.062130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.062278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.062457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.062503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.062583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.062671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.062699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.062802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.062929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.062957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.063102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.063208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.063237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.063344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.063463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.063489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.063584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.063682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.063712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.063812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.063898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.063925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.064066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.064181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.064209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.064307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.064425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.064452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.064545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.064659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.064686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.064773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.064863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.064889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.065007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.065123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.065150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.065849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.065973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.066100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.066415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.066623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.066850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.066996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-16 17:50:19.067108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.748 [2024-11-16 17:50:19.067200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.067229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.067316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.067439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.067466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.067608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.067744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.067771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.067870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.067969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.067997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.068141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.068263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.068290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.068411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.068522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.068550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.068650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.069341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.069374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.069514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.069640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.069670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.069758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.069844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.069872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.069993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.070122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.070149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.070240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.070362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.070388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.070508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.070603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.070644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.070745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.070866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.070892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.071002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.071109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.071138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.071228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.071321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.071347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.071464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.071543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.071571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.071665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.071776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.071803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.071904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.072068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.072097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.072195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.072287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.072317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.072418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.072515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.072544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.072670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.072782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.072809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.072922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.073023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.073052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.073147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.073262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.073291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.073388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.073499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.073527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.073638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.073749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.073775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.073888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.074010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.074038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.074161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.074318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.074348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.074472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.074594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.074639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-16 17:50:19.074748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.749 [2024-11-16 17:50:19.074835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.074860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.075023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.075148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.075177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.075269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.075368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.075397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.075526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.075656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.075684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.076395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.076489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.076517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.076675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.076768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.076793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.076945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.077050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.077076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.077156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.077298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.077327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.077449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.077546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.077574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.077689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.077775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.077802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.077900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.078047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.078077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.078240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.078352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.078385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.078484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.078581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.078609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.078729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.078818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.078849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.078983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.079102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.079131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.079250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.079384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.079412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.079515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.079610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.079659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.079745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.079879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.079907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.080061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.080151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.080186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.080306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.080424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.080459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.080548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.080641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.080686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.080773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.080855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.080883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.080976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.081160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.081189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.081292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.081422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.081455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.081550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.081666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.081694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.081797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.081917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.081947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.082035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.082153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.082182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.082311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.082465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.082492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-16 17:50:19.082589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.750 [2024-11-16 17:50:19.082751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.082777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.082865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.082993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.083122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.083363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.083594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.083838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.083967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.084054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.084161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.084187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.084333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.084414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.084440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.084521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.084614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.084649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.084735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.084844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.084871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.085000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.085117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.085146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.085286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.085421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.085449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.085546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.085686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.085713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.085794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.085910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.085938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.086027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.086130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.086159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.086262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.086387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.086416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.086552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.086648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.086682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.086802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.086927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.086955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.087047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.087172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.087201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.087284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.087433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.087462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.087561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.087661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.087712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.087834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.087926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.087951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.088030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.088116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.088139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.088254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.088367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.088390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.088486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.088575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.088598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.088722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.088840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.088865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.089006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.089104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.089133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.089251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.089371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.089399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.751 [2024-11-16 17:50:19.089487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.089574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.751 [2024-11-16 17:50:19.089602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.751 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.089724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.089800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.089825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.089965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.090051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.090078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.090214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.090335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.090364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.090461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.090562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.090592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.090711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.090830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.090856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.090974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.091093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.091118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.091209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.091343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.091371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.091496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.091602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.091683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.091781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.091866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.091892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.092015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.092139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.092182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.092284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.092386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.092415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.092514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.092630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.092657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.092827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.092927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.092956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.093079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.093167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.093197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.093325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.093424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.093451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.093560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.093654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.093687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.093795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.093892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.093929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.094051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.094137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.094165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.094259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.094376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.094404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.094510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.094640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.094686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.094772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.094856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.094881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.095028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.095135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.095164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.095296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.095394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.095423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.095537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.095626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.095652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.752 qpair failed and we were unable to recover it. 00:30:41.752 [2024-11-16 17:50:19.095749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.095869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.752 [2024-11-16 17:50:19.095894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.095993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.096079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.096105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.096248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.096351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.096380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.096502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.096600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.096636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.096784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.096894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.096922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.097087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.097185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.097213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.097369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.097493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.097522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.097672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.097755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.097780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.097872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.097967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.098123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.098344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.098647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.098861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.098998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.099141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.099228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.099254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.099361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.099495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.099524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.099629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.099736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.099763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.099883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.099992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.100018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.100112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.100231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.100273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.100424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.100538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.100564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.100659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.100778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.100804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.100888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.100975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.101000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.101128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.101211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.101258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.101459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.101567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.101593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.101720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.101833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.101859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.101999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.102145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.102171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.102295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.102433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.102462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.102629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.102720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.102747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.102841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.102957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.102989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.753 [2024-11-16 17:50:19.103148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.103278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.753 [2024-11-16 17:50:19.103306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.753 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.103391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.103516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.103545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.103687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.103774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.103800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.103911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.104062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.104088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.104227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.104356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.104382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.104475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.104600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.104646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.104772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.104894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.104931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.105047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.105144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.105170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.105286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.105418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.105447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.105552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.105670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.105697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.105821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.105916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.105943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.106058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.106174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.106204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.106681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.106776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.106804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.106928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.107036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.107065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.107583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.107744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.107772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.107870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.107998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.108025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.108144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.108289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.108318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.108423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.108561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.108590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.108749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.108840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.108866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.108971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.109071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.109099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.109200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.109325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.109354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.109454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.109560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.109587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.109730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.109827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.109853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.109982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.110071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.110101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.110231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.110365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.110395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.110538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.110641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.110684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.110774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.110882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.110921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.111048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.111141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.111169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.111265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.111386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.111426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.754 qpair failed and we were unable to recover it. 00:30:41.754 [2024-11-16 17:50:19.111581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.754 [2024-11-16 17:50:19.111727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.111753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.111877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.111999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.112040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.112179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.112270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.112300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.112464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.112627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.112670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.112759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.112839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.112864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.113006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.113125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.113158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.113288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.113388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.113431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.113544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.113656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.113684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.113771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.113866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.113896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.114027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.114136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.114166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.114269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.114370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.114399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.114533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.114652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.114679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.114765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.114853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.114879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.114994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.115114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.115142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.115270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.115392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.115421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.115543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.115669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.115696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.115786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.115878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.115904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.116008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.116107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.116135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.116222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.116313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.116342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.116431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.116581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.116609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.116718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.116813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.116839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.116972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.117126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.117154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.117252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.117359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.117389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.117485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.117622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.117675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.117764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.117854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.117880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.117989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.118079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.118107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.118195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.118319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.118352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.118454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.118546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.118574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.755 [2024-11-16 17:50:19.118718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.118814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.755 [2024-11-16 17:50:19.118839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.755 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.118986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.119085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.119114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.119209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.119387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.119415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.119543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.119657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.119683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.119769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.119861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.119886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.119993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.120123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.120151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.120271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.120423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.120450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.120533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.120631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.120674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.120782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.120862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.120891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.121074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.121196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.121224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.121385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.121490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.121517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.121623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.121754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.121779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.121910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.122150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.122409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.122652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.122860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.122997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.123025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.123153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.123261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.123289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.123385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.123483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.123515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.123608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.123730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.123756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.123847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.124011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.124051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.124221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.124332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.124360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.124476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.124630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.124657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.124747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.124829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.124855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.124963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.125075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.125118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.125311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.125409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.125446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.125575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.125696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.125723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.125869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.125969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.126011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.756 [2024-11-16 17:50:19.126115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.126233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.756 [2024-11-16 17:50:19.126265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.756 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.126394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.126505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.126533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.126669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.126770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.126796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.126885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.127011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.127039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.127170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.127261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.127289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.127399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.127514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.127541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.127646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.127800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.127825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.127937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.128031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.128070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.128200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.128324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.128351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.128474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.128574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.128603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.128720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.128815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.128842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.128935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.129075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.129119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.129263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.129416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.129444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.129557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.129657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.129684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.129776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.129867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.129893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.130012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.130152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.130180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.130277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.130393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.130421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.130534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.130630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.130657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.130771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.130853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.130878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.130984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.131081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.131108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.131239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.131340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.131370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.131488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.131601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.131646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.131775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.131855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.131881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.132014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.132151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.132176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.132288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.132424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.132452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.132561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.132671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.132697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.132791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.132878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.132903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.133007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.133161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.133188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.757 qpair failed and we were unable to recover it. 00:30:41.757 [2024-11-16 17:50:19.133304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.757 [2024-11-16 17:50:19.133444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.133473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.133607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.133703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.133728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.133818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.133940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.133966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.134107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.134199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.134242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.134351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.134440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.134482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.134582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.134703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.134729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.134842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.134977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.135004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.135095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.135237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.135263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.135384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.135469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.135496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.135587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.135737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.135763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.135893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.136182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.136406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.136657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.136909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.136999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.137024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.137116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.137205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.137232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.137351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.137485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.137527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.137620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.137740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.137767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.137882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.137995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.138020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.138138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.138289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.138318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.138440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.138565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.138594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.138746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.138834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.138859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.138962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.139046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.139075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.139207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.139343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.139370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.139492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.139630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.139659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.139800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.139892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.139928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.140017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.140096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.140122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.140228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.140311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.140338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.140484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.140560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.140586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.140717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.140807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.140833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.140983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.141126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.758 [2024-11-16 17:50:19.141152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.758 qpair failed and we were unable to recover it. 00:30:41.758 [2024-11-16 17:50:19.141241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.141362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.141388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.141503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.141656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.141685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.141812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.141894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.141931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.142018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.142135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.142161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.142251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.142342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.142367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.142483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.142667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.142694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.142776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.142858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.142883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.142973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.143087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.143112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.143234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.143369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.143395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.143496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.143597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.143637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.143741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.143826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.143852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.144003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.144092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.144118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.144285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.144438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.144467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.144593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.144704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.144731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.144820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.144908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.144934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.145034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.145171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.145196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.145323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.145396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.145422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.145510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.145596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.145638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.145729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.145806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.145831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.145975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.146073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.146102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.146246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.146360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.146385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.146464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.146582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.146624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.146709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.146796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.146823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.146898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.147021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.147048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.147159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.147302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.147330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.147445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.147559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.147585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.147728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.147813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.147838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.147926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.148032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.148062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.148148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.148242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.148270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.148410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.148495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.148520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.759 [2024-11-16 17:50:19.148622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.148712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.759 [2024-11-16 17:50:19.148737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.759 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.148833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.148913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.148939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.149041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.149220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.149251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.149339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.149450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.149475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.149586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.149715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.149741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.149855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.149965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.149991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.150104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.150290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.150486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.150722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.150906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.150989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.151015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.151126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.151241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.151270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.151409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.151513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.151538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.151653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.151741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.151767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.151856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.152162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.152426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.152656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.152860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.152961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.153072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.153168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.153212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.153336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.153451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.153477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.153594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.153686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.153712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.153800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.153886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.153922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.154044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.154117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.154142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.154266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.154377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.154402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.154515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.154643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.154669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.154779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.154862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.154888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.155014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.155131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.155159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.155263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.155374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.155400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.155484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.155567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.155592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.155700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.155793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.155819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.155957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.156085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.156113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.156238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.156351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.156376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.156492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.156590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.760 [2024-11-16 17:50:19.156629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.760 qpair failed and we were unable to recover it. 00:30:41.760 [2024-11-16 17:50:19.156736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.156842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.156868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.156975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.157090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.157116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.157223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.157338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.157363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.157475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.157642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.157669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.157754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.157829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.157854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.157939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.158154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.158422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.158636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.158847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.158967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.159059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.159170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.159195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.159309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.159392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.159433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.159532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.159632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.159658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.159775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.159865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.159891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.160003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.160086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.160113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.160248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.160334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.160362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.160486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.160573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.160601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.160711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.160852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.160878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.160971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.161054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.161079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.161163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.161291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.161323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.161465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.161583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.161627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.161743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.161826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.161852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.161967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.162082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.162107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.162222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.162393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.162418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.761 qpair failed and we were unable to recover it. 00:30:41.761 [2024-11-16 17:50:19.162500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.761 [2024-11-16 17:50:19.162608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.162642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.162766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.162851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.162876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.163002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.163092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.163119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.163234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.163352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.163380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.163507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.163634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.163679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.163772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.163847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.163872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.164021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.164114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.164139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.164253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.164390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.164416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.164504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.164663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.164690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.164772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.164854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.164879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.165006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.165238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.165439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.165675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.165877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.165987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.166103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.166217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.166243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.166344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.166443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.166473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.166561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.166667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.166696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.166813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.166897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.166928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.167015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.167125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.167150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.167234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.167347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.167388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.167512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.167599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.167646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.167762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.167874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.167910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.762 [2024-11-16 17:50:19.168043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.168121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.762 [2024-11-16 17:50:19.168148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.762 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.168256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.168380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.168408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.168512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.168645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.168674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.168786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.168866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.168890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.169034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.169141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.169167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.169298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.169428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.169453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.169543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.169652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.169679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.169764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.169877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.169915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.170017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.170137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.170179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.170265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.170351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.170376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.170496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.170597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.170652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.170768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.170849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.170874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.170979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.171058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.171083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.171171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.171304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.171333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.171424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.171531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.171557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.171706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.171823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.171865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.171956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.172190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.172474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.172704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.172904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.172987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.173012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.173126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.173270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.173297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.173421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.173518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.173546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.173691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.173780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.173810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.173924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.174085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.174110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.174235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.174317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.763 [2024-11-16 17:50:19.174342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.763 qpair failed and we were unable to recover it. 00:30:41.763 [2024-11-16 17:50:19.174427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.174523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.174549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.174649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.174733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.174757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.174844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.174953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.174979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.175067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.175283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.175488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.175715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.175906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.175997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.176118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.176392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.176636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.176858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.176980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.177071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.177162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.177190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.177310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.177408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.177437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.177562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.177667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.177710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.177798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.177889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.177915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.178001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.178191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.178430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.178688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.178896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.178990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.179099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.179318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.179547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.179766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.179899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.179986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.180099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.180126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.180244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.180326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.180351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:41.764 [2024-11-16 17:50:19.180468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.180556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:41.764 [2024-11-16 17:50:19.180582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:41.764 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.180712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdb9980 is same with the state(5) to be set 00:30:42.052 [2024-11-16 17:50:19.180839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.180963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.181124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.181388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.181571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.181839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.181946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.182037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.182185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.182212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.182323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.182413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.182440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.182527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.182626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.182654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.182777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.182864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.182892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.183021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.183137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.183164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.183264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.183346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.183372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.183455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.183543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.183570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.183660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.183743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.183770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.183890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.184155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.184413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.184676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.184879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.052 [2024-11-16 17:50:19.184988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.052 qpair failed and we were unable to recover it. 00:30:42.052 [2024-11-16 17:50:19.185071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.185184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.185212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.185321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.185405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.185433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.185530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.185626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.185653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.185770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.185863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.185889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.186004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.186197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.186422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.186642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.186861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.186980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.187126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.187331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.187553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.187784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.187925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.188042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.188127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.188153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.188259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.188343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.188369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.188489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.188582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.188611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.188737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.188821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.188847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.188968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.189229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.189425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.189611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.189831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.189987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.190109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.190255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.190280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.190394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.190511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.190537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.190649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.190734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.190760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.190838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.190956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.190982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.191097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.191213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.191238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.191330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.191446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.053 [2024-11-16 17:50:19.191473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.053 qpair failed and we were unable to recover it. 00:30:42.053 [2024-11-16 17:50:19.191564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.191650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.191676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.191755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.191842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.191871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.191968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.192083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.192110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.192198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.192278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.192304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.192391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.192482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.192509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.192636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.192722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.192748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.192870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.193120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.193367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.193628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.193821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.193956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.194078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.194196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.194223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.194309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.194397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.194423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.194546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.194655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.194681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.194775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.194912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.194937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.195052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.195162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.195188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.195308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.195419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.195444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.195559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.195689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.195734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.195814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.195913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.195938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.196031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.196169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.196195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.196275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.196380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.196410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.196526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.196608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.196641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.196733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.196830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.196857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.196969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.197088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.197114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.197208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.197299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.197324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.197416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.197498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.197523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.197639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.197751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.197777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.197893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.198009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.054 [2024-11-16 17:50:19.198035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.054 qpair failed and we were unable to recover it. 00:30:42.054 [2024-11-16 17:50:19.198147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.198258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.198283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.198363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.198456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.198487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.198581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.198702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.198730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.198819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.198902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.198928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.199006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.199097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.199123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.199238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.199359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.199385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.199470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.199574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.199601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.199750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.199840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.199867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.199956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.200150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.200371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.200636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.200895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.200986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.201115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.201336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.201530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.201792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.201910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.201999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.202114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.202139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.202222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.202370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.202397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.202507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.202588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.202622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.202740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.202834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.202864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.202947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.203179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.203417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.203638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.203831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.203957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.055 qpair failed and we were unable to recover it. 00:30:42.055 [2024-11-16 17:50:19.204041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.055 [2024-11-16 17:50:19.204132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.204161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.204309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.204392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.204418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.204531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.204644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.204671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.204764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.204849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.204875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.204993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.205108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.205135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.205253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.205336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.205361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.205497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.205610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.205644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.205803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.205892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.205928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.206042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.206121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.206146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.206267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.206344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.206369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.206516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.206597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.206637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.206759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.206874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.206899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.207022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.207134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.207160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.207246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.207331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.207357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.207469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.207588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.207613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.207739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.207856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.207882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.207968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.208083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.208110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.208196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.208370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.208399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.208485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.208600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.208635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.208750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.208871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.208896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.209008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.209088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.209118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.209229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.209343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.209369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.209487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.209595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.209628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.209715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.209833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.209860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.209948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.210036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.210062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.210184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.210276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.210303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.056 qpair failed and we were unable to recover it. 00:30:42.056 [2024-11-16 17:50:19.210446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.056 [2024-11-16 17:50:19.210531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.210557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.210652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.210771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.210798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.210913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.211177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.211400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.211634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.211886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.211974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.212087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.212282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.212544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.212805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.212944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.213085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.213198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.213223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.213313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.213426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.213456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.213548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.213628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.213655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.213737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.213877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.213910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.213999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.214205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.214436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.214671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.214868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.214986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.215135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.215372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.215604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.215869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.215984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.216069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.216161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.057 [2024-11-16 17:50:19.216188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.057 qpair failed and we were unable to recover it. 00:30:42.057 [2024-11-16 17:50:19.216276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.216390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.216418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.216529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.216639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.216666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.216760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.216840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.216866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.216953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.217038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.217064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.217209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.217326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.217352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.217439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.217552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.217578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.217699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.217821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.217847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.217963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.218213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.218403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.218614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.218827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.218946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.219061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.219178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.219204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.219318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.219416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.219442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.219552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.219664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.219692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.219778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.219866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.219893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.219988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.220106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.220131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.220245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.220333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.220360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.220503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.220587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.220624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.220716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.220826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.220853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.220940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.221061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.221087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.221169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.221278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.221305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.221426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.221517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.221544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.221641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.221764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.221791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.221882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.222021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.222047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.222136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.222227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.222252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.222367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.222460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.222487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.222598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.222748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.222775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.058 qpair failed and we were unable to recover it. 00:30:42.058 [2024-11-16 17:50:19.222906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.058 [2024-11-16 17:50:19.223016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.223128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.223376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.223577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.223812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.223982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.224100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.224208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.224235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.224321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.224490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.224517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.224633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.224762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.224809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.224924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.225107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.225134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.225275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.225363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.225392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.225502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.225597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.225632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.225748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.225834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.225861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.225957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.226079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.226106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.226215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.226364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.226390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.226509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.226593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.226627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.226718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.226855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.226883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.226972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.227065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.227091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.227214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.227294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.227320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.227472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.227558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.227584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.227690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.227809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.227836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.227924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.228147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.228348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.228601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.228830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.228974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.229051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.229146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.229173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.229288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.229373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.229398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.229484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.229597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.229630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.059 [2024-11-16 17:50:19.229730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.229816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.059 [2024-11-16 17:50:19.229841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.059 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.229960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.230159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.230348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.230596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.230824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.230936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.231073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.231155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.231180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.231273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.231365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.231392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.231485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.231623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.231653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.231742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.231836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.231864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.232005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.232117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.232143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.232253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.232330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.232355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.232508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.232590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.232625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.232743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.232848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.232874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.233009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.233116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.233143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.233282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.233386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.233411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.233527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.233612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.233644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.233748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.233879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.233904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.233999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.234195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.234405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.234610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.234842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.234982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.235102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.235219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.235245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.235331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.235451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.235476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.235581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.235670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.235695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.235842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.235938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.235964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.236087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.236177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.236204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.060 [2024-11-16 17:50:19.236301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.236416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.060 [2024-11-16 17:50:19.236441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.060 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.236582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.236679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.236706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.236806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.236901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.236929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.237047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.237128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.237153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.237241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.237321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.237348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.237457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.237597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.237632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.237721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.237818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.237844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.237953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.238066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.238093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.238208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.238289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.238315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.238440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.238558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.238585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.238705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.238789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.238815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.238928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.239187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.239404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.239671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.239869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.239978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.240069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.240187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.240214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.240334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.240415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.240441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.240535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.240644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.240671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.240818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.240935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.240961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.241073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.241154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.241181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.241274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.241360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.241386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.241533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.241635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.241666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.241763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.241856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.241882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.242006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.242123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.242148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.061 qpair failed and we were unable to recover it. 00:30:42.061 [2024-11-16 17:50:19.242278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.061 [2024-11-16 17:50:19.242384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.242409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.242522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.242643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.242674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.242768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.242858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.242887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.242977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.243208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.243401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.243607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.243811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.243926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.244064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.244180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.244207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.244300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.244386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.244413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.244536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.244662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.244693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.244784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.244896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.244928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.245015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.245101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.245127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.245233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.245318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.245346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.245439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.245559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.245587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.245774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.245895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.245922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.246024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.246109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.246138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.246237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.246390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.246419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.246510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.246622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.246649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.246749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.246861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.246906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.247018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.247132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.247162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.247292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.247437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.247472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.247614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.247764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.247790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.247905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.247991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.248048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.248172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.248303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.248331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.248465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.248585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.248621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.248755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.248847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.248873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.249006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.249133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.249162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.062 [2024-11-16 17:50:19.249259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.249353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.062 [2024-11-16 17:50:19.249382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.062 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.249506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.249634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.249678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.249760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.249852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.249877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.250009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.250161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.250195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.250305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.250439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.250468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.250559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.250653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.250696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.250815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.250905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.250932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.251015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.251140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.251169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.251266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.251355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.251384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.251477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.251599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.251634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.251733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.251851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.251877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.251966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.252103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.252129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.252268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.252425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.252454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.252559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.252699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.252726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.252821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.252935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.252962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.253053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.253164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.253192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.253318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.253421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.253451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.253573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.253678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.253706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.253789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.253864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.253890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.253975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.254117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.254144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.254259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.254379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.254407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.254499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.254584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.254610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.254726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.254817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.254842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.254934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.255023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.255049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.255158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.255251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.255280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.255378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.255545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.255571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.255688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.255782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.255808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.255944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.256065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.256094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.256229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.256357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.256385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.063 qpair failed and we were unable to recover it. 00:30:42.063 [2024-11-16 17:50:19.256485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.063 [2024-11-16 17:50:19.256602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.256637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.256774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.256869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.256894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.257031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.257110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.257136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.257219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.257329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.257354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.257461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.257564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.257592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.257740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.257825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.257852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.257942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.258179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.258422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.258627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.258834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.258970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.259093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.259213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.259239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.259337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.259450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.259476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.259563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.259679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.259707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.259794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.259901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.259926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.260024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.260133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.260159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.260250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.260361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.260387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.260475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.260551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.260577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.260700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.260813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.260839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.260959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.261182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.261384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.261582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.261811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.261935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.262026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.262231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.262424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.262686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.064 [2024-11-16 17:50:19.262887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.064 [2024-11-16 17:50:19.262996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.064 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.263082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.263204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.263231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.263345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.263468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.263495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.263599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.263689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.263714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.263794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.263903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.263929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.264047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.264155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.264182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.264270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.264388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.264415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.264526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.264607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.264639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.264718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.264836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.264862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.264957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.265042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.265068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.265176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.265320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.265346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.265487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.265609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.265653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.265743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.265848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.265874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.265953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.266209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.266408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.266631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.266847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.266983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.267072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.267155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.267182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.267266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.267376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.267402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.267515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.267596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.267632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.267745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.267829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.267854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.267928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.268170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.268403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.268653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.268848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.268953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.269056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.269196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.269240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.065 [2024-11-16 17:50:19.269333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.269415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.065 [2024-11-16 17:50:19.269442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.065 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.269532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.269623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.269650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.269737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.269819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.269847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.269959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.270099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.270125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.270209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.270319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.270345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.270487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.270604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.270640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.270739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.270825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.270853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.270970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.271085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.271111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.271194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.271277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.271303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.271419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.271537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.271564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.271694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.271842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.271872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.272020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.272138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.272165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.272252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.272329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.272356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.272484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.272567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.272594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.272728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.272856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.272886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.272974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.273154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.273180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.273323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.273411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.273438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.273517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.273628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.273673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.273759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.273877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.273908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.273999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.274125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.274154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.274275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.274426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.274455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.274585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.274708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.274736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.274814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.274925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.274954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.275076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.275215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.275245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.275365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.275457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.275485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.275591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.275730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.275758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.066 qpair failed and we were unable to recover it. 00:30:42.066 [2024-11-16 17:50:19.275875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.276000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.066 [2024-11-16 17:50:19.276026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.276123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.276234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.276259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.276373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.276453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.276478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.276587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.276717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.276744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.276835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.276921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.276946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.277082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.277178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.277208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.277359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.277488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.277518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.277685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.277808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.277835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.277932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.278044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.278071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.278232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.278322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.278351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.278477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.278646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.278673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.278790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.278934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.278960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.279071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.279258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.279302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.279391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.279519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.279546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.279659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.279744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.279771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.279880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.279992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.280018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.280105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.280189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.280216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.280357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.280481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.280508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.280594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.280709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.280736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.280879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.280975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.281119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.281344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.281534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.281804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.281919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.282060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.282211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.282239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.282325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.282450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.282478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.282567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.282711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.282737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.282897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.283088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.283132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.283281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.283411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.067 [2024-11-16 17:50:19.283441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.067 qpair failed and we were unable to recover it. 00:30:42.067 [2024-11-16 17:50:19.283595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.283748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.283775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.283912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.284039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.284067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.284193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.284322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.284351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.284490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.284604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.284636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.284793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.284884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.284918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.285076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.285199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.285227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.285373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.285502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.285530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.285697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.285811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.285837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.285976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.286086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.286112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.286224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.286348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.286378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.286496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.286644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.286671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.286773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.286877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.286922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.287058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.287147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.287174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.287291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.287400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.287427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.287513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.287633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.287666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.287818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.287930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.287956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.288097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.288208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.288234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.288314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.288395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.288422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.288546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.288666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.288696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.288854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.288956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.288986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.289115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.289231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.289257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.289404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.289516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.289542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.289627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.289744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.289770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.289913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.290137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.290418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.290642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.290879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.290979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.291005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.068 qpair failed and we were unable to recover it. 00:30:42.068 [2024-11-16 17:50:19.291091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.291209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.068 [2024-11-16 17:50:19.291235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.291349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.291441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.291467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.291576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.291673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.291699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.291776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.291890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.291917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.292060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.292177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.292202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.292316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.292426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.292451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.292591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.292732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.292776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.292927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.293083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.293108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.293252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.293334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.293360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.293477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.293593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.293628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.293765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.293865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.293892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.293976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.294094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.294120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.294229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.294335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.294361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.294470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.294586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.294611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.294732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.294819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.294845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.294929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.295071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.295098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.295218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.295340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.295366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.295461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.295579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.295606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.295711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.295878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.295904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.295985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.296124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.296150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.296264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.296384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.296410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.296531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.296645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.296672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.296766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.296905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.296931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.297050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.297166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.297191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.297331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.297434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.297459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.297579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.297670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.297697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.297816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.297951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.297995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.298089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.298205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.298230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.298310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.298423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.069 [2024-11-16 17:50:19.298449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.069 qpair failed and we were unable to recover it. 00:30:42.069 [2024-11-16 17:50:19.298538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.298653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.298680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.298797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.298913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.298940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.299054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.299166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.299192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.299342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.299423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.299449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.299531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.299650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.299681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.299796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.299938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.299965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.300054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.300137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.300164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.300258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.300337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.300363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.300457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.300572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.300597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.300687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.300805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.300830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.300946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.301055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.301081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.301195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.301302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.301327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.301419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.301503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.301529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.301628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.301753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.301783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.301879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.302142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.302377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.302629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.302874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.302993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.303023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.303143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.303244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.303273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.303401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.303493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.303520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.303614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.303758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.303784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.303906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.303997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.304024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.304114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.304233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.304262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.304365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.304483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.070 [2024-11-16 17:50:19.304512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.070 qpair failed and we were unable to recover it. 00:30:42.070 [2024-11-16 17:50:19.304611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.304739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.304765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.304850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.304980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.305010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.305113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.305210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.305238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.305377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.305494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.305523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.305647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.305780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.305806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.305906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.306003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.306029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.306153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.306279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.306308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.306434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.306584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.306614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.306724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.306848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.306874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.307032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.307178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.307207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.307309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.307435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.307464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.307585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.307703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.307730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.307847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.307957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.308000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.308101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.308224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.308254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.308382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.308529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.308557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.308705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.308800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.308826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.308910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.309116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.309350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.309634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.309859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.309996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.310094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.310194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.310224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.310325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.310417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.310446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.310549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.310648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.310692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.310808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.310886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.310911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.311026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.311110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.311136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.311221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.311339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.071 [2024-11-16 17:50:19.311365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.071 qpair failed and we were unable to recover it. 00:30:42.071 [2024-11-16 17:50:19.311468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.311571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.311596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.311731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.311813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.311838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.311951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.312153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.312372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.312624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.312862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.312979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.313098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.313221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.313247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.313343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.313483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.313509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.313593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.313715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.313741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.313830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.313920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.313945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.314033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.314238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.314471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.314682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.314883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.314995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.315137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.315352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.315570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.315797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.315927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.316025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.316118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.316143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.316264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.316352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.316379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.316493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.316584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.316610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.316734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.316850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.316876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.316960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.317082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.317108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.317196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.317309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.317335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.317449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.317559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.317585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.317716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.317806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.317833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.072 qpair failed and we were unable to recover it. 00:30:42.072 [2024-11-16 17:50:19.317922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.072 [2024-11-16 17:50:19.318029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.318055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.318146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.318284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.318311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.318453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.318545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.318570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.318688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.318805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.318831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.318915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.318998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.319112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.319304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.319557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.319775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.319901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.320015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.320126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.320151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.320266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.320380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.320406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.320517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.320631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.320657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.320763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.320866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.320892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.320975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.321080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.321105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.321248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.321391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.321417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.321530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.321651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.321678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.321791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.321904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.321930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.322055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.322172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.322197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.322276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.322396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.322426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.322510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.322600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.322632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.322727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.322811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.322837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.322952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.323178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.323373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.323614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.323827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.323941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.324027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.324165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.324190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.324270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.324381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.324407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.073 [2024-11-16 17:50:19.324503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.324595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.073 [2024-11-16 17:50:19.324633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.073 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.324723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.324833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.324859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.324947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.325199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.325381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.325610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.325856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.325989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.326071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.326147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.326173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.326271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.326360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.326385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.326523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.326602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.326633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.326719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.326831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.326861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.326979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.327176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.327399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.327600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.327826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.327963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.328070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.328143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.328169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.328314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.328423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.328449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.328534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.328651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.328678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.328787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.328878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.328904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.328986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.329167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.329196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.329287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.329370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.329397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.329538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.329628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.329656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.329759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.329866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.329891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.330004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.330091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.330116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.330262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.330342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.330368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.330482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.330596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.330628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.330722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.330807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.330832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.330954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.331066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.331092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.074 qpair failed and we were unable to recover it. 00:30:42.074 [2024-11-16 17:50:19.331202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.074 [2024-11-16 17:50:19.331284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.331309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.331425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.331516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.331542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.331666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.331780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.331806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.331891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.331997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.332104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.332325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.332632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.332837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.332974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.333054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.333160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.333185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.333298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.333443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.333469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.333589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.333739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.333766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.333845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.333925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.333952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.334076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.334157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.334184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.334273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.334386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.334412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.334492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.334630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.334657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.334734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.334847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.334873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.334956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.335069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.335095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.335210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.335288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.335313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.335451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.335566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.335593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.335696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.335785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.335810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.335893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.336003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.336028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.336124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.336261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.336286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.075 [2024-11-16 17:50:19.336409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.336501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.075 [2024-11-16 17:50:19.336528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.075 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.336610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.336728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.336753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.336895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.337000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.337025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.337141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.337221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.337246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.337386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.337530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.337557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.337672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.337788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.337814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.337927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.338187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.338433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.338630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.338860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.338971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.339111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.339228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.339254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.339403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.339547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.339573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.339718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.339871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.339898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.339990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.340109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.340136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.340253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.340395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.340421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.340567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.340683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.340710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.340829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.340915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.340943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.341054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.341135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.341162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.341260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.341341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.341367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.341482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.341592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.341637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.341752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.341846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.341872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.341966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.342192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.342408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.342635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.342866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.342998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.076 qpair failed and we were unable to recover it. 00:30:42.076 [2024-11-16 17:50:19.343090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.076 [2024-11-16 17:50:19.343201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.343227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.343365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.343505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.343530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.343650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.343738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.343765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.343858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.343934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.343961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.344102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.344210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.344236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.344333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.344423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.344448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.344560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.344637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.344663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.344751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.344840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.344867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.344987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.345097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.345123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.345273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.345364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.345390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.345473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.345605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.345639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.345748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.345858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.345884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.345972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.346055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.346081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.346176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.346313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.346344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.346514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.346644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.346672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.346794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.346921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.346950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.347082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.347194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.347220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.347339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.347453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.347479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.347564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.347723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.347767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.347877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.348119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.348341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.348536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.348800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.348937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.077 qpair failed and we were unable to recover it. 00:30:42.077 [2024-11-16 17:50:19.349079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.077 [2024-11-16 17:50:19.349221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.349246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.349360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.349480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.349506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.349646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.349763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.349788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.349883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.349989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.350130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.350353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.350587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.350853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.350992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.351107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.351217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.351243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.351328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.351416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.351442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.351565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.351659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.351686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.351797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.351888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.351914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.352026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.352148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.352175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.352292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.352431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.352457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.352546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.352678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.352707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.352838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.352980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.353005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.353128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.353245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.353272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.353419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.353532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.353557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.353645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.353784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.353828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.353958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.354086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.354111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.354229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.354310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.354335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.354412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.354493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.354519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.354677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.354813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.354842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.354939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.355080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.355107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.355220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.355314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.355342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.355449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.355558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.355584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.078 qpair failed and we were unable to recover it. 00:30:42.078 [2024-11-16 17:50:19.355699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.078 [2024-11-16 17:50:19.355831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.355860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.355979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.356066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.356096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.356201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.356358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.356386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.356503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.356680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.356708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.356801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.356939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.356969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.357062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.357219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.357248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.357376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.357508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.357537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.357706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.357791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.357817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.357970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.358116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.358146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.358272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.358378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.358407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.358493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.358606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.358644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.358744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.358825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.358851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.358950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.359160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.359383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.359644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.359872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.359978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.360007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.360096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.360248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.360276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.360430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.360556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.360585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.360700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.360833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.360862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.360979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.361127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.361156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.361252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.361377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.361408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.361535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.361632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.361677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.361822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.361965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.361996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.362090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.362166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.362192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.362287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.362403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.362429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.079 [2024-11-16 17:50:19.362546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.362661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.079 [2024-11-16 17:50:19.362688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.079 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.362833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.362923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.362949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.363033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.363113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.363158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.363285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.363381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.363410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.363533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.363630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.363676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.363765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.363877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.363903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.364010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.364171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.364200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.364352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.364486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.364517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.364635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.364801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.364844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.364984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.365188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.365256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.365340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.365455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.365480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.365557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.365647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.365675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.365807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.365960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.366140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.366362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.366638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.366836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.366945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.367084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.367201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.367231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.367349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.367492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.367517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.367601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.367726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.367770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.367852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.367934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.367962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.080 qpair failed and we were unable to recover it. 00:30:42.080 [2024-11-16 17:50:19.368052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.368208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.080 [2024-11-16 17:50:19.368235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.368317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.368469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.368495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.368602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.368722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.368749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.368872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.368999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.369027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.369115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.369255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.369281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.369389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.369502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.369538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.369684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.369798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.369825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.369944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.370061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.370088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.370203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.370316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.370342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.370456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.370575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.370613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.370747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.370837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.370863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.370981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.371118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.371144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.371262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.371379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.371406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.371528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.371688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.371718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.371871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.372017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.372061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.372203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.372342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.372368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.372484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.372599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.372638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.372752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.372943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.372971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.373102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.373208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.373234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.373351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.373464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.373490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.373569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.373653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.373679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.373773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.373892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.373926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.374044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.374155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.374182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.374290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.374370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.374397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.374514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.374643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.374672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.374782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.374867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.374893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.375049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.375168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.375195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.375285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.375368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.081 [2024-11-16 17:50:19.375395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.081 qpair failed and we were unable to recover it. 00:30:42.081 [2024-11-16 17:50:19.375515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.375600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.375632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.375753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.375860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.375888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.376048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.376191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.376217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.376304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.376449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.376475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.376562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.376710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.376755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.376892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.377024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.377050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.377165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.377255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.377281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.377393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.377533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.377560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.377700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.377819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.377845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.377934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.378041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.378067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.378182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.378321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.378348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.378486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.378628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.378656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.378772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.378920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.378946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.379032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.379112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.379138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.379252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.379367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.379394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.379485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.379635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.379661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.379755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.379892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.379922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.380041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.380165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.380191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.380307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.380392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.380420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.380545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.380659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.380686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.380830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.380922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.380949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.381040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.381155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.381182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.381257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.381345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.381371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.381459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.381568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.381595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.381720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.381828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.381854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.381981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.382094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.382120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.382231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.382355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.382381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.382468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.382587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.382629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.082 qpair failed and we were unable to recover it. 00:30:42.082 [2024-11-16 17:50:19.382726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.082 [2024-11-16 17:50:19.382813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.382841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.382969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.383081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.383107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.383222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.383307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.383333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.383445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.383559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.383586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.383699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.383830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.383859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.383956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.384034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.384060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.384201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.384341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.384366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.384475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.384586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.384628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.384768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.384880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.384915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.385085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.385178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.385207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.385390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.385562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.385589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.385728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.385891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.385943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.386078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.386192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.386235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.386375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.386492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.386520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.386646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.386743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.386769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.386878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.387141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.387336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.387633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.387832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.387981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.388123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.388327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.388514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.388742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.388881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.389001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.389129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.389156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.389267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.389384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.389409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.389494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.389605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.389637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.389743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.389837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.389863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.083 [2024-11-16 17:50:19.389975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.390085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.083 [2024-11-16 17:50:19.390111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.083 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.390202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.390276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.390302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.390416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.390512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.390539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.390686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.390784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.390811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.390939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.391060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.391085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.391194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.391282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.391309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.391422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.391535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.391561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.391692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.391786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.391815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.391938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.392089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.392116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.392268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.392424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.392453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.392582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.392696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.392726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.392825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.392942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.392971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.393123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.393216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.393245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.393346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.393475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.393504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.393633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.393734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.393761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.393882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.394000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.394029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.394120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.394236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.394265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.394366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.394498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.394527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.394657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.394746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.394792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.394932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.395049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.395078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.395176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.395303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.395332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.395451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.395545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.395587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.395723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.395833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.395861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.395984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.396120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.396149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.396264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.396397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.396431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.396526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.396656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.396699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.396807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.396909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.396938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.397092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.397243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.397271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.084 [2024-11-16 17:50:19.397421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.397549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.084 [2024-11-16 17:50:19.397577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.084 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.397706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.397814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.397843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.397957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.398043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.398072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.398194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.398316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.398346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.398475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.398614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.398665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.398754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.398830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.398861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.398987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.399114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.399142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.399271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.399403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.399432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.399537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.399633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.399660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.399828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.399963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.399993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.400114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.400241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.400270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.400379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.400494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.400537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.400661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.400752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.400779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.400863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.401008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.401034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.401176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.401274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.401304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.401424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.401528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.401562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.401709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.401786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.401812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.401946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.402072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.402100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.402190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.402322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.402350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.402484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.402613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.402649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.402750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.402833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.402859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.402965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.403085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.403110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.403184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.403352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.403380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.403507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.403632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.403658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.403771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.403864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.403889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.404011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.404159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.404188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.085 qpair failed and we were unable to recover it. 00:30:42.085 [2024-11-16 17:50:19.404318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.085 [2024-11-16 17:50:19.404441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.404469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.404553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.404695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.404721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.404806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.404884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.404915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.405051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.405175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.405204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.405323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.405442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.405470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.405568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.405702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.405728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.405866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.406063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.406110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.406257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.406405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.406435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.406573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.406700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.406728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.406812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.406954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.406981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.407114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.407244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.407270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.407410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.407518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.407544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.407652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.407784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.407813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.407950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.408025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.408050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.408248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.408359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.408385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.408500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.408581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.408623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.408731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.408849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.408877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.409009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.409127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.409157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.409282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.409431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.409457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.409575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.409660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.409707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.409797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.409934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.409963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.410083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.410174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.410202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.410288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.410430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.410459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.410587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.410741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.410767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.410893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.410997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.411025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.411146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.411242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.411270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.411386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.411518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.411547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.411694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.411835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.411861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.411967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.412096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.086 [2024-11-16 17:50:19.412136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.086 qpair failed and we were unable to recover it. 00:30:42.086 [2024-11-16 17:50:19.412303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.412425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.412453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.412557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.412642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.412673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.412815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.412951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.412979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.413104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.413229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.413258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.413370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.413533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.413562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.413749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.413842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.413867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.413944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.414067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.414109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.414250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.414395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.414437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.414572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.414673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.414718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.414823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.414955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.414996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.415158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.415259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.415287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.415405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.415536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.415566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.415666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.415751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.415776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.415916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.415994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.416035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.416129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.416244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.416272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.416427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.416522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.416550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.416654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.416807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.416833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.416939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.417068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.417097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.417231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.417370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.417413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.417572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.417693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.417719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.417834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.417937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.417965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.418090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.418211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.418240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.418399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.418525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.418553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.418695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.418779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.418805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.418936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.419029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.419057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.419286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.419388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.419417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.419552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.419694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.419720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.419864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.420032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.420061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.087 qpair failed and we were unable to recover it. 00:30:42.087 [2024-11-16 17:50:19.420198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.420317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.087 [2024-11-16 17:50:19.420343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.420455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.420599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.420635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.420773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.420917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.420943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.421071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.421191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.421217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.421323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.421410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.421439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.421562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.421760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.421789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.421952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.422038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.422064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.422144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.422258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.422283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.422403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.422491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.422520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.422692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.422782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.422808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.422948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.423071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.423113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.423227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.423315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.423341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.423485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.423574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.423599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.423727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.423916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.423956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.424098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.424216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.424242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.424357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.424444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.424469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.424551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.424665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.424707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.424840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.424932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.424960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.425095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.425206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.425232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.425393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.425522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.425550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.425646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.425766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.425795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.425904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.426019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.426044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.426135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.426217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.426243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.426356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.426460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.426485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.426576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.426696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.088 [2024-11-16 17:50:19.426726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.088 qpair failed and we were unable to recover it. 00:30:42.088 [2024-11-16 17:50:19.426859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.426976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.427020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.427106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.427246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.427289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.427404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.427489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.427514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.427653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.427733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.427759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.427842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.427988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.428014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.428154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.428343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.428369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.428481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.428651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.428681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.428876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.429080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.429131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.429222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.429388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.429414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.429550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.429693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.429719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.429838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.429965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.429993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.430124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.430262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.430287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.430383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.430519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.430557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.430691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.430780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.430808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.430946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.431086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.431112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.431200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.431282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.431309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.431427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.431560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.431588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.431736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.431828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.431854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.431990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.432110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.432138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.432301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.432442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.432468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.432580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.432679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.432705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.432820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.432936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.432962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.433055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.433192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.433220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.433370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.433480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.433506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.433646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.433767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.433795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.433928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.434047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.434076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.434212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.434303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.434328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.434440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.434554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.089 [2024-11-16 17:50:19.434599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.089 qpair failed and we were unable to recover it. 00:30:42.089 [2024-11-16 17:50:19.434732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.434852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.434879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.435016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.435107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.435134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.435224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.435341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.435367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.435484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.435638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.435668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.435866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.435950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.435976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.436093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.436214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.436243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.436346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.436504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.436530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.436648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.436758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.436784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.436929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.437060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.437088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.437192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.437314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.437343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.437487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.437601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.437638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.437756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.437894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.437923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.438069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.438190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.438219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.438366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.438445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.438471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.438589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.438673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.438714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.438810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.438908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.438936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.439037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.439163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.439189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.439294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.439444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.439472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.439650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.439784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.439812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.439954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.440068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.440094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.440210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.440368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.440396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.440500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.440590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.440640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.440784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.440902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.440932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.090 [2024-11-16 17:50:19.441062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.441184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.090 [2024-11-16 17:50:19.441212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.090 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.441339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.441489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.441518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.441653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.441798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.441823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.441960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.442095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.442120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.442209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.442319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.442344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.442435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.442545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.442571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.442681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.442774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.442816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.442958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.443084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.443112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.443247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.443383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.443409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.443534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.443643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.443688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.443822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.443940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.443969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.444084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.444195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.444221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.444303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.444413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.444439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.444545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.444622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.444648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.444765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.444880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.444905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.445003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.445129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.445154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.445267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.445350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.445375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.445454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.445540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.445566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.445679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.445829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.445858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.446009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.446131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.446159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.446266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.446385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.446411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.446517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.446600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.446631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.446768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.446893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.446921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.447056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.447204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.447230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.091 qpair failed and we were unable to recover it. 00:30:42.091 [2024-11-16 17:50:19.447358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.447543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.091 [2024-11-16 17:50:19.447569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.447686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.447825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.447851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.447939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.448053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.448079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.448246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.448402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.448427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.448581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.448683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.448712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.448829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.448980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.449101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.449328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.449644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.449846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.449980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.450089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.450208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.450234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.450353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.450461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.450487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.450564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.450704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.450730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.450866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.450984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.451012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.451117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.451229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.451255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.451394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.451513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.451541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.451641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.451723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.451759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.451928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.452041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.452067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.452191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.452266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.452306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.452406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.452505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.452531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.452672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.452813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.452854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.452979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.453112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.453138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.453257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.453372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.453398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.453480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.453627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.453653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.453815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.453984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.454053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.454206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.454328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.454356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.454491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.454603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.454639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.454727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.454835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.454878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.454984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.455121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.092 [2024-11-16 17:50:19.455147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.092 qpair failed and we were unable to recover it. 00:30:42.092 [2024-11-16 17:50:19.455262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.455373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.455398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.455537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.455650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.455694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.455839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.455962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.455990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.456120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.456229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.456254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.456360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.456510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.456538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.456663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.456794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.456820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.456931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.457152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.457375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.457611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.457836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.457967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.458128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.458224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.458252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.458382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.458499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.458525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.458638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.458718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.458744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.458829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.458950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.458976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.459060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.459201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.459227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.459337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.459496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.459524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.459691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.459807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.459833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.459929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.460068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.460094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.460206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.460322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.460348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.460481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.460565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.460594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.460745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.460883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.460908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.460996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.461102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.461130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.461266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.461405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.461430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.461556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.461681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.461707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.461859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.461990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.462016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.462164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.462279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.462305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.462445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.462532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.462557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.462664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.462748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.462774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.462882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.462989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.463014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.093 qpair failed and we were unable to recover it. 00:30:42.093 [2024-11-16 17:50:19.463135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.093 [2024-11-16 17:50:19.463277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.463303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.463468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.463599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.463642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.463781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.463900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.463929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.464045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.464159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.464184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.464342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.464425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.464454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.464566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.464706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.464732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.464843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.464956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.464982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.465124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.465258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.465283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.465390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.465471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.465501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.465621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.465733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.465760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.465880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.465985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.466010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.466147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.466232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.466258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.466365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.466477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.466503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.466630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.466710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.466739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.466863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.467001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.467027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.467148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.467232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.467257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.467399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.467524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.467552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.467674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.467808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.467833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.467940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.468054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.468079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.468213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.468338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.468365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.468520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.468642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.468671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.468807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.468886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.468912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.469037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.469184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.469209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.469347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.469468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.469497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.469627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.469774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.469800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.469933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.470065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.470091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.470164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.470274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.470299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.094 qpair failed and we were unable to recover it. 00:30:42.094 [2024-11-16 17:50:19.470412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.470533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.094 [2024-11-16 17:50:19.470558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.470696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.470832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.470858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.470969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.471077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.471102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.471242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.471348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.471374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.471532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.471667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.471693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.471789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.471922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.471951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.472056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.472171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.472196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.472330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.472452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.472493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.472608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.472698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.472724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.472865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.472969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.472994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.473128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.473237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.473263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.473343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.473473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.473501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.473601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.473745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.473771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.473881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.474029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.474057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.474183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.474346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.474371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.474506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.474624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.474650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.474757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.474850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.474879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.475010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.475135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.475164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.475298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.475408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.475435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.475561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.475646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.475675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.475769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.475865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.475893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.475991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.476131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.476156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.476288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.476416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.476444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.476549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.476634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.476660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.476803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.476917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.476942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.477114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.477239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.477264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.477400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.477568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.477594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.477720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.477796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.477822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.477941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.478108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.478133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.478274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.478403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.095 [2024-11-16 17:50:19.478431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.095 qpair failed and we were unable to recover it. 00:30:42.095 [2024-11-16 17:50:19.478562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.478651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.478678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.478777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.478906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.478934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.479106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.479195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.479226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.479342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.479448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.479473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.479606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.479783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.479811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.479911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.480035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.480063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.480224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.480340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.480365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.480477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.480587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.480622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.480738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.480877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.480919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.481057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.481169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.481194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.481321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.481460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.481486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.481578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.481676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.481702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.481791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.481906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.481932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.482073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.482195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.482224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.482377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.482505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.482533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.482652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.482730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.482755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.482898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.483027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.483055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.483153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.483244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.483272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.483382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.483496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.483521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.483643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.483808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.483837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.483955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.484036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.484065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.484201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.484288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.484314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.484474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.484591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.484625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.484763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.484888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.484917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.485052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.485155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.485180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.485271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.485363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.485389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.485540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.485689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.485715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.485800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.485903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.485928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.486001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.486116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.486157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.486249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.486362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.486388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.486518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.486688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.486714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.486805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.486936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.486964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.096 qpair failed and we were unable to recover it. 00:30:42.096 [2024-11-16 17:50:19.487090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.096 [2024-11-16 17:50:19.487201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.487226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.487316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.487405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.487431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.487542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.487650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.487676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.487750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.487832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.487857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.487944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.488023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.488048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.488173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.488261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.488289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.488413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.488563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.488591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.488746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.488838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.488864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.488957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.489096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.489124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.489280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.489428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.489457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.489565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.489689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.489715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.489795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.489894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.489926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.490098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.490206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.490232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.490423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.490578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.490607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.490770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.490995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.491051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.491202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.491328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.491357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.491551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.491667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.491693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.491812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.491925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.491968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.492103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.492250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.492278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.492392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.492511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.492536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.492621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.492746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.492774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.492911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.492983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.493015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.493132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.493250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.493276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.493380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.493469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.493497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.493592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.493759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.493785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.493903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.494040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.494065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.494255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.494435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.494460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.494601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.494688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.494715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.494830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.494950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.494975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.495085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.495215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.495241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.495326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.495452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.495493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.495613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.495709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.495735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.495870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.495988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.496014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.097 qpair failed and we were unable to recover it. 00:30:42.097 [2024-11-16 17:50:19.496130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.097 [2024-11-16 17:50:19.496239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.496267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.496394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.496469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.496494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.496636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.496754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.496783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.496881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.497007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.497032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.497179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.497265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.497290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.497384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.497550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.497575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.497673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.497777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.497820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.497980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.498122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.498148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.498360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.498511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.498539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.498700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.498811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.498837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.498925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.499063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.499088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.499248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.499399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.499428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.499536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.499681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.499707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.499848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.499985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.500011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.500095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.500208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.500233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.500353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.500435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.500460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.500600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.500748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.500774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.500858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.500975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.501000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.501143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.501224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.501251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.501349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.501502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.501528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.501655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.501791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.501832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.501924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.502048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.502091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.502201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.502319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.502345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.502464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.502636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.502665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.502766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.502889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.502917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.503044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.503122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.503147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.503285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.503365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.503393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.503520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.503656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.503682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.503809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.503886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.503911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.504018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.504153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.504183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.504297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.504438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.504463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.098 qpair failed and we were unable to recover it. 00:30:42.098 [2024-11-16 17:50:19.504626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.098 [2024-11-16 17:50:19.504754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.504780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.504893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.505102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.505131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.505247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.505339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.505367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.505500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.505612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.505644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.505756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.505890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.505918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.506080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.506192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.506217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.506326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.506413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.506439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.506571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.506706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.506751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.506867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.506946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.506972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.507093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.507198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.507224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.507366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.507479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.507505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.507629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.507714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.507740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.507860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.507971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.507997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.508107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.508221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.508247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.508365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.508536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.508562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.508680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.508789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.508814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.508900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.509061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.509089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.509241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.509373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.509401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.509572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.509662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.509688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.509826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.509939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.509967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.099 qpair failed and we were unable to recover it. 00:30:42.099 [2024-11-16 17:50:19.510092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.510180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.099 [2024-11-16 17:50:19.510209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.510364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.510471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.510514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.510614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.510753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.510778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.510916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.511041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.511066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.511177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.511258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.511284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.511384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.511503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.511531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.511674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.511811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.511839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.511975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.512089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.512114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.512246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.512337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.512365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.512529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.512668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.512694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.512768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.512902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.512928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.513058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.513187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.513215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.513351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.513473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.513498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.513579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.513670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.513696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.513795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.513899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.513928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.514021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.514135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.514164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.514293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.514407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.514434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.514528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.514681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.514723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.514843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.514934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.514977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.100 [2024-11-16 17:50:19.515109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.515206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.100 [2024-11-16 17:50:19.515231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.100 qpair failed and we were unable to recover it. 00:30:42.384 [2024-11-16 17:50:19.515363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.515496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.515522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.384 qpair failed and we were unable to recover it. 00:30:42.384 [2024-11-16 17:50:19.515608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.515714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.515740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.384 qpair failed and we were unable to recover it. 00:30:42.384 [2024-11-16 17:50:19.515856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.516006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.516032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.384 qpair failed and we were unable to recover it. 00:30:42.384 [2024-11-16 17:50:19.516159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.516248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.516276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.384 qpair failed and we were unable to recover it. 00:30:42.384 [2024-11-16 17:50:19.516373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.516491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.384 [2024-11-16 17:50:19.516518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.516627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.516716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.516742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.516882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.517030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.517072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.517164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.517241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.517266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.517381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.517477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.517505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.517634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.517802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.517833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.517923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.518026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.518054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.518142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.518244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.518270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.518410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.518502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.518530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.518630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.518746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.518774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.518908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.519136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.519351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.519612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.519810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.519935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.520074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.520217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.520242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.520391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.520478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.520503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.520658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.520776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.520801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.520920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.521069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.521094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.521236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.521349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.521374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.521466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.521613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.521650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.521802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.521956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.521984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.522119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.522239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.522264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.522397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.522525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.522553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.522685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.522811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.522840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.522977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.523056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.523082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.523250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.523338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.523370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.523503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.523655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.523684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.385 qpair failed and we were unable to recover it. 00:30:42.385 [2024-11-16 17:50:19.523822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.523963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.385 [2024-11-16 17:50:19.523989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.524124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.524252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.524281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.524435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.524562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.524588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.524720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.524806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.524832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.524974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.525096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.525125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.525252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.525352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.525396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.525540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.525636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.525679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.525799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.525881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.525924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.526055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.526200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.526228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.526370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.526509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.526535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.526642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.526748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.526777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.526863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.526991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.527018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.527142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.527258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.527283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.527375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.527525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.527553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.527675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.527825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.527853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.527995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.528083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.528109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.528265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.528416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.528457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.528575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.528695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.528721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.528839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.528922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.528952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.529064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.529154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.529179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.529288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.529410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.529438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.529566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.529675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.529701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.529829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.529979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.530007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.530131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.530274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.530302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.530465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.530555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.530580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.530721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.530798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.530824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.530931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.531084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.531110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.531254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.531373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.531399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.531488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.531602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.531638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.386 qpair failed and we were unable to recover it. 00:30:42.386 [2024-11-16 17:50:19.531795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.386 [2024-11-16 17:50:19.531904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.531929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.532017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.532134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.532160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.532267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.532381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.532423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.532546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.532674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.532704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.532810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.532920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.532946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.533038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.533127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.533152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.533307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.533387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.533416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.533561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.533725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.533751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.533869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.534016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.534045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.534166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.534309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.534334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.534453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.534594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.534625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.534773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.534859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.534888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.535037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.535161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.535190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.535303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.535440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.535466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.535575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.535683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.535710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.535845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.535994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.536022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.536188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.536311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.536337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.536476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.536594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.536629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.536751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.536881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.536909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.537069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.537209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.537234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.537343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.537466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.537494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.537624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.537763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.537788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.537868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.537957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.537983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.538117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.538270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.538299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.538398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.538532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.538558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.538649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.538762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.538788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.538946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.539080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.539108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.539204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.539342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.539367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.539462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.539570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.539596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.387 qpair failed and we were unable to recover it. 00:30:42.387 [2024-11-16 17:50:19.539754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.387 [2024-11-16 17:50:19.539860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.539888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.540038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.540165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.540193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.540363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.540446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.540471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.540556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.540676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.540703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.540790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.540913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.540941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.541052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.541157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.541182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.541301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.541408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.541436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.541553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.541690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.541716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.541825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.541970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.541995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.542127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.542219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.542247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.542338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.542433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.542461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.542577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.542702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.542732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.542871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.543012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.543038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.543129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.543211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.543252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.543358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.543473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.543499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.543584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.543765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.543795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.543881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1715044 Killed "${NVMF_APP[@]}" "$@" 00:30:42.388 [2024-11-16 17:50:19.544001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.544029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.544168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 17:50:19 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:42.388 [2024-11-16 17:50:19.544283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.544309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 17:50:19 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:42.388 [2024-11-16 17:50:19.544431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 17:50:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:42.388 [2024-11-16 17:50:19.544566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.544594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 17:50:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:42.388 [2024-11-16 17:50:19.544700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.544786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.544815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 17:50:19 -- common/autotest_common.sh@10 -- # set +x 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.544958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.545099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.545129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.545265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.545415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.545444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.545540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.545694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.545720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.545859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.545987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.546012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.546143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.546279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.546304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.388 [2024-11-16 17:50:19.546381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.546470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.388 [2024-11-16 17:50:19.546498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.388 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.546640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.546729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.546754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.546886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.547018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.547046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.547143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.547293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.547321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.547434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.547542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.547568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.547682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.547789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.547818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.547938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.548088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.548117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.548252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 17:50:19 -- nvmf/common.sh@469 -- # nvmfpid=1715740 00:30:42.389 17:50:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:42.389 [2024-11-16 17:50:19.548336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.548362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 17:50:19 -- nvmf/common.sh@470 -- # waitforlisten 1715740 00:30:42.389 [2024-11-16 17:50:19.548495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.548597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 17:50:19 -- common/autotest_common.sh@829 -- # '[' -z 1715740 ']' 00:30:42.389 [2024-11-16 17:50:19.548631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.548735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 17:50:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:42.389 [2024-11-16 17:50:19.548859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 17:50:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:42.389 [2024-11-16 17:50:19.548887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 17:50:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:42.389 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:42.389 [2024-11-16 17:50:19.549037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 17:50:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:42.389 [2024-11-16 17:50:19.549160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.549185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 17:50:19 -- common/autotest_common.sh@10 -- # set +x 00:30:42.389 [2024-11-16 17:50:19.549290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.549385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.549431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.549545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.549640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.549666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.549774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.549887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.549913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.550015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.550143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.550186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.550313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.550415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.550443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.550580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.550707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.550733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.550819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.550908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.550932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.551022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.551127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.551152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.551260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.551368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.551393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.389 qpair failed and we were unable to recover it. 00:30:42.389 [2024-11-16 17:50:19.551500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.389 [2024-11-16 17:50:19.551642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.551671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.551803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.551903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.551932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.552060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.552146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.552171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.552305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.552396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.552424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.552544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.552653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.552682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.552781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.552899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.552932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.553072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.553185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.553213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.553306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.553434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.553462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.553610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.553713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.553738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.553832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.553924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.553949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.554033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.554127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.554152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.554268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.554379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.554405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.554525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.554613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.554646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.554738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.554854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.554880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.555042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.555249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.555484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.555700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.555901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.555986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.556120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.556367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.556559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.556788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.556935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.557047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.557134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.557159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.557270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.557393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.557426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.557536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.557649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.557692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.557776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.557865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.557891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.557987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.558076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.390 [2024-11-16 17:50:19.558101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.390 qpair failed and we were unable to recover it. 00:30:42.390 [2024-11-16 17:50:19.558238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.558348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.558374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.558468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.558556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.558581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.558685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.558781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.558809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.558920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.559040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.559068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.559178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.559285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.559311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.559426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.559557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.559585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.559735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.559833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.559862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.559980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.560227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.560413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.560644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.560855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.560976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.561080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.561204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.561233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.561354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.561440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.561466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.561553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.561662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.561688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.561766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.561858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.561884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.561999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.562108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.562133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.562246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.562344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.562371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.562492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.562609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.562642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.562767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.562851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.562876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.391 qpair failed and we were unable to recover it. 00:30:42.391 [2024-11-16 17:50:19.563007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.391 [2024-11-16 17:50:19.563137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.563162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.563277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.563357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.563384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.563475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.563590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.563638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.563763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.563863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.563888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.564004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.564092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.564117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.564234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.564346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.564374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.564465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.564551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.564577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.564686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.564771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.564797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.564912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.565167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.565397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.565628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.565854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.565986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.566075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.566172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.566199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.566298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.566407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.566434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.566519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.566613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.566645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.566731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.566808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.566833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.566960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.567162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.567412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.567613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.392 qpair failed and we were unable to recover it. 00:30:42.392 [2024-11-16 17:50:19.567840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.392 [2024-11-16 17:50:19.567919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.567944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.568070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.568213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.568240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.568360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.568474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.568501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.568612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.568708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.568734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.568823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.568940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.568966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.569052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.569137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.569163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.569302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.569389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.569419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.569530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.569628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.569654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.569746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.569851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.569876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.569961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.570177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.570411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.570648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.570840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.570959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.571074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.571183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.571208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.571321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.571428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.571453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.571578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.571727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.571753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.571880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.571963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.571988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.572077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.572188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.572213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.572327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.572416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.572442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.572533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.572639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.393 [2024-11-16 17:50:19.572665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.393 qpair failed and we were unable to recover it. 00:30:42.393 [2024-11-16 17:50:19.572750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.572836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.572862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.572982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.573219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.573457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.573657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.573852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.573985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.574078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.574219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.574244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.574335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.574425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.574451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.574565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.574655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.574682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.574766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.574855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.574881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.574998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.575220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.575444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.575656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.575881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.575991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.576130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.576335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.576557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.576756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.576893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.576979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.577062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.577087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.394 [2024-11-16 17:50:19.577173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.577297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.394 [2024-11-16 17:50:19.577330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.394 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.577416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.577535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.577561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.577651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.577740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.577766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.577854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.577981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.578123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.578358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.578574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.578841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.578963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.579081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.579225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.579250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.579341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.579461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.579487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.579596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.579702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.579729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.579815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.579890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.579916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.580000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.580088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.580114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.580200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.580283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.580308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.580429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.580518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.580543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.580649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.580789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.580815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.580940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.581031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.581056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.581151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.581235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.581261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.395 [2024-11-16 17:50:19.581347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.581475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.395 [2024-11-16 17:50:19.581500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.395 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.581607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.581726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.581752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.581889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.581999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.582114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.582329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.582528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.582757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.582872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.582958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.583187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.583410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.583601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.583819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.583932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.584034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.584181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.584207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.584294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.584374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.584400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.584489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.584575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.584600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.584696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.584805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.584830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.584951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.585060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.585085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.585195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.585291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.585316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.585428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.585521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.585548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.585665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.585777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.585803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.585918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.586004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.586031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.586110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.586219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.586244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.586333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.586424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.396 [2024-11-16 17:50:19.586450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.396 qpair failed and we were unable to recover it. 00:30:42.396 [2024-11-16 17:50:19.586547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.586652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.586679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.586769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.586861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.586886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.586971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.587168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.587385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.587621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.587862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.587978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.588105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.588193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.588219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.588312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.588397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.588423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.588505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.588579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.588604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.588730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.588821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.588847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.588937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.589155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.589406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.589605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.589880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.589987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.590070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.590250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.590280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.590394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.590509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.590534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.590629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.590718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.590744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.590831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.590915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.590940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.591054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.591146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.591172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.397 qpair failed and we were unable to recover it. 00:30:42.397 [2024-11-16 17:50:19.591261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.591393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.397 [2024-11-16 17:50:19.591418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.591524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.591613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.591651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.591769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.591867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.591893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.592003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.592116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.592142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.592225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.592312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.592338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.592431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.592544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.592570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.592711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.592853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.592879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.592971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.593143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:42.398 [2024-11-16 17:50:19.593174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593203] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:42.398 [2024-11-16 17:50:19.593264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.593381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.593609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.593847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.593964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.594052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.594133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.594158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.594274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.594385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.594410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.594499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.594586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.594611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.594714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.594801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.594826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.594937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.595139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.595338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.595594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.595816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.595978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.596077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.596160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.596186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.398 qpair failed and we were unable to recover it. 00:30:42.398 [2024-11-16 17:50:19.596312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.398 [2024-11-16 17:50:19.596416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.596441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.596558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.596643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.596670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.596758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.596870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.596895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.597014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.597234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.597456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.597657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.597853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.597985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.598071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.598162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.598187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.598275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.598410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.598435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.598522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.598604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.598637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.598729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.598816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.598841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.598929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.599154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.599353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.599590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.599842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.599982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.600064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.600153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.600178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.600290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.600402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.600427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.600510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.600640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.600666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.600786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.600895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.600920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.399 qpair failed and we were unable to recover it. 00:30:42.399 [2024-11-16 17:50:19.601015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.601105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.399 [2024-11-16 17:50:19.601130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.601245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.601362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.601387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.601526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.601638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.601665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.601758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.601848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.601873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.601954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.602176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.602407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.602636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.602903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.602994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.603161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.603355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.603580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.603816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.603933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.604055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.604165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.604191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.604285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.604370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.604396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.604489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.604599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.604631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.604750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.604840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.604866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.605006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.605136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.605162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.605251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.605367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.605392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.605506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.605587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.605612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.605713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.605809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.605834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.605924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.606011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.606037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.606120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.606236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.400 [2024-11-16 17:50:19.606262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.400 qpair failed and we were unable to recover it. 00:30:42.400 [2024-11-16 17:50:19.606355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.606431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.606457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.606574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.606723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.606749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.606842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.606948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.606974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.607062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.607146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.607172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.607284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.607400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.607425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.607503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.607598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.607634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.607737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.607813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.607838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.607948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.608182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.608427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.608651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.608914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.608992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.609098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.609319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.609568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.609798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.609932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.610074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.610182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.401 [2024-11-16 17:50:19.610207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.401 qpair failed and we were unable to recover it. 00:30:42.401 [2024-11-16 17:50:19.610288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.610398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.610424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.610510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.610622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.610648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.610767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.610848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.610874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.611002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.611260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.611485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.611689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.611893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.611988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.612108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.612390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.612596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.612886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.612999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.613088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.613227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.613252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.613345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.613435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.613461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.613584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.613733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.613759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.613869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.614136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.614347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.614560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.614780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.614886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.614976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.615058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.615084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.615175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.615256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.615283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.402 qpair failed and we were unable to recover it. 00:30:42.402 [2024-11-16 17:50:19.615370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.402 [2024-11-16 17:50:19.615482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.615508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.615598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.615698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.615725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.615841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.615931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.615957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.616041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.616154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.616179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.616289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.616378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.616403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.616491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.616582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.616607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.616730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.616839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.616865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.616981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.617205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.617401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.617659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.617862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.617998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.618092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.618203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.618228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.618369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.618481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.618506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.618628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.618750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.618775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.618857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.618937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.618963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.619041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.619157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.619183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.619268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.619378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.619403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.619491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.619631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.619660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.619742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.619827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.619852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.619973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.620109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.620134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.620247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.620361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.620386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.620503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.620589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.620632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.620749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.620855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.403 [2024-11-16 17:50:19.620880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.403 qpair failed and we were unable to recover it. 00:30:42.403 [2024-11-16 17:50:19.620965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.621165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.621393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.621621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.621889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.621988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.622154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.622361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.622613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.622816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.622933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.623032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.623117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.623143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.623232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.623338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.623364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.623455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.623542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.623567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.623684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.623794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.623820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.623914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.624146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.624353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.624558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.624824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.624934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.625055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.625139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.625165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.625253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.625333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.625359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.404 [2024-11-16 17:50:19.625447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.625536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.404 [2024-11-16 17:50:19.625561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.404 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.625669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.625758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.625783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.625927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.626153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.626382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.626632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.626835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.626937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.627027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.627104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.627130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.627215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.627354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.627379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.627479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.627587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.627612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.627749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.627860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.627887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.628027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.628135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.628161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.628277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.628359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.628385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.628499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.628605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.628648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.628740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.628835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.628860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.628952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.629176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.629383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.629582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.629808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.629923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.630012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.630090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.630115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.630206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.630320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.630346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.405 qpair failed and we were unable to recover it. 00:30:42.405 [2024-11-16 17:50:19.630432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.405 [2024-11-16 17:50:19.630543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.630569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.630669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.630754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.630779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.630867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.630957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.630982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.631069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.631209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.631234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.631321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.631451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.631482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.631592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.631687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.631714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.631863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.631973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.631999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.632088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.632193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.632223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.632338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 EAL: No free 2048 kB hugepages reported on node 1 00:30:42.406 [2024-11-16 17:50:19.632455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.632480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.632566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.632658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.632684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.632799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.632872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.632897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.632994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.633181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.633410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.633679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.633883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.633999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.634108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.634334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.634541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.634783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.634924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.635014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.635107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.635132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.635216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.635326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.635352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.635440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.635547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.635573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.406 qpair failed and we were unable to recover it. 00:30:42.406 [2024-11-16 17:50:19.635668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.406 [2024-11-16 17:50:19.635760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.635786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.635881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.635974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.636116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.636340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.636594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.636809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.636976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.637094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.637184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.637210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.637335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.637426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.637451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.637557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.637652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.637678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.637770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.637880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.637905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.638014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.638129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.638155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.638297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.638382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.638408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.638496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.638586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.638612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.638762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.638856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.638881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.638974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.639066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.639092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.639213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.639325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.639351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.639466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.639578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.639604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.639733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.639844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.639870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.639962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.640052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.640077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.407 [2024-11-16 17:50:19.640158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.640234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.407 [2024-11-16 17:50:19.640259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.407 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.640345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.640484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.640509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.640602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.640702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.640728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.640837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.640923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.640949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.641055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.641145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.641171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.641257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.641365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.641390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.641513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.641633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.641659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.641781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.641864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.641890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.641970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.642229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.642457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.642671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.642869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.642980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.643103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.643351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.643527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.643749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.643918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.644005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.644204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.644420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.644614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.408 [2024-11-16 17:50:19.644825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.408 [2024-11-16 17:50:19.644941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.408 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.645063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.645145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.645170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.645289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.645376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.645402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.645518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.645605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.645636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.645720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.645836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.645862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.645955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.646161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.646387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.646600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.646832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.646977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.647096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.647168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.647194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.647274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.647351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.647376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.647458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.647536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.647561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.647682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.647796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.647823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.647920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.648157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.648368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.648625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.648814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.648927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.649012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.649083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.649109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.649223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.649316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.649342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.409 qpair failed and we were unable to recover it. 00:30:42.409 [2024-11-16 17:50:19.649451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.409 [2024-11-16 17:50:19.649556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.649581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.649672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.649784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.649809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.649900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.650164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.650350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.650570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.650842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.650976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.651100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.651209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.651234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.651314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.651431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.651457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.651548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.651662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.651689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.651805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.651946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.651972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.652063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.652201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.652226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.652312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.652420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.652445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.652523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.652613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.652644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.652757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.652849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.652874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.652955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.653181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.653429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.653654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.653852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.653959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.654076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.654188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.654213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.654295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.654382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.654407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.410 [2024-11-16 17:50:19.654497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.654575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.410 [2024-11-16 17:50:19.654601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.410 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.654724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.654840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.654866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.654955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.655161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.655356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.655584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.655835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.655972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.656064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.656155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.656181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.656270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.656381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.656406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.656496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.656580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.656606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.656734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.656820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.656845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.656959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.657052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.657078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.657199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.657311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.657337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.657416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.657532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.657558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.657685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.657779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.657805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.657918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.658031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.658057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.658169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.658285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.658311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.658456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.658573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.658599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.658748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.658854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.658879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.658977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.659161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.659358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.659581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.411 qpair failed and we were unable to recover it. 00:30:42.411 [2024-11-16 17:50:19.659841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.411 [2024-11-16 17:50:19.659925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.659951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.660042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.660157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.660182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.660296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.660378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.660403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.660495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.660599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.660633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.660747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.660865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.660890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.660971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.661222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.661431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.661677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.661890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.661977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.662123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.662376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.662612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.662829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.662967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.663081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.663165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.663191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.663286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.663396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.663421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.663542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.663654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.663685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.663774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.663864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.663889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.664007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.664257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.664448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.664632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.412 qpair failed and we were unable to recover it. 00:30:42.412 [2024-11-16 17:50:19.664829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.412 [2024-11-16 17:50:19.664942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.664968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.665053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.665137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.665163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.665278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.665364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.665389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.665471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.665550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.665575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.665710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.665793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.665819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.665929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.666210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.666412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.666602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.666852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.666961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.667076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.667193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.667219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.667302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.667385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.667410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.667498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.667609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.667641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.667726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.667819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.667844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.667968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.668045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.668070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.668192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.668329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.668355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.668443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.668558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.668583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.413 qpair failed and we were unable to recover it. 00:30:42.413 [2024-11-16 17:50:19.668680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.668770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.413 [2024-11-16 17:50:19.668795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.668894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.669123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.669357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.669592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.669851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.669964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.670042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.670142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.670168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.670259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.670352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.670378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.670470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.670589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.670614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.670743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.670831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.670856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.671001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.671083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.671109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.671219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.671327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.671352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.671467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.671549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.671574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.671686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.671803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.671828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.671916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.672146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.672386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.672575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.672838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.672974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.673054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.673147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.673174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.673258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.673354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.673379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.414 qpair failed and we were unable to recover it. 00:30:42.414 [2024-11-16 17:50:19.673463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.414 [2024-11-16 17:50:19.673574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.673600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.673731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.673845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.673870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.673957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.674189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.674398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.674627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.674821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.674925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.675017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.675238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.675473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.675682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.675899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.675983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.676091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.676323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.676507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.676723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.676861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.676997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.677228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.677451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:42.415 [2024-11-16 17:50:19.677543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.677682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.677879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.677988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.678079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.678160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.678186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.415 [2024-11-16 17:50:19.678295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.678393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.415 [2024-11-16 17:50:19.678423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.415 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.678518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.678595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.678626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.678738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.678821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.678847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.678937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.679156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.679368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.679574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.679776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.679880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.679972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.680087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.680112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.680200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.680305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.680331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.680441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.680554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.680579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.680688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.680803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.680828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.680913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.681029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.681055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.681172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.681253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.681279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.681420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.681497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.681523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.681655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.681747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.681774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.681891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.682113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.682341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.682537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.682759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.682868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.682963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.683071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.416 [2024-11-16 17:50:19.683096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.416 qpair failed and we were unable to recover it. 00:30:42.416 [2024-11-16 17:50:19.683212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.683330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.683355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.683470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.683608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.683638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.683723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.683844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.683870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.683956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.684041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.684067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.684149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.684225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.684250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.684341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.684460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.684486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.684629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.684764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.684790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.684885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.685129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.685352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.685609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.685808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.685937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.686059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.686147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.686173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.686249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.686366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.686393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.686471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.686591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.686623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.686750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.686844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.686870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.686957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.687240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.687449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.687654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.687848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.687986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.688078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.688191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.688217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.417 qpair failed and we were unable to recover it. 00:30:42.417 [2024-11-16 17:50:19.688307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.417 [2024-11-16 17:50:19.688414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.688440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.688533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.688620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.688652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.688733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.688839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.688864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.688955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.689161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.689416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.689635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.689873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.689986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.690104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.690295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.690537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.690801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.690905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.691019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.691202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.691421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.691676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.691887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.691974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.692100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.692362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.692564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.692761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.692881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.692962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.693053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.693078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.693159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.693262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.418 [2024-11-16 17:50:19.693288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.418 qpair failed and we were unable to recover it. 00:30:42.418 [2024-11-16 17:50:19.693374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.693470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.693496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.693605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.693718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.693744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.693860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.693958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.693984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.694095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.694181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.694206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.694320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.694412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.694438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.694530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.694646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.694672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.694756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.694883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.694908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.695053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.695168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.695194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.695285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.695395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.695421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.695512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.695627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.695655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.695733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.695843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.695870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.695956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.696150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.696384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.696622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.696856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.696981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.419 qpair failed and we were unable to recover it. 00:30:42.419 [2024-11-16 17:50:19.697070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.697183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.419 [2024-11-16 17:50:19.697209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.697299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.697388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.697414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.697503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.697626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.697652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.697739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.697832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.697857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.697935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.698150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.698385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.698599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.698788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.698905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.698986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.699188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.699372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.699591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.699835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.699973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.700088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.700165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.700191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.700276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.700365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.700391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.700528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.700641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.700668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.700760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.700877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.700903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.701016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.701108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.701135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.701232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.701346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.701375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.701496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.701583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.701609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.701743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.701847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.420 [2024-11-16 17:50:19.701872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.420 qpair failed and we were unable to recover it. 00:30:42.420 [2024-11-16 17:50:19.701989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.702202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.702429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.702626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.702828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.702992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.703073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.703156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.703182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.703299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.703385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.703410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.703494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.703573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.703598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.703706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.703818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.703844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.703938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.704049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.704074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.704160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.704277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.704302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.704394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.704480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.704506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.704596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.704731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.704758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.704868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.705175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.705382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.705602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.705821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.705964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.706085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.706195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.706220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.706338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.706434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.706460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.706575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.706693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.706719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.421 [2024-11-16 17:50:19.706835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.706917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.421 [2024-11-16 17:50:19.706944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.421 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.707084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.707161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.707187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.707270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.707378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.707403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.707484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.707570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.707597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.707709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.707824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.707851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.707928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.708131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.708352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.708558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.708785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.708895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.708977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.709063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.709090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.709209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.709347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.709373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.709460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.709543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.709569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.709686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.709769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.709796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.709908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.710131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.710360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.710593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.710846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.710956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.711109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.711222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.711247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.711364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.711450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.711476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.711590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.711741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.711767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.711876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.711987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.712133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.712357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.712604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.712824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.712996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.713084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.713197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.713224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.422 qpair failed and we were unable to recover it. 00:30:42.422 [2024-11-16 17:50:19.713315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.422 [2024-11-16 17:50:19.713424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.713451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.713540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.713653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.713680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.713773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.713863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.713889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.713983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.714212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.714430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.714631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.714837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.714975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.715058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.715151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.715177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.715265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.715343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.715369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.715466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.715583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.715608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.715698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.715815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.715841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.715935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.716157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.716347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.716538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.716778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.716890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.717006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.717120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.717146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.717242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.717357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.717383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.717497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.717646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.717673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.717771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.717876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.717902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.718017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.718105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.718132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.718254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.718391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.718417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.718503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.718588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.718621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.718711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.718801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.718827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.718937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.719057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.719084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.423 qpair failed and we were unable to recover it. 00:30:42.423 [2024-11-16 17:50:19.719195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.423 [2024-11-16 17:50:19.719312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.719338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.719443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.719525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.719552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.719666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.719775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.719801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.719883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.719962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.719996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.720097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.720215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.720241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.720342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.720425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.720450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.720536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.720629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.720659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.720753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.720837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.720864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.720947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.721173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.721422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.721628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.721829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.721952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.722045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.722131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.722156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.722243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.722351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.722382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.722510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.722598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.722631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.722753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.722846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.722873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.722998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.723243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.723440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.723670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.723907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.723989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.724126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.724345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.724552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.724792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.724935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.424 qpair failed and we were unable to recover it. 00:30:42.424 [2024-11-16 17:50:19.725012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.424 [2024-11-16 17:50:19.725126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.725152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.725246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.725359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.725385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.725513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.725629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.725673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.725793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.725902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.725936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.726017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.726236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.726436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.726659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.726866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.726975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.727115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.727199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.727224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.727312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.727393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.727419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.727507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.727599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.727644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.727767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.727856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.727882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.727956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.728185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.728418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.728673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.728903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.728986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.729123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.729381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.729579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.729834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.729944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.730058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.730173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.730198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.425 qpair failed and we were unable to recover it. 00:30:42.425 [2024-11-16 17:50:19.730320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.425 [2024-11-16 17:50:19.730425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.730451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.730562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.730678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.730704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.730786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.730874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.730902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.731021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.731232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.731428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.731620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.731843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.731982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.732124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.732209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.732234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.732323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.732403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.732428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.732515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.732599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.732637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.732766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.732860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.732885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.732976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.733093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.733118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.733227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.733337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.733363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.733503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.733642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.733680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.733767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.733849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.733876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.733974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.734088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.734118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.734230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.734338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.734363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.734442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.734534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.734560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.734675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.734763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.734789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.734880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.735132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.735330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.735541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.735766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.735904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.736023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.736131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.736156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.736240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.736365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.736390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.736481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.736621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.426 [2024-11-16 17:50:19.736653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.426 qpair failed and we were unable to recover it. 00:30:42.426 [2024-11-16 17:50:19.736771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.736883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.736909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.736994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.737130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.737156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.737296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.737386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.737411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.737528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.737611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.737643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.737752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.737841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.737866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.737948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.738163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.738397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.738664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.738869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.738982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.739103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.739202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.739228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.739371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.739491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.739516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.739603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.739688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.739714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.739805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.739916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.739941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.740023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.740101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.740126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.740254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.740340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.740366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.740477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.740561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.740588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.740689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.740807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.740833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.740951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.741200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.741422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.741630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.741852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.741987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.742070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.742176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.742201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.742295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.742374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.742399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.742489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.742599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.742631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.742726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.742822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.742848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.427 qpair failed and we were unable to recover it. 00:30:42.427 [2024-11-16 17:50:19.742953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.427 [2024-11-16 17:50:19.743050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.743191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.743392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.743630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.743836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.743976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.744067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.744175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.744202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.744292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.744401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.744428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.744524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.744610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.744649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.744770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.744850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.744876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.744991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.745088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.745114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.745201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.745320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.745347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.745462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.745546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.745573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.745660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.745747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.745774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.745899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.746035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.746062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.746140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.746227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.746255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.746350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.746442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.746468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.746611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.746746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.746773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.746893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.747125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.747373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.747627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.747841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.747986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.748074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.748280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.748504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.748710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.748914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.748995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.749021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.428 qpair failed and we were unable to recover it. 00:30:42.428 [2024-11-16 17:50:19.749106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.749183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.428 [2024-11-16 17:50:19.749209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.749323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.749438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.749465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.749555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.749649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.749677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.749765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.749854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.749881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.749970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.750170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.750374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.750605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.750841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.750959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.751076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.751166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.751192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.751307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.751402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.751428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.751535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.751610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.751642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.751727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.751810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.751837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.751977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.752169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.752357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.752561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.752795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.752912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.753023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.753139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.753165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.753251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.753361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.753387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.753474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.753588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.753631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.753722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.753860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.753886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.753999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.754088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.754115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.754206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.754319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.754345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.754433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.754518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.754543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.429 [2024-11-16 17:50:19.754664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.754754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.429 [2024-11-16 17:50:19.754781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.429 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.754902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.754991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.755105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.755342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.755563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.755772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.755920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.756012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.756123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.756150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.756272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.756364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.756390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.756505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.756619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.756647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.756742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.756833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.756859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.756963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.757191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.757424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.757666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.757858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.757985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.758093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.758209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.758235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.758326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.758434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.758460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.758551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.758644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.758672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.758761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.758877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.758904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.758984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.759084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.759110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.759206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.759319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.759345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.759430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.759543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.759569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.759675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.759765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.759792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.759900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.760131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.760326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.760561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.760768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.760917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.761009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.761097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.761124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.761233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.761350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.430 [2024-11-16 17:50:19.761376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.430 qpair failed and we were unable to recover it. 00:30:42.430 [2024-11-16 17:50:19.761500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.761589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.761629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.761718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.761809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.761835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.761945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.762179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.762415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.762649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.762853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.762968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.763082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.763223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.763249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.763337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.763455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.763481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.763608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.763729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.763755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.763836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.763925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.763953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.764037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.764141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.764177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.764292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.764382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.764409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.764497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.764585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.764628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.764726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.764837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.764865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.764978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.765065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.765091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.765209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.765304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.765331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.765451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.765537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.765564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.765688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.765768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.765794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.765902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.766144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.766398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.766604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.766814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.766963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.767073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.767159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.767185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.767278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.767367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.767393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.767534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.767624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.767651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.767732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.767809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.767835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.767932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.768024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.768050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.768136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.768250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.768276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.768360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.768449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.768475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.431 qpair failed and we were unable to recover it. 00:30:42.431 [2024-11-16 17:50:19.768586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.431 [2024-11-16 17:50:19.768714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.768741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.768831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.768946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.768972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.769092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.769214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.769240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.769321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.769463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.769489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.769609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.769742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.769769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.769877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.769965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.769991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.770110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.770223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.770251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.770364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.770447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.770473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.770562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.770714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.770740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.770853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.770983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.771099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.771289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.771527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.771766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.771883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.771997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.772106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.772132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.772226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.772367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.772393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.772508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.772590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.772633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.772725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.772839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.772866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.772981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.773195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.773421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.773655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.773849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.773974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.774059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.774166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.774192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.774280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.774393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.774419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.774512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.774638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.774664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.774749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.774835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.774860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.774979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.775192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.775385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.775582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.775800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.775903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.432 qpair failed and we were unable to recover it. 00:30:42.432 [2024-11-16 17:50:19.776000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.432 [2024-11-16 17:50:19.776081] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:42.433 [2024-11-16 17:50:19.776105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.776213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776213] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:42.433 [2024-11-16 17:50:19.776236] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:42.433 [2024-11-16 17:50:19.776249] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:42.433 [2024-11-16 17:50:19.776291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.776304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:42.433 [2024-11-16 17:50:19.776394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:42.433 [2024-11-16 17:50:19.776351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:42.433 [2024-11-16 17:50:19.776355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:42.433 [2024-11-16 17:50:19.776484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.776628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.776823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.776961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.777077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.777190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.777216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.777298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.777382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.777407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.777496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.777609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.777646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.777743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.777833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.777863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.777962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.778069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.778094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.778197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.778340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.778365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.778482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.778572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.778598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.778752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.778846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.778872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.779006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.779096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.779121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.779230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.779322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.779348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.779427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.779541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.779567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.779700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.779786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.779813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.779936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.780186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.780427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.780679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.780879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.780991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.781103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.781333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.781516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.781730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.781865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.781971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.782158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.782410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.782662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.433 qpair failed and we were unable to recover it. 00:30:42.433 [2024-11-16 17:50:19.782869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.433 [2024-11-16 17:50:19.782983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.783122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.783347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.783570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.783818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.783964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.784054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.784144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.784169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.784252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.784374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.784400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.784488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.784606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.784639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.784735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.784822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.784848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.784943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.785152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.785382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.785581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.785822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.785930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.786020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.786110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.786136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.786222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.786300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.786325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.786431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.786515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.786541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.786671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.786791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.786816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.786925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.787144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.787370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.787608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.787816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.787935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.788051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.788163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.788189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.788306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.788395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.788420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.788508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.788592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.788623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.788719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.788853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.788878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.434 qpair failed and we were unable to recover it. 00:30:42.434 [2024-11-16 17:50:19.788997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.789077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.434 [2024-11-16 17:50:19.789102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.789188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.789296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.789322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.789405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.789513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.789542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.789665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.789747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.789773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.789853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.789941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.789967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.790059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.790138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.790164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.790254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.790362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.790387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.790503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.790647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.790673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.790789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.790879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.790915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.791035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.791131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.791157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.791241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.791361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.791387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.791502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.791589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.791621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.791739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.791830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.791855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.791951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.792090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.792115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.792195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.792287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.792313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.792432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.792545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.792570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.792669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.792759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.792784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.792876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.793128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.793364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.793566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.793772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.793886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.793980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.794197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.794433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.794646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.794873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.794993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.795107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.795185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.795211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.795306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.795397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.795423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.795541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.795661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.795687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.795769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.795853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.795884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.796006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.796086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.796111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.435 qpair failed and we were unable to recover it. 00:30:42.435 [2024-11-16 17:50:19.796200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.435 [2024-11-16 17:50:19.796317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.796342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.796423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.796540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.796566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.796667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.796759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.796785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.796892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.796969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.796995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.797112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.797221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.797246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.797334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.797414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.797440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.797546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.797649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.797676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.797753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.797829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.797854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.797948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.798066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.798091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.798187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.798296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.798321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.798405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.798511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.798536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.798644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.798755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.798785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.798885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.799175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.799361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.799557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.799795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.799902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.800007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.800194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.800407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.800639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.800840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.800982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.801012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.801129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.801220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.801246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.801342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.801485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.801510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.801642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.801758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.801784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.801875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.801995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.802113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.802338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.802572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.802799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.802923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.803010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.803128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.803154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.803238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.803328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.803354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.803445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.803550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.803576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.436 [2024-11-16 17:50:19.803708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.803801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.436 [2024-11-16 17:50:19.803827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.436 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.803924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.804116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.804380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.804592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.804819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.804934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.805035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.805122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.805147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.805255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.805366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.805392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.805477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.805588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.805622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.805724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.805821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.805847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.805929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.806168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.806363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.806607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.806858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.806977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.807087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.807169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.807195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.807281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.807366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.807392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.807506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.807624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.807651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.807778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.807859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.807885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.807971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.808174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.808379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.808649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.808884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.808992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.809084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.809172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.809198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.809316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.809399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.809425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.809521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.809611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.809649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.809768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.809877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.809902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.810023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.810105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.810130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.810243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.810358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.810388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.810484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.810599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.810631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.810726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.810807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.810833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.810950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.811033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.811059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.811144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.811231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.811257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.811348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.811434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.811459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.437 [2024-11-16 17:50:19.811570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.811654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.437 [2024-11-16 17:50:19.811680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.437 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.811764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.811843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.811868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.811987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.812101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.812127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.812214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.812300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.812326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.812442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.812525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.812551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.812676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.812761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.812786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.812895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.813116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.813340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.813575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.813833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.813954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.814095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.814191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.814217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.814298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.814402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.814428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.814567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.814691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.814717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.814841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.814932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.814958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.815085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.815200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.815226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.815320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.815403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.815428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.815505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.815642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.815668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.815787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.815874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.815908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.816006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.816111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.816136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.816228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.816322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.816347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.816431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.816544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.816570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.816699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.816786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.816812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.816932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.817024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.817050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.817159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.817302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.817328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.438 qpair failed and we were unable to recover it. 00:30:42.438 [2024-11-16 17:50:19.817446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.438 [2024-11-16 17:50:19.817530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.817555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.817680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.817766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.817792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.817884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.817976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.818091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.818288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.818516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.818787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.818922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.819024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.819129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.819155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.819232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.819320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.819346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.819426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.819532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.819558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.819663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.819763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.819789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.819931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.820134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.820385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.820610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.820817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.820951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.821073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.821164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.821190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.821284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.821367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.821392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.821508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.821586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.821631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.821727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.821830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.821856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.821950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.822039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.822068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.822184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.822276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.822302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.822389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.822528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.822553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.822668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.822769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.822795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.822882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.823032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.823057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.823137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.823224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.823249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.823338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.823441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.439 [2024-11-16 17:50:19.823467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.439 qpair failed and we were unable to recover it. 00:30:42.439 [2024-11-16 17:50:19.823552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.823655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.823681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.823767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.823884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.823916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.824007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.824094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.824119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.824234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.824331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.824357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.824466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.824557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.824583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.824709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.824788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.824814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.824912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.825144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.825337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.825564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.825795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.825933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.826024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.826113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.826138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.826218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.826310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.826336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.826429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.826543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.826568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.826703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.826793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.826819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.826942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.827033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.827058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.827144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.827260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.827286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.827428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.827517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.827543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.827655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.827775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.827801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.827929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.828172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.828378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.828574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.828799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.828946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.829035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.829242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.829464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.829696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.440 [2024-11-16 17:50:19.829885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.829991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.440 [2024-11-16 17:50:19.830016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.440 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.830101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.830216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.830242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.830335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.830459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.830486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.830612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.830727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.830753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.830867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.830992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.831097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.831325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.831579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.831794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.831923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.832006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.832227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.832446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.832675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.832899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.832995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.833113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.833342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.833542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.833775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.833887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.833976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.834183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.834379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.834580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.834833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.834945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.835091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.835179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.835206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.835299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.835378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.835403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.835500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.835589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.835613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.835714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.835823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.835849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.835942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.836030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.836055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.836145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.836226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.836252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-16 17:50:19.836340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.441 [2024-11-16 17:50:19.836452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.836486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.836574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.836667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.836693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.836800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.836895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.836921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.837008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.837212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.837416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.837651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.837886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.837983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.838125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.838315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.838533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.838780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.838886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.838981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.839178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.839398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.839622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.839818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.839930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.840013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.840130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.840156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.840262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.840359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.840385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.840515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.840636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.840662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.840748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.840837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.840864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.840960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.841054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.841079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.841188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.841270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.841296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.841371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.841459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.841485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.442 [2024-11-16 17:50:19.841575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.841737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.442 [2024-11-16 17:50:19.841764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.442 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.841855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.841950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.841977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.842091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.842175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.842201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.842310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.842393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.842418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.842495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.842611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.842648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.842739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.842831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.842857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.842998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.843205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.843440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.843664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.843856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.843979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.844148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.844339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.844565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.844843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.844967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.845048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.845138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.845163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.845277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.845356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.845382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.845458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.845575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.845613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.845717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.845829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.845854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.845980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.846210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.846418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.846660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.846855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.846973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.847066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.847183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.847209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.847306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.847398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.847424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.847519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.847594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.847629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.847716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.847827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.847853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.847952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.848048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.848074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.443 qpair failed and we were unable to recover it. 00:30:42.443 [2024-11-16 17:50:19.848187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.848299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.443 [2024-11-16 17:50:19.848325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.848420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.848510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.848536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.848636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.848721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.848749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.848834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.848946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.848984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.849072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.849187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.849212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.849287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.849363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.849388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.849517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.849640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.849667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.849751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.849835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.849861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.849968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.850061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.850087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.850198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.850276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.850301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.850398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.850479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.850504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.850593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.850687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.444 [2024-11-16 17:50:19.850714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.444 qpair failed and we were unable to recover it. 00:30:42.444 [2024-11-16 17:50:19.850806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.850895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.850932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.851020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.851136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.851162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.851252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.851340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.851366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.851460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.851551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.851577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.851674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.851768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.851793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.851913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.852151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.852375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.852572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.852824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.852937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.853024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.853113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.853139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.853226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.853312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.853338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.853425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.853514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.853540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.735 qpair failed and we were unable to recover it. 00:30:42.735 [2024-11-16 17:50:19.853638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.735 [2024-11-16 17:50:19.853720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.853746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.853844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.853940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.853980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.854100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.854216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.854242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.854324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.854414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.854439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.854527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.854626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.854653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.854771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.854861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.854887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.854995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.855110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.855136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.855212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.855348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.855374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.855466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.855576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.855613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.855774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.855858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.855883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.855974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.856057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.856083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.856168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.856281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.856307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.856399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.856503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.856529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.856627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.856745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.856771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.856884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.857120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.857346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.857635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.857842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.857978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.858093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.858301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.858497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.858711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.858865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.858956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.859179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.859374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.859619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.859865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.859978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.860003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.736 [2024-11-16 17:50:19.860081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.860171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.736 [2024-11-16 17:50:19.860196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.736 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.860288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.860397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.860423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.860510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.860592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.860629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.860719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.860838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.860864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.860950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.861155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.861410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.861643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.861845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.861979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.862120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.862236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.862262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.862338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.862414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.862441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.862557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.862666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.862697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.862783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.862896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.862932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.863049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.863158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.863184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.863266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.863352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.863382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.863467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.863557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.863582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.863739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.863825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.863851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.863952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.864191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.864401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.864605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.864812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.864961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.865049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.865158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.865184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.865271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.865359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.865384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.865475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.865585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.865632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.865760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.865847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.865874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.865961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.866052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.866078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.866189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.866279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.866304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.866394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.866478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.866504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.737 qpair failed and we were unable to recover it. 00:30:42.737 [2024-11-16 17:50:19.866627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.866717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.737 [2024-11-16 17:50:19.866743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.866825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.866906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.866940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.867056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.867134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.867159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.867299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.867393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.867418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.867500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.867585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.867624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.867710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.867816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.867841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.867945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.868158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.868349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.868597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.868814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.868965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.869085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.869166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.869192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.869332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.869417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.869442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.869546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.869663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.869690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.869775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.869854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.869879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.869991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.870068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.870095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.870207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.870369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.870399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.870495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.870609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.870643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.870735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.870849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.870875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.870958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.871087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.871113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.871196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.871301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.871328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.871411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.871556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.871583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.871694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.871807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.871833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.871946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.872154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.872350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.872610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.872872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.872998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.738 [2024-11-16 17:50:19.873087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.873200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.738 [2024-11-16 17:50:19.873228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.738 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.873341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.873420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.873446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.873534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.873655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.873685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.873783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.873875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.873903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.874017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.874215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.874443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.874643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.874835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.874955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.875068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.875144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.875171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.875285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.875364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.875390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.875471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.875579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.875630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.875715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.875813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.875840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.875959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.876072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.876099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.876214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.876294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.876320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.876413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.876549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.876577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.876689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.876803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.876830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.876915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.877211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.877421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.877653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.877850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.877997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.878087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.878170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.878196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.878274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.878384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.878413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.878493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.878580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.878623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.878718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.878807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.878833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.878962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.879113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.879141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.879229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.879346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.879373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.879462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.879578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.879625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.739 qpair failed and we were unable to recover it. 00:30:42.739 [2024-11-16 17:50:19.879741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.739 [2024-11-16 17:50:19.879821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.879847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.879986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.880094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.880122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.880213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.880302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.880329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.880442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.880534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.880560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.880665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.880748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.880776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.880926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.881147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.881343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.881533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.881774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.881890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.881982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.882215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.882422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.882607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.882805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.882926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.883013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.883092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.883122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.883231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.883308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.883334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.883420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.883505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.883531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.883622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.883739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.883766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.883879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.884143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.884339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.884590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.740 qpair failed and we were unable to recover it. 00:30:42.740 [2024-11-16 17:50:19.884797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.740 [2024-11-16 17:50:19.884925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.885006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.885119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.885146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.885265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.885352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.885379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.885461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.885553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.885579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.885689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.885829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.885860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.885994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.886085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.886115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.886199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.886314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.886347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.886467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.886564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.886596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.886713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.886810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.886839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.886938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.887140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.887355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.887579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.887794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.887908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.888058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.888171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.888197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.888284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.888376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.888402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.888496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.888588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.888627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.888742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.888831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.888857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.888939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.889163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.889355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.889623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.889824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.889936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.890053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.890168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.890196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.890277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.890383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.890410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.890487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.890598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.890632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.890752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.890834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.890861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.890961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.891084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.891113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.891195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.891270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.741 [2024-11-16 17:50:19.891296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.741 qpair failed and we were unable to recover it. 00:30:42.741 [2024-11-16 17:50:19.891385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.891493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.891519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.891604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.891692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.891718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.891808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.891888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.891914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.892002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.892226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.892453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.892660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.892857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.892962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.893092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.893189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.893219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.893321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.893416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.893446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.893538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.893627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.893655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.893747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.893861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.893887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.893965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.894210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.894416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.894647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.894849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.894960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.895068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.895158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.895185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.895277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.895360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.895387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.895500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.895588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.895630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.895721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.895817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.895843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.895958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.896209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.896404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.896584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.896820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.896930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.897040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.897131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.897157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.897269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.897383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.742 [2024-11-16 17:50:19.897409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.742 qpair failed and we were unable to recover it. 00:30:42.742 [2024-11-16 17:50:19.897501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.897584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.897612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.897736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.897826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.897852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.897947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.898168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.898368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.898594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.898807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.898927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.899016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.899240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.899486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.899708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.899901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.899999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.900112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.900331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.900523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.900722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.900829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.900922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.901146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.901336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.901560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.901770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.901880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.901982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.902078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.902111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.902207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.902326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.902354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.902475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.902637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.902677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.902825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.902909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.902940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.903056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.903147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.903175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.903300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.903389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.903417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.903504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.903628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.903665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.743 [2024-11-16 17:50:19.903755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.903842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.743 [2024-11-16 17:50:19.903869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.743 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.903959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.904151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.904346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.904569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.904833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.904955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.905041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.905123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.905149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.905267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.905379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.905406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.905481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.905587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.905613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.905713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.905808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.905834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.905928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.906127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.906375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.906572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.906770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.906877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.907000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.907243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.907464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.907680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.907872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.907973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.908087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.908171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.908198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.908308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.908387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.908414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.908488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.908563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.908594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.908700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.908813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.908839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.908935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.909015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.909042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.744 [2024-11-16 17:50:19.909126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.909208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.744 [2024-11-16 17:50:19.909234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.744 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.909313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.909399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.909424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.909502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.909578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.909604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.909710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.909797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.909823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.909922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.910157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.910389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.910628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.910918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.910999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.911112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.911387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.911610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.911849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.911997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.912074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.912156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.912183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.912322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.912462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.912488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.912604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.912718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.912744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.912824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.912909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.912935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.913018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.913224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.913467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.913706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.913891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.913985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.914091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.914290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.914517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.914730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.914837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.914928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.915005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.915031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.915107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.915221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.915246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.915371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.915459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.915485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.745 qpair failed and we were unable to recover it. 00:30:42.745 [2024-11-16 17:50:19.915593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.745 [2024-11-16 17:50:19.915688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.915714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.915839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.915929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.915955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.916037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.916124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.916151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.916244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.916330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.916356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.916468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.916576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.916602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.916759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.916839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.916864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.916957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.917172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.917397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.917628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.917829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.917934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.918010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.918089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.918115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.918230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.918307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.918333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.918417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.918497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.918523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.918638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.918762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.918788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.918906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.919136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.919368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.919589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.919800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.919924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.920062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.920261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.920466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.920659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.920863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.920982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.921065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.921147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.921173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.921285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.921373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.921399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.921516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.921593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.921623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.921732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.921805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.746 [2024-11-16 17:50:19.921830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.746 qpair failed and we were unable to recover it. 00:30:42.746 [2024-11-16 17:50:19.921939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.922162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.922359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.922583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.922861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.922980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.923057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.923252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.923473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.923705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.923889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.923977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.924114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.924338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.924554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.924752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.924886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.925008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.925239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.925430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.925631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.925869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.925981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.926092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.926274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.926508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.926721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.926903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.926982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.927119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.927309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.927518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.927754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.927855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.747 [2024-11-16 17:50:19.927944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.928026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.747 [2024-11-16 17:50:19.928052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.747 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.928163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.928277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.928303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.928385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.928462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.928488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.928581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.928689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.928715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.928828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.928940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.928965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.929049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.929239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.929426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.929626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.929869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.929975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.930061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.930197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.930222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.930333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.930416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.930441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.930557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.930644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.930679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.930787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.930905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.930937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.931019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.931102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.931127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.931239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.931320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.931345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.931423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.931528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.931554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.931676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.931771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.931796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.931887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.932111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.932301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.932502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.932704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.932841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.932928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.933041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.933067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.933183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.933260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.933286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.933368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.933473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.933499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.933611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.933741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.933768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.933886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.934008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.934033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.934119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.934200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.934226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.748 qpair failed and we were unable to recover it. 00:30:42.748 [2024-11-16 17:50:19.934333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.934441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.748 [2024-11-16 17:50:19.934467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.934548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.934640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.934678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.934768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.934851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.934877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.934955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.935182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.935442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.935647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.935846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.935986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.936099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.936184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.936210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.936318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.936402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.936427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.936504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.936582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.936608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.936708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.936790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.936815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.936901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.937130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.937329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.937543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.937754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.937856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.937950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.938162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.938356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.938563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.938770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.938875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.938958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.939041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.939067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.939156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.939271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.939297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.939384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.939463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.939488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.749 [2024-11-16 17:50:19.939595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.939714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.749 [2024-11-16 17:50:19.939740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.749 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.939853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.939945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.939971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.940049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.940131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.940157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.940297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.940382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.940407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.940522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.940603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.940635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.940760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.940844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.940869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.940949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.941154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.941341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.941536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.941767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.941879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.942002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.942183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.942358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.942536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.942734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.942840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.942927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.943116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.943305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.943523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.943786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.943900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.943986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.944061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.944086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.944226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.944317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.944344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.944459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.944565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.944591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.944721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.944837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.944862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.944956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.945175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.945394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.945610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.750 [2024-11-16 17:50:19.945839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.750 [2024-11-16 17:50:19.945948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.750 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.946063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.946147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.946172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.946286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.946396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.946421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.946526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.946646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.946679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.946756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.946840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.946866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.946963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.947150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.947409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.947597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.947852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.947969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.948061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.948176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.948200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.948281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.948371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.948396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.948473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.948583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.948609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.948710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.948793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.948817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.948927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.949130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.949316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.949512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.949741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.949853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.949945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.950137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.950326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.950515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.950753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.950892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.950982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.951123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.951148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.951227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.951308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.951333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.951445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.951564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.951589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.951702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.951816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.951842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.951941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.952031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.952057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.751 qpair failed and we were unable to recover it. 00:30:42.751 [2024-11-16 17:50:19.952136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.952244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.751 [2024-11-16 17:50:19.952269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.952348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.952431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.952457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.952574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.952660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.952686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.952797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.952887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.952917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.953006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.953122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.953147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.953237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.953347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.953374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.953493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.953581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.953607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.953711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.953790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.953815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.953898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.954120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.954309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.954524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.954759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.954897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.954982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.955184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.955362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.955605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.955840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.955968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.956054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.956170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.956196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.956284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.956369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.956394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.956483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.956586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.956611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.956708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.956790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.956815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.956899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.957009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.957034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.957116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.957258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.957284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.957423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.957529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.957562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.957672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.957796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.957823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.957943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.958054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.958081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.958197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.958278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.958303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.958408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.958494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.958519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.752 qpair failed and we were unable to recover it. 00:30:42.752 [2024-11-16 17:50:19.958613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.752 [2024-11-16 17:50:19.958715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.958740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.958830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.958940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.958966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.959044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.959125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.959150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.959250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.959365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.959390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.959500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.959593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.959632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.959728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.959852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.959884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.959985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.960074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.960106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.960228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.960322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.960354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.960480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.960566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.960597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.960704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.960792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.960821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.960913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.961180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.961422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.961670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.961907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.961989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.962123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.962349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.962557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.962746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.962855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.962999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.963182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.963376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.963634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.963866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.963986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.964103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.964219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.964247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.964341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.964461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.964497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.753 qpair failed and we were unable to recover it. 00:30:42.753 [2024-11-16 17:50:19.964613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.753 [2024-11-16 17:50:19.964711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.964742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.964855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.964942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.964968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.965112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.965226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.965259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.965381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.965499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.965526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.965610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.965738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.965766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.965865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.965945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.965970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.966052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.966162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.966188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.966278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.966388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.966413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.966493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.966577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.966602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.966699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.966782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.966811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.966957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.967143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.967405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.967600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.967804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.967940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.968029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.968142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.968167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.968242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.968315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.968341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.968457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.968596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.968629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.968739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.968827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.968853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.968965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.969193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.969385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.969599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.969833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.969935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.970014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.970230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.970425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.970649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.970904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.970985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.754 [2024-11-16 17:50:19.971010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.754 qpair failed and we were unable to recover it. 00:30:42.754 [2024-11-16 17:50:19.971090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.971170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.971196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.971307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.971396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.971421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.971503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.971619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.971651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.971797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.971872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.971898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.972017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.972209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.972418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.972635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.972828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.972932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.973046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.973154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.973180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.973270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.973384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.973409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.973521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.973610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.973642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.973728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.973820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.973845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.973961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.974151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.974361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.974565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.974777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.974916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.974993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.975212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.975428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.975654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.975884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.975992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.976106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.976195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.976220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.976342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.976418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.976442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.976520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.976599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.976633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.976748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.976820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.976845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.976924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.977029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.977055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.755 [2024-11-16 17:50:19.977146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.977256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.755 [2024-11-16 17:50:19.977281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.755 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.977372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.977483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.977509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.977593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.977686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.977712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.977827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.977909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.977934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.978016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.978210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.978430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.978656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.978872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.978984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.979093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.979279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.979506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.979739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.979845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.979962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.980149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.980337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.980548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.980740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.980845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.980924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.981148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.981347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.981573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.981815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.981919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.982001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.982104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.982129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.982232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.982326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.982354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.982443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.982557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.982585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.982711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.982806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.982834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.982974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.983096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.983129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.756 [2024-11-16 17:50:19.983250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.983346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.756 [2024-11-16 17:50:19.983372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.756 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.983490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.983647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.983676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.983772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.983856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.983886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.984013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.984132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.984159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.984244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.984323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.984351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.984480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.984558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.984584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.984699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.984792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.984818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.984933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.985126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.985345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.985564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.985796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.985909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.986023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.986136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.986161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.986247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.986329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.986355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.986437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.986517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.986543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.986647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.986755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.986781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.986898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.987121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.987335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.987580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.987778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.987918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.988013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.988124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.988150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.988257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.988350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.988375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.988459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.988551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.988577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.988712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.988803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.988829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.988918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.989030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.989056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.989139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.989254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.989284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.989367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.989456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.989481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.757 [2024-11-16 17:50:19.989597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.989717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.757 [2024-11-16 17:50:19.989743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.757 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.989831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.989915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.989942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.990035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.990111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.990137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.990275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.990381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.990407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.990483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.990595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.990627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.990710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.990795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.990821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.990944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.991162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.991413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.991603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.991820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.991932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.992009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.992195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.992428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.992679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.992896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.992981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.993087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.993280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.993474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.993711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.993864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.993975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.994173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.994391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.994658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.994892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.994996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.758 [2024-11-16 17:50:19.995109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.995223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.758 [2024-11-16 17:50:19.995248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.758 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.995335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.995408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.995434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.995547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.995630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.995656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.995753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.995866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.995891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.995976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.996181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.996399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.996629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.996861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.996975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.997002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.997084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.997197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.997223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.997305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.997388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.997413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.997603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.997731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.997757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.997867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.997982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.998086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.998296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.998496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.998751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.998856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.998939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.999128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.999452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.999677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:19.999866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:19.999975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:20.000080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:20.000336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:20.000550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:20.000805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.000937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:20.001018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.001101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.001127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:20.001215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.001307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.001333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:20.001416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.001505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.001532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.759 qpair failed and we were unable to recover it. 00:30:42.759 [2024-11-16 17:50:20.001628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.759 [2024-11-16 17:50:20.001718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.001745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.001835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.001922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.001948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.002060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.002244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.002443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.002638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.002840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.002948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.003061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.003187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.003213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.003356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.003450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.003476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.003556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.003653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.003679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.003773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.003866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.003892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.003980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.004071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.004097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.004183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.004271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.004297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.004386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.004482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.004507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.004622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.004781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.004817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.004961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.005221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.005450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.005667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.005876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.005997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.006086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.006170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.006196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.006278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.006360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.006386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.006480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.006564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.006591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.006699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.006806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.006837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.006926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.007167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.007393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.007638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.007836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.760 [2024-11-16 17:50:20.007947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.760 qpair failed and we were unable to recover it. 00:30:42.760 [2024-11-16 17:50:20.008069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.008269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.008464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.008670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.008859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.008973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.009055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.009259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.009474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.009673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.009864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.009979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.010099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.010294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.010521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.010722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.010860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.010944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.011139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.011369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.011566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.011768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.011877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.011959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.012151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.012362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.012609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.012806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.012925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.013014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.013201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.013447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.013687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.761 qpair failed and we were unable to recover it. 00:30:42.761 [2024-11-16 17:50:20.013896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.761 [2024-11-16 17:50:20.013978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.014133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.014359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.014595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.014810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.014916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.014999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.015195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.015395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.015585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.015786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.015907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.015991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.016219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.016414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.016599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.016804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.016923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.017008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.017117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.017143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.017231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.017310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.017337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.017432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.017545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.017571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.017668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.017752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.017780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.017861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.018149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.018417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.018600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.018806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.018915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.018995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.019231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.019471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.019676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.762 [2024-11-16 17:50:20.019876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.019982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.762 [2024-11-16 17:50:20.020007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.762 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.020096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.020175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.020208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.020300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.020412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.020440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.020554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.020658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.020688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.020775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.020865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.020893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.021023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.021124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.021163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.021254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.021339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.021367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.021464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.021561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.021600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.021708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.021832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.021873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.021968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.022071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.022098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.022224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.022319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.022357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.022452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.022538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.022564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.022689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.022820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.022849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.022951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.023148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.023339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.023543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.023764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.023872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.023971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.024174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.024402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.024638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.024888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.024999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.025030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.025194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.025279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.025306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.025393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.025486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.025515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.025611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.025703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.025730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.763 qpair failed and we were unable to recover it. 00:30:42.763 [2024-11-16 17:50:20.025823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.763 [2024-11-16 17:50:20.027391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.027438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.027553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.027646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.027674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.027764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.027852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.027879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.027968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.028177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.028405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.028606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.028845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.028961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.029043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.029160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.029187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.029307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.029387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.029413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.029528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.029619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.029647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.029748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.029844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.029874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.030000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.030224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.030431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.030693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.030885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.030974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.031121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.031308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.031537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.031765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.031881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.031975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.032215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.032448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.032661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.032872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.032984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.033009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.033121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.033200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.033231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.033318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.033396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.033424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.033508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.033626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.764 [2024-11-16 17:50:20.033653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.764 qpair failed and we were unable to recover it. 00:30:42.764 [2024-11-16 17:50:20.033747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.033831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.033856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.033944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.034166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.034387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.034577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.034839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.034952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.035034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.035179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.035205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.035320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.035411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.035443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.035563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.035681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.035708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.035802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.035927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.035954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.036065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.036143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.036169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.036252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.036356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.036383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.036483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.036599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.036634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.036728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.036814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.036839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.036923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.037146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.037366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.037584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.037851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.037957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.038041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.038156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.038182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.038297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.038379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.038406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.038493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.038591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.038628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.038781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.038871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.038897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.038980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.039172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.039402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.039588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.039803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.765 [2024-11-16 17:50:20.039917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.765 qpair failed and we were unable to recover it. 00:30:42.765 [2024-11-16 17:50:20.040012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.040098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.040124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.040262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.040338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.040364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.040476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.040563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.040589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.040680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.040760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.040786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.040892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.041034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.041060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.041140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.041250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.041276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.041364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.041480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.041508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.041596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.041718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.041746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.041891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.042106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.042343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.042557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.042754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.042894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.042977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.043200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.043400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.043585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.043821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.043930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.044050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.044160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.044187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.044305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.044389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.044417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.044540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.044670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.044698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.044780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.044868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.044895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.045005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.045119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.045144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.045255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.045332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.045358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.045484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.045592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.045624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.045707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.045823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.045850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.045965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.046080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.046107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.046193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.046303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.046329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.766 qpair failed and we were unable to recover it. 00:30:42.766 [2024-11-16 17:50:20.046417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.766 [2024-11-16 17:50:20.046563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.046589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.046676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.046766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.046792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.046885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.046966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.046993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.047110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.047220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.047246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.047328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.047405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.047432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.047548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.047634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.047663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.047754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.047842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.047869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.047959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.048137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.048323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.048570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.048804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.048905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.049018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.049216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.049413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.049649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.049858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.049975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.050094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.050289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.050544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.050775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.050922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.051038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.051134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.051161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.051262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.051418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.051445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.051525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.051664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.051691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.051778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.051886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.767 [2024-11-16 17:50:20.051912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.767 qpair failed and we were unable to recover it. 00:30:42.767 [2024-11-16 17:50:20.051995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.052178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.052400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.052661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.052857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.052962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.053048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.053169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.053196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.053308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.053400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.053427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.053547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.053642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.053671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.053753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.053831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.053858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.053949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.054178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.054394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.054625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.054846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.054996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.055073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.055151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.055178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.055260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.055342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.055370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.055456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.055560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.055587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.055695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.055849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.055881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.055977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.056176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.056437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.056662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.056850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.056955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.057045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.057126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.057154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.057270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.057357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.057385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.057467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.057582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.057609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.057742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.057836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.057863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.057950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.058063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.058091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.768 qpair failed and we were unable to recover it. 00:30:42.768 [2024-11-16 17:50:20.058168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.768 [2024-11-16 17:50:20.058278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.058305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.058413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.058522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.058548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.058658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.058775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.058802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.058894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.058972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.058998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.059083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.059179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.059206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.059290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.059429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.059456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.059538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.059625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.059653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.059738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.059859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.059886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.059975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.060199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.060456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.060651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.060870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.060974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.061086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.061161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.061188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.061270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.061346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.061374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.061458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.061566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.061592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.061681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.061789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.061816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.061932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.062149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.062404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.062597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.062807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.062942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.063039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.063133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.063162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.063244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.063322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.063349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.063459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.063564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.063591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.063684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.063790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.063817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.063928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.064040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.064066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.064160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.064241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.064269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.769 qpair failed and we were unable to recover it. 00:30:42.769 [2024-11-16 17:50:20.064359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.769 [2024-11-16 17:50:20.064471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.064498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.064578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.064704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.064736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.064824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.064923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.064951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.065096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.065176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.065203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.065288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.065428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.065455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.065539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.065636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.065664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.065775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.065859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.065886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.066001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.066114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.066141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.066222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.066334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.066362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.066447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.066594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.066628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.066725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.066865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.066892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.067002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.067114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.067146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.067263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.067341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.067368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.067479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.067561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.067588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.067681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.067792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.067819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.067930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.068143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.068344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.068569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.068793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.068899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.068983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.069204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.069434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.069640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.069864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.069969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.070086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.070196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.070222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.070301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.070383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.070410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.070535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.070627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.070655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.770 qpair failed and we were unable to recover it. 00:30:42.770 [2024-11-16 17:50:20.070766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.070857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.770 [2024-11-16 17:50:20.070883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.070965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.071218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.071439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.071649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.071845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.071989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.072108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.072194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.072222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.072340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.072417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.072444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.072561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.072648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.072676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.072764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.072841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.072868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.072955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.073150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.073344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.073604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.073832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.073982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.074090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.074309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.074570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.074789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.074896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.074983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.075168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.075418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.075612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.075801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.075916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.076008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.076199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.076401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.076627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.771 qpair failed and we were unable to recover it. 00:30:42.771 [2024-11-16 17:50:20.076883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.771 [2024-11-16 17:50:20.076968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.076994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.077144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.077219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.077245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.077353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.077461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.077488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.077601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.077689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.077718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.077861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.077942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.077969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.078050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.078137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.078165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.078283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.078402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.078429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.078544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.078639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.078667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.078755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.078836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.078864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.078989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.079209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.079406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.079636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.079857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.079976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.080095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.080207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.080235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.080322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.080451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.080479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.080570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.080692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.080720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.080835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.080931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.080959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.081043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.081120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.081148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.081259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.081400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.081427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.081510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.081590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.081622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.081707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.081795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.081821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.081907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.082021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.082048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.082134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.082243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.082270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.772 [2024-11-16 17:50:20.082352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.082490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.772 [2024-11-16 17:50:20.082517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.772 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.082662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.082782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.082809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.082895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.083146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.083411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.083674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.083906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.083986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.084126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.084317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.084503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.084760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.084907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.084996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.085076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.085103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.085199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.085278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.085305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.085416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.085526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.085554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.085668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.085775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.085802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.085914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.086111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.086297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.086514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.086720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.086906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.086994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.087136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.087388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.087583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.087825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.087943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.088028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.088108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.088134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.088250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.088329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.088356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.088438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.088549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.088575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.088671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.088750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.088776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.773 qpair failed and we were unable to recover it. 00:30:42.773 [2024-11-16 17:50:20.088862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.773 [2024-11-16 17:50:20.089005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.089148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.089340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.089569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.089775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.089884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.090038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.090240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.090433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.090660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.090878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.090993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.091136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.091357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.091581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.091778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.091918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.092006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.092122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.092148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.092261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.092344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.092371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.092480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.092597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.092628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.092773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.092880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.092906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.092992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.093183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.093456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.093673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.093905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.093986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.094099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.094330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.094517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.094759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.094871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.094957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.095069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.095096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.774 qpair failed and we were unable to recover it. 00:30:42.774 [2024-11-16 17:50:20.095209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.095324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.774 [2024-11-16 17:50:20.095352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.095441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.095528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.095555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.095666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.095747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.095774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.095860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.095976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.096117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.096309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.096573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.096778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.096893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.097035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.097145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.097172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.097253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.097367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.097394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.097480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.097566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.097595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.097693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.097769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.097796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.097905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.098120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.098368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.098583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.098795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.098911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.099021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.099248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.099470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.099674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.099874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.099989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.100015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.100163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.100276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.100303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.100388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.100498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.100525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.100664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.100745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.100771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.100889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.100976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.101006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.101096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.101224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.101251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.101361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.101446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.101473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.775 [2024-11-16 17:50:20.101588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.101677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.775 [2024-11-16 17:50:20.101704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.775 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.101817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.101897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.101924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.102008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.102261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.102450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.102670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.102865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.102976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.103003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.103114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.103203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.103234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.103353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.103465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.103492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.103605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.103725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.103753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.103865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.103981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.104083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.104328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.104549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.104780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.104906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.104984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.105208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.105430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.105655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.105881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.105992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.106109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.106369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.106584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.106862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.106994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.107083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.107227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.107254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.107372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.107452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.107478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.107562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.107647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.107675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.107788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.107901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.107933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.108017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.108108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.108135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.776 qpair failed and we were unable to recover it. 00:30:42.776 [2024-11-16 17:50:20.108250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.776 [2024-11-16 17:50:20.108361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.108387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.108472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.108582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.108608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.108759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.108874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.108901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.108990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.109174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.109424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.109647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.109848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.109963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.110072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.110186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.110212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.110305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.110396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.110422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.110512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.110631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.110659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.110769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.110913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.110939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.111022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.111107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.111133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.111218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.111304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.111332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.111439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.111549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.111576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.111693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.111801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.111828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.111935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.112164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.112401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.112653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.112849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.112990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.113102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.113239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.113265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.113405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.113514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.113540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.113653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.113733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.113760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.113844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.113958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.113984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.114090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.114175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.114202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.114286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.114407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.114434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.114554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.114633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.114659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.777 qpair failed and we were unable to recover it. 00:30:42.777 [2024-11-16 17:50:20.114747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.114857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.777 [2024-11-16 17:50:20.114883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.115003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.115198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.115423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.115604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.115842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.115976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.116092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.116275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.116501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.116694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.116884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.116997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.117118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.117200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.117228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.117319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.117407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.117433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.117513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.117587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.117613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.117760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.117836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.117863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.117980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.118203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.118413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.118633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.118826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.118939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.119046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.119123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.119149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.119240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.119349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.119375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.119465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.119550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.119579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.119665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.119769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.119797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.119909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.120124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.120322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.120541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.120761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.120877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.120965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.121052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.121080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.778 [2024-11-16 17:50:20.121189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.121279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.778 [2024-11-16 17:50:20.121305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.778 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.121400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.121475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.121502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.121583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.121724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.121751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.121838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.121931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.121958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.122041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.122122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.122148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.122258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.122365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.122391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.122500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.122583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.122609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.122708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.122814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.122841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.122922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.123139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.123365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.123578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.123779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.123926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.124036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.124286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.124474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.124669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.124859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.124974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.125086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.125197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.125224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.125311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.125424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.125453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.125537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.125623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.125650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.125758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.125858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.125890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.126006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.126088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.126115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.126231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.126369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.126397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.126485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.126564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.126591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.126719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.126844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.126872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.126956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.127177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.127390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.127583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.127826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.127936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.779 [2024-11-16 17:50:20.128021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.128109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.779 [2024-11-16 17:50:20.128137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.779 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.128225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.128342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.128369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.128479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.128588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.128624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.128706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.128826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.128853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.128938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.129178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.129400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.129649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.129841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.129945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.130023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.130216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.130448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.130699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.130888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.130976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.131005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.131120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.131205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.131232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.131311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.131459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.131485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.131597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.132355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.132422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.132613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.132738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.132765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.132856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.132976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.133084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.133300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.133526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.133767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.133875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.134014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.134206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.134406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.134677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.134868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.134979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.135005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.135126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.135210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.135236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.135314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.135445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.135473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.135589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.135685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.135712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.780 qpair failed and we were unable to recover it. 00:30:42.780 [2024-11-16 17:50:20.135825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.780 [2024-11-16 17:50:20.135905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.135931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.136039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.136259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.136473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.136699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.136887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.136996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.137080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.137171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.137198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.137279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.137391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.137417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.137500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.137582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.137609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.137731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.137809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.137841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.137955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.138205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.138393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.138584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.138819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.138955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.139040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.139122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.139149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.139232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.139317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.139344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.139462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.139577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.139603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.139736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.139818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.139844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.139963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.140219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.140448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.140637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.140866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.140975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.141002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.141088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.141192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.141219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.781 qpair failed and we were unable to recover it. 00:30:42.781 [2024-11-16 17:50:20.141302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.781 [2024-11-16 17:50:20.141416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.141442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.141521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.141633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.141660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.141757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.141842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.141870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.141991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.142215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.142425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.142626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.142877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.142987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.143062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.143179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.143207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.143328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.143408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.143434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.143523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.143638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.143666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.143785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.143899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.143925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.144047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.144153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.144180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.144257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.144365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.144391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.144506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.144592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.144633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.144748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.144855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.144882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.144958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.145138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.145387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.145601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.145808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.145978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.146054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.146133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.782 [2024-11-16 17:50:20.146171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.782 qpair failed and we were unable to recover it. 00:30:42.782 [2024-11-16 17:50:20.146262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.146404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.146431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.146532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.146627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.146655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.146798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.146883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.146910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.147009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.147233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.147435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.147648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.147860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.147968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.148048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.148232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.148460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.148653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.148900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.148980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.149128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.149340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.149530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.149788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.149898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.150017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.150107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.150135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.150218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.150359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.150386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.150503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.150589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.150622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.150739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.150816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.150843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.150924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.151174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.151375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.151575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.151807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.151926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.152044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.152131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.152158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.152242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.152318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.152344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.783 qpair failed and we were unable to recover it. 00:30:42.783 [2024-11-16 17:50:20.152458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.783 [2024-11-16 17:50:20.152577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.152604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.152731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.152844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.152870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.152961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.153192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.153384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.153611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.153810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.153945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.154039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.154155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.154182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.154265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.154351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.154378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.154489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.154599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.154634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.154748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.154864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.154891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.154975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.155190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.155445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.155652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.155877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.155996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.156126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.156370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.156590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.156855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.156968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.157045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.157150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.157176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.157320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.157399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.157425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.157518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.157596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.157630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.157774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.157856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.157883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.157971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.158093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.158121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.158239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.158353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.158379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.158489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.158630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.158657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.158739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.158850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.158877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.784 qpair failed and we were unable to recover it. 00:30:42.784 [2024-11-16 17:50:20.158971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.784 [2024-11-16 17:50:20.159081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.159196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.159390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.159585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.159814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.159923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.160012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.160097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.160124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.160206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.160288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.160314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.160448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.160587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.160626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.160743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.160828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.160855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.160938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.161187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.161405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.161605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.161843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.161985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.162095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.162209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.162235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.162345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.162425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.162452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.162528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.162602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.162636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.162781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.162881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.162911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.163034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.163228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.163449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.163676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.163866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.163999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.164084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.164260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.164453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.164684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.164872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.164995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.165106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.165217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.785 [2024-11-16 17:50:20.165244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.785 qpair failed and we were unable to recover it. 00:30:42.785 [2024-11-16 17:50:20.165320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.165431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.165457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.165536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.165609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.165641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.165737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.165850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.165877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.165969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.166160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.166377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.166596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.166791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.166893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.166987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.167185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.167413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.167641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.167865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.167976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.168116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.168323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.168583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.168784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.168904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.168989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.169208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.169402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.169631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.169825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.169968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.170054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.170139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.786 [2024-11-16 17:50:20.170164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.786 qpair failed and we were unable to recover it. 00:30:42.786 [2024-11-16 17:50:20.170281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.170394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.170420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.170501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.170584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.170610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.170695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.170773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.170799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.170912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.171164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.171382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.171625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.171812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.171945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.172024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.172209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.172390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.172576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.172813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.172931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.173012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.173107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.173145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.173258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.173365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.173392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.173476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.173582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.173608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.173706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.173817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.173842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.173927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.174137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.174385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.174581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.174843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.174953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.175033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.175107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.175133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.175217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.175324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.175351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.175442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.175535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.175560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.175700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.175824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.175854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.175964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.176073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.176103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.176189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.176273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.176300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.787 qpair failed and we were unable to recover it. 00:30:42.787 [2024-11-16 17:50:20.176412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.176497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.787 [2024-11-16 17:50:20.176524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.176609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.176734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.176762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.176884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.176967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.176993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.177082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.177162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.177188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.177267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.177373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.177399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.177510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.177583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.177608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.177704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.177811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.177838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.177915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.178129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.178373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.178645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.178862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.178982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.179090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.179288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.179503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.179712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.179826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.179908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.180132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.180388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.180587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.180822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.180936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.181014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.181126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.181152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.181266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.181372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.181398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.181515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.181630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.181657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.181751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.181830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.181856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.181941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.182058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.182084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.182162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.182274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.182300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.182412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.182490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.182516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.182631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.182720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.788 [2024-11-16 17:50:20.182747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.788 qpair failed and we were unable to recover it. 00:30:42.788 [2024-11-16 17:50:20.182831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.182920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.182947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.183095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.183174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.183200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.183344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.183427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.183454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.183551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.183639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.183667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.183778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.183857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.183884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.183968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.184173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.184360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.184558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.184782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.184894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.184981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.185206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.185430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.185611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.185806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.185973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.186054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.186248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.186439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.186658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.186864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.186976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.187087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.187165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.187191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.187273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.187358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.187385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.187493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.187573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.187599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.187729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.187811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.187837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.187926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.188147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.188363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.188563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.789 qpair failed and we were unable to recover it. 00:30:42.789 [2024-11-16 17:50:20.188776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.789 [2024-11-16 17:50:20.188855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.188881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.188998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.189228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.189445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.189670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.189898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.189979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.190096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.190332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.190582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.190786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.190932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.191014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.191242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.191480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.191672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.191905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.191999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.192113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.192364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.192614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.192815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.192921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.193008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.193199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.193448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.193719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.193918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.193994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.194021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.194130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.194245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.194273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.790 qpair failed and we were unable to recover it. 00:30:42.790 [2024-11-16 17:50:20.194390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.790 [2024-11-16 17:50:20.194479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.791 [2024-11-16 17:50:20.194505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.791 qpair failed and we were unable to recover it. 00:30:42.791 [2024-11-16 17:50:20.194592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.791 [2024-11-16 17:50:20.194690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.791 [2024-11-16 17:50:20.194717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.791 qpair failed and we were unable to recover it. 00:30:42.791 [2024-11-16 17:50:20.194798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.791 [2024-11-16 17:50:20.194914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:42.791 [2024-11-16 17:50:20.194940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:42.791 qpair failed and we were unable to recover it. 00:30:42.791 [2024-11-16 17:50:20.195049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.195162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.195189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.195280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.195360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.195387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.195467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.195579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.195605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.195716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.195798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.195829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.195912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.196131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.196389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.196610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.196845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.196951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.081 qpair failed and we were unable to recover it. 00:30:43.081 [2024-11-16 17:50:20.197062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.081 [2024-11-16 17:50:20.197177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.197204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.197290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.197376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.197402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.197490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.197580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.197607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.197704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.197787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.197814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.197927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.198123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.198318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.198518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.198758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.198871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.198957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.199142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.199408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.199659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.199849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.199964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.200055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.200139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.200165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.200254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.200410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.200437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.200527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.200608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.200642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.200727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.200837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.200864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.200955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.201178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.201434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.201629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.201882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.201987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.202139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.202350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.202608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.202810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.202920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.203009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.203083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.203110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.082 [2024-11-16 17:50:20.203226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.203336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.082 [2024-11-16 17:50:20.203363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.082 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.203478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.203560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.203587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.203716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.203793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.203819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.203933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.204127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.204359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.204573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.204786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.204949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.205035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.205227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.205446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.205712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.205911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.205991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.206110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.206329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.206544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.206774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.206914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.207002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.207118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.207145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.207234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.207345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.207371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.207451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.207533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.207560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.207657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.207773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.207799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.207917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.208173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.208372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.208569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.208833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.208968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.209074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.209161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.209186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.209290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.209402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.209428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.209511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.209594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.209625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.083 qpair failed and we were unable to recover it. 00:30:43.083 [2024-11-16 17:50:20.209705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.083 [2024-11-16 17:50:20.209788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.209816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.209940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.210152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.210372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.210653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.210866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.210979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.211093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.211176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.211202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.211284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.211442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.211469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.211589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.211707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.211734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.211818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.211897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.211924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.212033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.212253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.212448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.212680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.212870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.212982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.213095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.213176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.213203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.213282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.213390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.213416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.213494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.213576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.213603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.213702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.213814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.213842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.213936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.214158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.214433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.214630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.214860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.214971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.215088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.215197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.215223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.215307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.215385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.215411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.215499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.215606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.215648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.215760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.215875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.215901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.084 [2024-11-16 17:50:20.215983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.216076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.084 [2024-11-16 17:50:20.216103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.084 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.216218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.216331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.216357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.216442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.216531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.216557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.216646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.216726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.216753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.216876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.216981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.217096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.217311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.217564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.217759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.217871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.217955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.218150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.218403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.218598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.218796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.218905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.218987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.219208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.219401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.219627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.219816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.219960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.220044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.220159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.220186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.220270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.220372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.220398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.220479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.220560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.220585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.220686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.220806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.220834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.220920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.221171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.221385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.221586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.221784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.221898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.221981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.222094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.085 [2024-11-16 17:50:20.222120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.085 qpair failed and we were unable to recover it. 00:30:43.085 [2024-11-16 17:50:20.222240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.222315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.222340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.222450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.222559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.222589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.222680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.222791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.222819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.222936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.223127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.223353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.223550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.223766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.223872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.223962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.224195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.224446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.224663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.224886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.224993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.225099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.225348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.225628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.225830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.225933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.226018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.226102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.226128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.226217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.226293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.226320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.226460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.226565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.226591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.226721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.226805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.226833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.226915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.227026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.227057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.227140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.227215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.086 [2024-11-16 17:50:20.227242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.086 qpair failed and we were unable to recover it. 00:30:43.086 [2024-11-16 17:50:20.227335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.227412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.227439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.227523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.227630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.227658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.227737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.227845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.227871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.227958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.228179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.228394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.228630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.228819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.228958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.229043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.229158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.229188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.229284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.229364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.229391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.229488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.229597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.229630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.229741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.229847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.229873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.229986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.230184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.230412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.230633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.230881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.230989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.231126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.231353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.231576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.231837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.231942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.232057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.232272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.232455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.232666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.232887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.232991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.233082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.233192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.233218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.087 [2024-11-16 17:50:20.233334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.233414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.087 [2024-11-16 17:50:20.233441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.087 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.233517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.233628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.233655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.233749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.233829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.233856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.233967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.234151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.234398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.234606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.234839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.234973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.235088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.235170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.235196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.235314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.235433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.235460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.235581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.235673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.235700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.235789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.235897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.235924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.236052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.236132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.236159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.236236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.236320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.236347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.236432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.236574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.236600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.236723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.236835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.236861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.236941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.237205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.237454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.237638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.237826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.237962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.238054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.238159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.238186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.238268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.238378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.238404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.238495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.238609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.238640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.238718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.238799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.238826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.238906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.239184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.239399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.239591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.088 qpair failed and we were unable to recover it. 00:30:43.088 [2024-11-16 17:50:20.239847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.088 [2024-11-16 17:50:20.239928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.239955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.240033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.240148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.240175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.240256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.240335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.240361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.240482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.240565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.240591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.240691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.240806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.240834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.240921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.241118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.241330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.241609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.241839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.241971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.242087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.242169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.242196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.242274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.242354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.242381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.242474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.242584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.242610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.242705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.242816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.242842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.242930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.243123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.243387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.243629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.243863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.243966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.244077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.244156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.244182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.244261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.244338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.244365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.244456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.244569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.244595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.244714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.244821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.244847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.244998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.245116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.245144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.245265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.245349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.245375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.245462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.245583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.245609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.245714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.245796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.245822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.245933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.246009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.246035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.089 [2024-11-16 17:50:20.246109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.246227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.089 [2024-11-16 17:50:20.246253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.089 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.246364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.246456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.246483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.246595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.246679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.246706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.246818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.246901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.246928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.247037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.247150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.247176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.247291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.247396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.247423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.247500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.247625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.247652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.247743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.247824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.247851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.247937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.248139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.248361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.248550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.248801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.248908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.248990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.249209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.249427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.249688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.249887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.249998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.250109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.250354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.250534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.250775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.250881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.250961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.251104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.251130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.251209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.251291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.251317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.251430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.251509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.251535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.251652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.251764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.090 [2024-11-16 17:50:20.251790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.090 qpair failed and we were unable to recover it. 00:30:43.090 [2024-11-16 17:50:20.251873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.251982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.252119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.252362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.252575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.252809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.252917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.253031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.253276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.253466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.253667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.253902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.253987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.254130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.254313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.254512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.254737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.254869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.254992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.255174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.255396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.255624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.255876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.255979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.256086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.256178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.256203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.256297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.256403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.256429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.256511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.256644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.256672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.256756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.256862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.256888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.256984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.257174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.257391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.257608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.257820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.257959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.091 qpair failed and we were unable to recover it. 00:30:43.091 [2024-11-16 17:50:20.258081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.091 [2024-11-16 17:50:20.258185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.258212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.258326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.258409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.258439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.258521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.258638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.258666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.258783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.258862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.258888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.258994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.259222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.259445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.259636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.259834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.259936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.260016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.260205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.260454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.260708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.260905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.260989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.261092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.261288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.261539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.261786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.261892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.261978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.262213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.262396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.262582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.262782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.262920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.263004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.263088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.263114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.263203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.263278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.263304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.263380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.263459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.263485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.092 [2024-11-16 17:50:20.263563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.263680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.092 [2024-11-16 17:50:20.263707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.092 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.263817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.263928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.263955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.264071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.264154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.264182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.264292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.264370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.264397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.264515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.264591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.264622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.264707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.264817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.264847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.264928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.265174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.265361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.265598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.265834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.265939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.266085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.266166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.266192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.266296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.266371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.266397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.266536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.266679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.266706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.266819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.266900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.266928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.267041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.267151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.267178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.267271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.267360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.267386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.267492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.267569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.267595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.267718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.267805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.267832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.267950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.268166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.268382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.268575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.268813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.268950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.269043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.269167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.269194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.269306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.269406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.269434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.269582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.269668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.269696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.269786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.269894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.269920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.270001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.270108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.270134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.093 qpair failed and we were unable to recover it. 00:30:43.093 [2024-11-16 17:50:20.270247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.093 [2024-11-16 17:50:20.270340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.270367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.270456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.270567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.270593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.270680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.270758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.270784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.270897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.271124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.271311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.271531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.271759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.271894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.271984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.272207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.272451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.272645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.272839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.272947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.273056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.273130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.273157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.273234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.273316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.273344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.273454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.273533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.273560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.273655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.273741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.273767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.273886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.274148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.274371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.274589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.274838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.274969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.275054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.275179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.275205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.275294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.275375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.275402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.275485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.275597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.275631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.275712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.275822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.275849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.275925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.276042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.276068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.276164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.276279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.276305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.094 qpair failed and we were unable to recover it. 00:30:43.094 [2024-11-16 17:50:20.276389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.094 [2024-11-16 17:50:20.276471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.276498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.276612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.276740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.276767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.276877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.276983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.277100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.277329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.277553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.277760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.277869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.277950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.278160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.278385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.278642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.278894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.278981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.279130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.279320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.279539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.279764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.279910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.279994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.280213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.280458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.280678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.280876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.280988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.281078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.281156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.281184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.281325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.281412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.281441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.281527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.281651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.281690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.281785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.281904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.281930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.095 qpair failed and we were unable to recover it. 00:30:43.095 [2024-11-16 17:50:20.282007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.095 [2024-11-16 17:50:20.282118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.282145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.282226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.282333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.282361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.282442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.282550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.282578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.282695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.282779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.282805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.282911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.283156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.283371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.283558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.283777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.283885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.283993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.284183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.284410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.284657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.284918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.284994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.285149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.285369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.285602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.285803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.285964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.286046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.286126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.286152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.286228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.286311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.286337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.286468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.286603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.286639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.286726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.286814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.286840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.286931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.287190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.287218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.287334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.287447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.287473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.287582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.287675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.287707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.287804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.287885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.287911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.288023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.288133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.288158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.288266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.288353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.288380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.096 qpair failed and we were unable to recover it. 00:30:43.096 [2024-11-16 17:50:20.288502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.096 [2024-11-16 17:50:20.288587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.288612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.288700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.288779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.288804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.288905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.289123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.289345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.289581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.289831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.289968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.290081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.290190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.290216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.290308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.290413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.290440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.290522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.290658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.290685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.290765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.290852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.290877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.290959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.291152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.291354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.291568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.291771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.291911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.291997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.292190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.292437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.292631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.292864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.292971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.293092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.293178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.293205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.293293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.293412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.293439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.293525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.293603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.293640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.293745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.293855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.293881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.293971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.294079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.294106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.294220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.294305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.294331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.294406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.294521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.294547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.294629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.294747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.097 [2024-11-16 17:50:20.294773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.097 qpair failed and we were unable to recover it. 00:30:43.097 [2024-11-16 17:50:20.294879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.294995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.295102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.295287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.295518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.295772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.295948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.296033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.296110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.296137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.296220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.296296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.296323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.296410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.296548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.296574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.296741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.296821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.296851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.296953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.297187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.297380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.297606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.297839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.297957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.298032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.298143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.298170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.298278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.298391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.298417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.298528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.298614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.298647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.298767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.298846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.298872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.298955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.299065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.299096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.299187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.299294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.299320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.299399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.299538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.299564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.299679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.299775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.299801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.299885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.300107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.300328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.300524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.300816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.300942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.301030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.301108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.301135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.098 [2024-11-16 17:50:20.301211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.301316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.098 [2024-11-16 17:50:20.301342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.098 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.301439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.301523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.301549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.301668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.301775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.301801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.301883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.302109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.302342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.302558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.302790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.302897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.302988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.303209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.303483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.303722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.303913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.303990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.304093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.304355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.304610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.304829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.304969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.305080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.305186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.305213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.305293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.305374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.305401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.305507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.305632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.305670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.305749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.305827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.305852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.305977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.306231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.306421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.306648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.306897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.306999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.307077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.307220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.307246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.307368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.307484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.307510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.307624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.307737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.307762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.099 qpair failed and we were unable to recover it. 00:30:43.099 [2024-11-16 17:50:20.307880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.307993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.099 [2024-11-16 17:50:20.308020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.308133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.308243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.308270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.308354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.308466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.308497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.308592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.308680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.308706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.308810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.308898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.308924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.309040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.309241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.309422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.309610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.309851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.309952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.310038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.310152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.310179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.310299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.310380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.310407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.310518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.310593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.310626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.310730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.310818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.310844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.310946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.311160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.311405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.311611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.311866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.311978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.312113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.312302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.312497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.312748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.312870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.312962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.313036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.313062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.313179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.313284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.313310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.313396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.313531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.100 [2024-11-16 17:50:20.313557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.100 qpair failed and we were unable to recover it. 00:30:43.100 [2024-11-16 17:50:20.313659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.313742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.313769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.313874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.313955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.313981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.314060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.314178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.314205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.314320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.314399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.314426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.314515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.314629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.314657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.314795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.314875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.314901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.315015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.315091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.315118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.315236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.315344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.315370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.315481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.315567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.315593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.315682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.315789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.315816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.315899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.316141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.316334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.316568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.316810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.316917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.317027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.317216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.317444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.317646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.317886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.317991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.318101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.318183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.318210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.318309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.318387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.318414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.318494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.318576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.318603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.318718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.318804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.318832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.318932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.319143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.319401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.319588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.101 [2024-11-16 17:50:20.319792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.101 [2024-11-16 17:50:20.319899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.101 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.320009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.320238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.320432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.320624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.320839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.320976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.321053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.321137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.321164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.321255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.321329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.321355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.321476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.321582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.321609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.321704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.321810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.321836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.321919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.322198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.322417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.322602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.322862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.322996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.323106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.323209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.323236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.323320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.323447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.323474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.323559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.323642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.323669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.323761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.323836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.323862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.323948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.324140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.324348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.324531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.324756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.324903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.325017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.325295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.325487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.325736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.325922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.325999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.326025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.102 [2024-11-16 17:50:20.326135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.326238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.102 [2024-11-16 17:50:20.326265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.102 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.326377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.326473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.326500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.326638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.326713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.326739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.326881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.326962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.326989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.327067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.327276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.327467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.327649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.327872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.327982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.328065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.328178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.328205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.328313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.328419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.328446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.328555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.328667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.328700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.328807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.328913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.328939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.329080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.329171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.329198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.329312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.329394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.329421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.329520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.329646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.329674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.329766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.329849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.329875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.329984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.330211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.330453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.330644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.330876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.330988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.331078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.331185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.331211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.331335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.331416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.331443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.331560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.331647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.331675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.331752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.331834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.331861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.331941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.332024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.332051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.332164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.332244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.332270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.332360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.332438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.332465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.103 qpair failed and we were unable to recover it. 00:30:43.103 [2024-11-16 17:50:20.332545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.103 [2024-11-16 17:50:20.332633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.332660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.332781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.332919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.332945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.333061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.333179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.333205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.333287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.333396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.333422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.333530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.333610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.333688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.333798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.333890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.333917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.333999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.334236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.334424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.334620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.334816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.334926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.335015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.335132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.335159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.335298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.335409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.335436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.335528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.335644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.335671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.335750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.335833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.335859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.335977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.336162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.336384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.336636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.336832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.336944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.337021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.337101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.337128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.337218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.337297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.337324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.337438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.337545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.337571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.337681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.337767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.337794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.337914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.338023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.338050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.104 [2024-11-16 17:50:20.338163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.338247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.104 [2024-11-16 17:50:20.338273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.104 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.338362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.338477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.338503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.338586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.338701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.338729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.338812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.338925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.338952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.339036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.339251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.339462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.339698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.339892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.339998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.340110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.340347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.340570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.340766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.340878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.340966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.341149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.341378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.341631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.341864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.341970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.342090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.342164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.342191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.342274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.342355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.342382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.342523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.342645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.342672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.342815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.342893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.342919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.343027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.343108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.343134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.343245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.343320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.343347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.343456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.343531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.343558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.343644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.343773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.343799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.343917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.344062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.344088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.344196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.344281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.344308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.344418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.344557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.344584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.105 qpair failed and we were unable to recover it. 00:30:43.105 [2024-11-16 17:50:20.344681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.344789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.105 [2024-11-16 17:50:20.344815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.344899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.344977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.345083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.345296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.345474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.345699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.345890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.345991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.346073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.346156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.346184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.346270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.346346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.346373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.346490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.346600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.346644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.346742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.346829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.346856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.346933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.347142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.347386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.347584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.347792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.347894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.347973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.348215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.348426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.348645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.348849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.348966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.349076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.349217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.349243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.349356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.349467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.349493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.349574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.349670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.349705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.349785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.349895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.349922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.350015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.350226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.350440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.350658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.106 qpair failed and we were unable to recover it. 00:30:43.106 [2024-11-16 17:50:20.350846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.106 [2024-11-16 17:50:20.350923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.350949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.351028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.351232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.351449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.351678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.351867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.351976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.352087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.352211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.352237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.352317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.352398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.352424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.352511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.352597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.352630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.352751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.352860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.352886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.352995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.353211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.353397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.353611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.353838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.353978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.354090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.354288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.354470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.354681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.354903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.354978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.355086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.355276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.355498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.355686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.355884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.355996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.356074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.356189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.356215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.356327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.356409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.356436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.356522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.356599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.356632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.356752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.356889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.107 [2024-11-16 17:50:20.356916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.107 qpair failed and we were unable to recover it. 00:30:43.107 [2024-11-16 17:50:20.357000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.357193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.357407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.357602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.357830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.357962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.358058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.358169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.358196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.358307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.358378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.358405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.358483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.358591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.358624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.358738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.358824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.358850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.358932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.359121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.359318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.359522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.359785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.359894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.359978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.360160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.360186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.360300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.360382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.360409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.360489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.360564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.360590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.360712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.360819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.360845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.360972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.361157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.361353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.361564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.361783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.361890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.362007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.362196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.362393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.362647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.362845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.362987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.108 [2024-11-16 17:50:20.363066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.363143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.108 [2024-11-16 17:50:20.363169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.108 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.363254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.363332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.363359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.363438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.363553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.363579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.363665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.363777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.363804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.363900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.363987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.364119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.364371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.364610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.364834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.364980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.365055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.365255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.365502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.365701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.365918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.365997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.366118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.366344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.366563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.366823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.366934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.367030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.367142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.367169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.367278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.367356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.367383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.367461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.367570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.367596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.367702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.367816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.367842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.367924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.368127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.368350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.368602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.109 qpair failed and we were unable to recover it. 00:30:43.109 [2024-11-16 17:50:20.368864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.109 [2024-11-16 17:50:20.368944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.368971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.369062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.369312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.369505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.369703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.369888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.369996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.370074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.370188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.370215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.370304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.370415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.370442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.370526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.370598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.370653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.370743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.370853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.370879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.370958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.371145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.371365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.371552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.371740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.371846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.371941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.372126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.372348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.372571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.372777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.372888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.372968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.373192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.373423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.373609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.373809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.373956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.374033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.374141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.374167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.374244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.374354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.374380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.374458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.374565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.374593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.374699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.374792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.110 [2024-11-16 17:50:20.374817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.110 qpair failed and we were unable to recover it. 00:30:43.110 [2024-11-16 17:50:20.374937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.375147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.375424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.375645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.375837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.375976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.376066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.376170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.376196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.376276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.376413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.376439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.376549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.376636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.376673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.376772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.376850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.376876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.376983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.377230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.377443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.377658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.377861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.377965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.378050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.378290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.378492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.378689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.378869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.378970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.379081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.379185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.379211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.379299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.379375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.379401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.379485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.379592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.379623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.379705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.379800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.379827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.379944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.380125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.380304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.380545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.380768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.380884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.111 [2024-11-16 17:50:20.380972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.381051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.111 [2024-11-16 17:50:20.381076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.111 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.381158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.381231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.381256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.381340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.381446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.381472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.381585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.381669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.381695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.381772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.381888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.381919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.381998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.382230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.382470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.382730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.382923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.382998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.383114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.383294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.383543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.383760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.383871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.383982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.384203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.384397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.384605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.384870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.384976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.385116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.385199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.385224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.385309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.385389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.385415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.385524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.385601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.385632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.385717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.385800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.385827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.385909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.386159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.386413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.386642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.386836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.386973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.387059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.387163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.387188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.112 qpair failed and we were unable to recover it. 00:30:43.112 [2024-11-16 17:50:20.387269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.387347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.112 [2024-11-16 17:50:20.387373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.387451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.387538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.387564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.387652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.387725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.387751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.387846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.387988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.388089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.388312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.388506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.388711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.388897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.388976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.389080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.389290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.389526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.389747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.389856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.389935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.390131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.390377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.390555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.390737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.390879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.390959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.391154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.391373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.391593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.391808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.391917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.392001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.392108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.392134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.392272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.392382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.392409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.392487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.392606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.113 [2024-11-16 17:50:20.392639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.113 qpair failed and we were unable to recover it. 00:30:43.113 [2024-11-16 17:50:20.392716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.392832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.392865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.392943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.393158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.393379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.393598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.393803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.393910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.393989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.394238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.394421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.394650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.394839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.394940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.395039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.395114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.395140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.395250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.395339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.395364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.395446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.395552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.395578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.395689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.395786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.395812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.395957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.396207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.396403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.396630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.396844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.396959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.397097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.397303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.397521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.397719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.397909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.397987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.398106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.398287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.398466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.114 [2024-11-16 17:50:20.398702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.114 [2024-11-16 17:50:20.398807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.114 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.398897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.399123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.399331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.399548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.399768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.399876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.399968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.400211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.400396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.400578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.400801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.400945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.401055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.401135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.401161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.401249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.401331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.401357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.401451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.401560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.401590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.401689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.401795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.401821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.401931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.402173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.402362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.402621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.402802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.402914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.403006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.403218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.403461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.403653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.403865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.403971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.404090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.404178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.404203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.404311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.404423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.404450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.404564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.404652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.404678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.404761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.404842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.404868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.115 qpair failed and we were unable to recover it. 00:30:43.115 [2024-11-16 17:50:20.404949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.115 [2024-11-16 17:50:20.405024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.405169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.405384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.405598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.405799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.405931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.406079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.406165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.406190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.406284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.406394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.406419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.406508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.406620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.406646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.406731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.406836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.406862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.406942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.407020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.407046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.407189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.407300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.407326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.407440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.407548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.407574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.407688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.407804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.407829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.407936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.408137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.408388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.408579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.408786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.408897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.409004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.409111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.409136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.409244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.409381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.409407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.409523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.409630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.409657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.409738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.409815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.409841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.409932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.410149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.410341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.410532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.410787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.410907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.410997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.411134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.411159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.116 [2024-11-16 17:50:20.411267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.411348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.116 [2024-11-16 17:50:20.411373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.116 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.411459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.411534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.411559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.411666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.411742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.411768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.411855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.411947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.411972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.412056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.412132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.412158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.412249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.412330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.412355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.412441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.412547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.412572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.412717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.412803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.412833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.412911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.413164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.413419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.413607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.413803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.413931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.414007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.414225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.414410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.414600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.414856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.414967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.415085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.415194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.415220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.415333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.415440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.415465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.415544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.415653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.415680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.415773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.415855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.415881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.415987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.416171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.416411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.416629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.416824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.416927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.417003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.417080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.417105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.417195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.417297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.417322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.117 qpair failed and we were unable to recover it. 00:30:43.117 [2024-11-16 17:50:20.417412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.417518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.117 [2024-11-16 17:50:20.417543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.417623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.417698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.417724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.417802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.417883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.417908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.417985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.418216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.418429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.418645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.418853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.418987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.419062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.419252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.419466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.419691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.419909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.419983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.420092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.420300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.420516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.420771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.420877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.421026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.421247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.421432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.421637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.421836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.421972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.422050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.422235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.422442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.422669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.118 qpair failed and we were unable to recover it. 00:30:43.118 [2024-11-16 17:50:20.422858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.118 [2024-11-16 17:50:20.422938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.422964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.423044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.423125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.423150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.423265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.423375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.423400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.423483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.423592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.423627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.423743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.423821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.423846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.423927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.424143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.424336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.424598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.424797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.424901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.424979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.425090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.425115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.425196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.425302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.425328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.425441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.425531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.425557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.425658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.425741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.425767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.425883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.426124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.426403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.426594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.426881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.426988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.427078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.427166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.427191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.427301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.427387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.427413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.427499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.427574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.427599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.427719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.427800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.427826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.427902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.428162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.428379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.428629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.428814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.428929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.429050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.429164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.119 [2024-11-16 17:50:20.429189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.119 qpair failed and we were unable to recover it. 00:30:43.119 [2024-11-16 17:50:20.429263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.429371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.429397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.429472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.429584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.429610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.429705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.429795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.429822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.429905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.430119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.430336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.430549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.430732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.430842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.430954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.431166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.431354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.431585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.431768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.431904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.432016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.432103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.432129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.432246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.432359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.432386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.432478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.432585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.432620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.432713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.432786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.432812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.432930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.433127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.433364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.433545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.433768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.433887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.433998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.434179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.434365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.434573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.434812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.434919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.435059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.435169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.435194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.120 [2024-11-16 17:50:20.435281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.435397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.120 [2024-11-16 17:50:20.435422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.120 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.435508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.435590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.435623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.435736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.435816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.435841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.435924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.436145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.436345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.436525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.436724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.436861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.436975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.437197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.437411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.437632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.437846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.437955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.438044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.438261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.438462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.438679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.438895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.438992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.439114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.439196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.439223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.439299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.439410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.439436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.439556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.439633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.439659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.439777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.439857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.439883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.439991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.440206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.440421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.440649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.440828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.440933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.441072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.441145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.441170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.441276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.441393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.441418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.121 qpair failed and we were unable to recover it. 00:30:43.121 [2024-11-16 17:50:20.441513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.121 [2024-11-16 17:50:20.441586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.441611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.441700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.441792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.441817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.441894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.441970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.441996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.442114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.442194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.442220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.442328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.442411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.442437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.442546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.442659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.442685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.442766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.442849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.442875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.442986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.443233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.443419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.443645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.443832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.443942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.444050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.444262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.444476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.444700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.444897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.444978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.445085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.445333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.445552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.445813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.445918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.445998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.446215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.446458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.446657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.446852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.446957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.447036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.447284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.447462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.447693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.122 [2024-11-16 17:50:20.447914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.447997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.122 [2024-11-16 17:50:20.448023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.122 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.448103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.448216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.448242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.448352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.448430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.448456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.448567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.448683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.448709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.448796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.448872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.448897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.448990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.449099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.449124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.449262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.449371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.449396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.449470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.449575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.449600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.449710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.449791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.449816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.449925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.450132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.450378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.450589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.450807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.450923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.451004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.451226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.451453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.451719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.451902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.451994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.452139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.452354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.452578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.452771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.452910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.452990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.453100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.453125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.453213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.453288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.453313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.453430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.453538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.453564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.123 [2024-11-16 17:50:20.453675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.453768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.123 [2024-11-16 17:50:20.453794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.123 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.453882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.453957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.453982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.454063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.454249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.454493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.454715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.454912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.454992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.455130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.455358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.455547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.455743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.455853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.455969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.456180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.456421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.456634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.456829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.456930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.457006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.457248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.457464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.457670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.457859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.457964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.458045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.458152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.458178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.458320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.458392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.458417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.458497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.458647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.458674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.458753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.458836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.458861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.458944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.459131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.459322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.459528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.459724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.459858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.459945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.460018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.460044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.460123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.460259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.124 [2024-11-16 17:50:20.460284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.124 qpair failed and we were unable to recover it. 00:30:43.124 [2024-11-16 17:50:20.460393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.460469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.460496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.460574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.460689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.460715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.460791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.460896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.460922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.460999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.461176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.461375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.461608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.461816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.461953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.462029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.462117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.462144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.462260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.462374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.462400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.462521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.462662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.462689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.462805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.462880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.462905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.463016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.463225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.463407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.463601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.463787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.463919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.464030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.464216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.464495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.464679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.464879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.464985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.465067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.465147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.465173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.465278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.465361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.465386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.465475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.465558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.465584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.465679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.465787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.465813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.465911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.466183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.466374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.466554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.466769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.466881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.125 qpair failed and we were unable to recover it. 00:30:43.125 [2024-11-16 17:50:20.466957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.125 [2024-11-16 17:50:20.467036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.467205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.467410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.467665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.467852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.467990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.468072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.468148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.468174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.468257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.468394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.468420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.468500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.468603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.468634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.468773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.468853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.468878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.468965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.469154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.469368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.469582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.469785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.469955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.470030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.470225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.470462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.470653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.470845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.470948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.471065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.471239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.471425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.471647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.471831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.471973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.472086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.472160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.472186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.472291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.472404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.472429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.472535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.472660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.472688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.472782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.472860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.472886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.472973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.473055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.473080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.473194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.473297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.473323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.126 [2024-11-16 17:50:20.473416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.473523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.126 [2024-11-16 17:50:20.473549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.126 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.473661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.473747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.473772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.473863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.473972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.473997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.474081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.474273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.474494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.474707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.474897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.474999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.475088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.475176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.475202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.475281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.475358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.475383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.475461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.475558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.475584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.475667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.475778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.475804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.475900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.476120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.476346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.476580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.476778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.476890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.476973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.477159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.477376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.477592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.477788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.477951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.478036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.478113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.478139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.478252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.478332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.478358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.478437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.478516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.478543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.478653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.478762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.478789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.478896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.479115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.479367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.479581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.127 qpair failed and we were unable to recover it. 00:30:43.127 [2024-11-16 17:50:20.479789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.127 [2024-11-16 17:50:20.479897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.479922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.480041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.480122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.480148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.480232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.480341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.480367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.480479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.480588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.480614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.480739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.480849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.480874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.480954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.481149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.481372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.481603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.481828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.481937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.482047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.482151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.482177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.482285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.482366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.482393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.482488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.482572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.482597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.482734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.482806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.482832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.482950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.483165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.483344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.483561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.483809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.483908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.484007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.484082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.484107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.128 qpair failed and we were unable to recover it. 00:30:43.128 [2024-11-16 17:50:20.484195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.484276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.128 [2024-11-16 17:50:20.484302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.484378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.484491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.484517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.484610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.484702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.484728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.484807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.484944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.484969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.485054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.485259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.485440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.485667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.485858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.485989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.486075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.486285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.486494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.486685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.486899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.486978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.487089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.487314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.487531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.487777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.487881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.488020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.488223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.488453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.488673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.488889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.488997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.489079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.489293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.489489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.489682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.489866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.489979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.490120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.490207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.490232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.129 qpair failed and we were unable to recover it. 00:30:43.129 [2024-11-16 17:50:20.490346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.129 [2024-11-16 17:50:20.490420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.490447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.490554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.490659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.490686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.490801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.490935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.490960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.491074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.491159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.491184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.491297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.491372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.491397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.491515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.491591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.491637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.491726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.491824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.491852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.491930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.492137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.492318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.492505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.492693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.492886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.492992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.493071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.493152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.493180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.493258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.493366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.493393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.493516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.493652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.493678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.493759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.493840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.493869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.493955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.494206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.494435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.494654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.494879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.494988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.495066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.495178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.495205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.495286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.495390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.495417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.495528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.495600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.495630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.495717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.495793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.495819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.495929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.496035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.496061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.496152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.496229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.496255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.496362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.496440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.496465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.130 qpair failed and we were unable to recover it. 00:30:43.130 [2024-11-16 17:50:20.496555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.130 [2024-11-16 17:50:20.496635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.496661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.496778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.496863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.496888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.497028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.497216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.497404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.497638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.497831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.497940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.498034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.498256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.498465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.498669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.498902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.498976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.499084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.499307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.499494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.499691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.499885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.499991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.500081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.500155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.500180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.500258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.500351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.500377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.500485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.500623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.500649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.500735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.500816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.500841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.500918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.501160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.501376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.501589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.501792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.501894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.502002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.502087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.502112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.502195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.502309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.502334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.502416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.502533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.131 [2024-11-16 17:50:20.502559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.131 qpair failed and we were unable to recover it. 00:30:43.131 [2024-11-16 17:50:20.502651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.502733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.502760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.502870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.502952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.502977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.503068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.503185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.503211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.503322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.503407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.503433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.503512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.503622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.503648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.503733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.503813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.503838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.503914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.504157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.504396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.504578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.504770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.504908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.504995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.505209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.505432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.505614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.505807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.505919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.506035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.506225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.506443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.506664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.506861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.506998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.507088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.507167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.507193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.507269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.507357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.507383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.507461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.507581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.507607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.132 qpair failed and we were unable to recover it. 00:30:43.132 [2024-11-16 17:50:20.507701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.132 [2024-11-16 17:50:20.507785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.507811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.507904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.507976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.508080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.508310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.508567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.508816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.508946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.509035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.509217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.509465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.509704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.509915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.509989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.510121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.510336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.510535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.510726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.510823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.510940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.511132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.511317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.511539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.511761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.511866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.511971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.512171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.512410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.512658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.512850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.512984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.513089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.513165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.513190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.513305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.513384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.513413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.513491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.513598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.513628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.513706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.513781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.133 [2024-11-16 17:50:20.513807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.133 qpair failed and we were unable to recover it. 00:30:43.133 [2024-11-16 17:50:20.513902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.513981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.514087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.514337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.514578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.514841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.514943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.515054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.515136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.515162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.515271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.515380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.515406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.515518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.515629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.515660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.515749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.515825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.515851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.515932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.516150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.516337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.516532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.516752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.516903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.516984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.517189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.517401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.517636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.517860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.517998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.518085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.518303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.518492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.518686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.518922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.518995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.519143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.519334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.519546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.519760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.519866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.134 [2024-11-16 17:50:20.519951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.520036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.134 [2024-11-16 17:50:20.520061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.134 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.520173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.520284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.520310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.520397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.520479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.520506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.520695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.520778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.520804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.520949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.521139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.521320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.521508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.521733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.521914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.521995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.522103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.522327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.522538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.522755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.522888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.522973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.523184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.523367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.523546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.523756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.523856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.523937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.524169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.524378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.524593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.524827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.524956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.525041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.525238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.525461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.525670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.525864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.525975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.135 qpair failed and we were unable to recover it. 00:30:43.135 [2024-11-16 17:50:20.526072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.135 [2024-11-16 17:50:20.526175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.526200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.526279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.526393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.526418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.526504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.526589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.526619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.526708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.526815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.526841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.526952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.527144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.527368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.527613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.527832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.527931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.528038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.528267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.528448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.528648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.528853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.528985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.529072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.529155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.529181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.529274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.529360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.529385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.529493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.529573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.529598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.529697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.529804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.529829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.529953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.530195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.530374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.530567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.530796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.530927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.531037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.531112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.531139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.531225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.531305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.531332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.531445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.531562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.136 [2024-11-16 17:50:20.531589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.136 qpair failed and we were unable to recover it. 00:30:43.136 [2024-11-16 17:50:20.531676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.531763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.531788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.531869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.531947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.531974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.532051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.532128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.532155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.532237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.532323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.532348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.532435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.532515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.532541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.532662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.532771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.532797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.532885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.533106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.533312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.533531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.533749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.533863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.533947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.534194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.534386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.534646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.534833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.534963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.535045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.535125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.535155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.535241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.535381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.535406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.535527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.535638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.535665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.535744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.535833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.535859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.535937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.536148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.536337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.536544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.536757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.536864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.536983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.537090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.537116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.537194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.537279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.537305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.537456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.537536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.537562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.137 [2024-11-16 17:50:20.537681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.537761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.137 [2024-11-16 17:50:20.537788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.137 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.537866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.537943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.537968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.538110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.538195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.538221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.538297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.538406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.538432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.538546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.538648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.538675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.538757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.538836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.538862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.538946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.539167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.539404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.539609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.539843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.539961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.540038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.540292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.540491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.540698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.540886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.540986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.541103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.541184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.541210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.541328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.541433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.541459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.541568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.541684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.541710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.541817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.541928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.541954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.542061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.542172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.542198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.542307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.542396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.542422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.138 [2024-11-16 17:50:20.542529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.542607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.138 [2024-11-16 17:50:20.542638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.138 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.542717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.542803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.542828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.542915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.542987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.543096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.543289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.543504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.543732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.543842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.543925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.544116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.544306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.544492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.544732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.544843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.544924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.545110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.545288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.545513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.545714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.545831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.545921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.546033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.546063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.546153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.546263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.546288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.546377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.546489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.546514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.546608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.546704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.417 [2024-11-16 17:50:20.546730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.417 qpair failed and we were unable to recover it. 00:30:43.417 [2024-11-16 17:50:20.546823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.546909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.546934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.547027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.547210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.547432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.547657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.547886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.547991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.548099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.548212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.548237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.548327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.548415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.548440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.548521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.548610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.548641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.548752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.548830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.548856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.548996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.549186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.549407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.549626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.549852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.549954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.550034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.550213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.550406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.550591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.550853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.550982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.551067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.551147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.551174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.551285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.551366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.551393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.551480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.551588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.551614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.551741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.551878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.551904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.551984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.552193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.552435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.552627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.418 [2024-11-16 17:50:20.552890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.552976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.418 [2024-11-16 17:50:20.553003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.418 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.553116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.553199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.553224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.553302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.553376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.553402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.553509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.553590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.553623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.553719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.553854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.553880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.553989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.554238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.554423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.554655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.554839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.554955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.555039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.555121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.555146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.555260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.555348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.555374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.555484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.555561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.555587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.555674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.555783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.555810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.555922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.556140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.556327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.556507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.556733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.556900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.557008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.557235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.557417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.557648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.557909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.557994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.558098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.558308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.558557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.558771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.558879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.558990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.559063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.559089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.419 qpair failed and we were unable to recover it. 00:30:43.419 [2024-11-16 17:50:20.559199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.419 [2024-11-16 17:50:20.559278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.559303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.559386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.559524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.559550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.559662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.559741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.559768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.559854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.559936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.559962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.560040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.560152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.560178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.560299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.560375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.560401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.560496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.560569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.560595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.560718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.560828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.560853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.560936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.561131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.561349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.561611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.561880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.561990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.562079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.562333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.562529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.562723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.562915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.562992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.563100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.563319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.563493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.563718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.563862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.563938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.564151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.564368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.564591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.564822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.564957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.565045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.565151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.565177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.565264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.565339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.420 [2024-11-16 17:50:20.565365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.420 qpair failed and we were unable to recover it. 00:30:43.420 [2024-11-16 17:50:20.565449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.565524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.565551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.565662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.565744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.565772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.565856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.565971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.565998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.566085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.566199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.566226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.566307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.566394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.566421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.566504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.566646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.566674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.566753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.566843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.566870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.566962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.567180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.567395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.567608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.567808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.567943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.568026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.568266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.568491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.568700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.568895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.568999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.569121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.569249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.569275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.569365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.569479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.569505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.569591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.569675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.569702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.569781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.569922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.569948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.570063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.570151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.570177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.570259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.570336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.570367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.570479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.570572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.421 [2024-11-16 17:50:20.570599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.421 qpair failed and we were unable to recover it. 00:30:43.421 [2024-11-16 17:50:20.570685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.570766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.570793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.570944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.571162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.571344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.571591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.571834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.571949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.572041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.572154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.572180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.572262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.572347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.572373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.572460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.572573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.572604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.572724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.572812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.572839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.572929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.573141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.573354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.573571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.573776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.573909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.573993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.574220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.574401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.574591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.574799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.574909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.575001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.575214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.575400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.575629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.575828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.575992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.576079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.576161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.576187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.576265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.576350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.576377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.576485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.576561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.576588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.422 qpair failed and we were unable to recover it. 00:30:43.422 [2024-11-16 17:50:20.576685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.422 [2024-11-16 17:50:20.576763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.576795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.576880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.576965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.576992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.577070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.577182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.577208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.577288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.577395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.577422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.577509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.577588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.577621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.577709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.577825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.577851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.577934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.578186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.578378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.578646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.578873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.578978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.579092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.579319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.579538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.579769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.579906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.579999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.580193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.580394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.580627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.580850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.580956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.581036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.581152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.581178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.581296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.581409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.581436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.581514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.581629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.581656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.581740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.581820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.581846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.581925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.582147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.582438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.582648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.582839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.423 [2024-11-16 17:50:20.582944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.423 qpair failed and we were unable to recover it. 00:30:43.423 [2024-11-16 17:50:20.583087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.583167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.583193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.583280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.583366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.583392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.583532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.583612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.583649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.583741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.583827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.583853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.583998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.584109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.584135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.584260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.584366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.584392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.584505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.584611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.584643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.584762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.584872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.584899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.585008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.585122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.585148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.585263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.585347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.585375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.585459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.585552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.585578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.585666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.585776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.585802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.585894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.586142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.586354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.586566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.586769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.586906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.587021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.587268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.587462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.587688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.587910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.587992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.588104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.588335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.588525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.588752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.588869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.588946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.589022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.589049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.589132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.589251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.589277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.424 qpair failed and we were unable to recover it. 00:30:43.424 [2024-11-16 17:50:20.589389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.424 [2024-11-16 17:50:20.589465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.589491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.589599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.589685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.589711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.589800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.589911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.589937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.590025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.590130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.590156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.590239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.590345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.590372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.590488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.590567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.590593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.590656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xdb9980 (9): Bad file descriptor 00:30:43.425 [2024-11-16 17:50:20.590809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.590899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.590929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.591044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.591274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.591494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.591720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.591906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.591992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.592134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.592361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.592596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.592800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.592899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.593017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.593272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.593473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.593667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.593855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.593976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.594117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.594336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.594565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.594803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.594913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.594997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.595105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.595132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.595213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.595329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.595357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.595470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.595553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.595579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.425 qpair failed and we were unable to recover it. 00:30:43.425 [2024-11-16 17:50:20.595674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.425 [2024-11-16 17:50:20.595783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.595810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.595897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.595978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.596099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.596322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.596545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.596789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.596930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.597021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.597200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.597419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.597604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.597826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.597959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.598072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.598262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.598498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.598699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.598894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.598978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.599125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.599317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.599515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.599731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.599838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.599950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.600089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.600115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.600227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.600308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.600335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.600451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.600541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.600567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.600677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.600786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.600813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.600897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.601007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.601033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.426 qpair failed and we were unable to recover it. 00:30:43.426 [2024-11-16 17:50:20.601143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.426 [2024-11-16 17:50:20.601258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.601284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.601369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.601509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.601535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.601612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.601697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.601725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.601817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.601929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.601955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.602033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.602109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.602135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.602220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.602306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.602334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.602445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.602555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.602582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.602706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.602788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.602815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.602927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.603144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.603359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.603579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.603813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.603924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.604068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.604143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.604169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.604246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.604388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.604415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.604495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.604601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.604634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.604712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.604797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.604824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.604909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.605130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.605353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.605550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.605848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.605973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.606099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.606211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.606238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.606315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.606420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.606446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.606553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.606667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.606694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.606778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.606859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.606884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.606958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.607043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.607068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.607175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.607253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.607279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.607353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.607459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.427 [2024-11-16 17:50:20.607486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.427 qpair failed and we were unable to recover it. 00:30:43.427 [2024-11-16 17:50:20.607569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.607651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.607677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.607796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.607875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.607902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.607982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.608203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.608418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.608599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.608805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.608941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.609050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.609138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.609164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.609273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.609351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.609377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.609497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.609609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.609643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.609724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.609832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.609858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.609945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.610131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.610427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.610636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.610864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.610975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.611114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.611340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.611584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.611783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.611888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.612001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.612210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.612425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.612625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.612841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.612974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.613053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.613128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.613154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.613236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.613345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.613371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.613452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.613564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.613590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.428 [2024-11-16 17:50:20.613689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.613811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.428 [2024-11-16 17:50:20.613841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.428 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.613956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.614162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.614392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.614636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.614858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.614995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.615103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.615330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.615553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.615775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.615884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.616003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.616225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.616446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.616670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.616863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.616999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.617120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.617214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.617241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.617323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.617411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.617437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.617525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.617612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.617644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.617730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.617809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.617836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.617922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.618118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.618368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.618567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.618824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.618931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.619021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.619255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.619448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.619630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.619855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.619962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.429 qpair failed and we were unable to recover it. 00:30:43.429 [2024-11-16 17:50:20.620077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.429 [2024-11-16 17:50:20.620185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.620212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.620322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.620403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.620430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.620541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.620614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.620647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.620725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.620806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.620832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.620912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.621138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.621346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.621625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.621828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.621935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.622076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.622154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.622181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.622309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.622392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.622418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.622532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.622638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.622665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.622778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.622862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.622888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.623000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.623110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.623136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.623217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.623345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.623371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.623456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.623539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.623567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.623677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.623785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.623812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.623940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.624131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.624396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.624624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.624816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.624980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.625069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.625149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.625176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.625299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.625415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.625441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.625551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.625665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.625693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.625774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.625858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.625885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.626005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.626118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.626145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.626256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.626331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.626358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.430 qpair failed and we were unable to recover it. 00:30:43.430 [2024-11-16 17:50:20.626443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.626536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.430 [2024-11-16 17:50:20.626563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.626674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.626761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.626788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.626871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.626947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.626973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.627064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.627144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.627170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.627246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.627331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.627359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.627470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.627577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.627605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.627692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.627780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.627806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.627937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.628213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.628411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.628650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.628875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.628987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.629069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.629151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.629177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.629263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.629456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.629483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.629609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.629737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.629767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.629859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.630106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.630298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.630522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.630773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.630877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.630962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.631189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.631380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.631600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.631808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.631945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.632065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.632178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.431 [2024-11-16 17:50:20.632205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.431 qpair failed and we were unable to recover it. 00:30:43.431 [2024-11-16 17:50:20.632319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.632408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.632434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.632545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.632630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.632659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.632746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.632837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.632864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.632991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.633077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.633104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.633215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.633307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.633334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.633424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.633563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.633589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.633678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.633768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.633795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.633907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.634165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.634405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.634637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.634825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.634928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.635037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.635120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.635152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.635267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.635375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.635402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.635482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.635588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.635614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.635736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.635873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.635899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.635990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.636174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.636367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.636594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.636827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.636961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.637043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.637152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.637180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.637295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.637377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.637409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.637487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.637599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.637630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.637748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.637830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.637857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.637948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.638024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.638050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.638167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.638251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.638279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.638386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.638468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.638494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.432 qpair failed and we were unable to recover it. 00:30:43.432 [2024-11-16 17:50:20.638605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.432 [2024-11-16 17:50:20.638711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.638737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.638822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.638899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.638925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.639039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.639119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.639145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.639289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.639369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.639396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.639513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.639595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.639633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.639718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.639807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.639834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.639976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.640166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.640367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.640609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.640812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.640947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.641092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.641180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.641207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.641286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.641394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.641421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.641552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.641631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.641658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.641739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.641860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.641891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.641969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.642187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.642404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.642643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.642872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.642985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.643130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.643355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.643584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.643808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.643912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.643993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.644194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.644383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.644577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.433 [2024-11-16 17:50:20.644779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.433 [2024-11-16 17:50:20.644892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.433 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.645012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.645127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.645155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.645252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.645361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.645387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.645495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.645576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.645602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.645721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.645833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.645860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.645938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.646190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.646380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.646638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.646825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.646923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.647011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.647128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.647154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.647269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.647356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.647382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.647465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.647576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.647602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.647722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.647835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.647861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.647976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.648196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.648407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.648633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.648831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.648938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.649022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.649100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.649126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.649267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.649377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.649404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.649481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.649587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.649613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.649733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.649870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.649896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.649983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.650093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.650119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.650210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.650290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.650317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.650463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.650541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.650567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.650690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.650775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.650801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.650945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.651021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.651046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.651160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.651271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.651296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.434 qpair failed and we were unable to recover it. 00:30:43.434 [2024-11-16 17:50:20.651379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.434 [2024-11-16 17:50:20.651455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.651482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.651565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.651654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.651680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.651763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.651838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.651875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.651987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.652179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.652404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.652626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.652828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.652931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.653135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.653252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.653281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.653371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.653479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.653507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.653614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.653705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.653733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.653844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.653923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.653949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.654037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.654122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.654150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.654239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.654357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.654385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.654501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.654608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.654641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.654729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.654812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.654840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.654918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.655174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.655373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.655569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.655773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.655905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.656099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.656213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.656240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.656323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.656518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.656545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.656665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.656754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.656781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.656871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.656956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.435 [2024-11-16 17:50:20.656984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.435 qpair failed and we were unable to recover it. 00:30:43.435 [2024-11-16 17:50:20.657072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.657156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.657183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.657266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.657348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.657376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.657467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.657546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.657573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.657684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.657787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.657817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.657929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.658148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.658377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.658586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.658826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.658945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.659059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.659141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.659169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.659287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.659373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.659401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.659494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.659606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.659642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.659754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.659832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.659860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.659957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.660164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.660415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.660647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.660850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.660989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.661072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.661180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.661207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.661290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.661402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.661429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.661512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.661589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.661621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.661750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.661833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.661861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.661974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.662166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.662423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.662618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.662882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.662994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.663021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.663104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.663210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.663237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.436 qpair failed and we were unable to recover it. 00:30:43.436 [2024-11-16 17:50:20.663323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.663451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.436 [2024-11-16 17:50:20.663478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.663560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.663700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.663727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.663813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.663889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.663916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.664032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.664230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.664463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.664699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.664896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.664974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.665078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.665298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.665490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.665728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.665833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.665943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.666137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.666374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.666567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.666778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.666887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.666978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.667204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.667412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.667645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.667844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.667986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.668064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.668153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.668180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.668299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.668386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.668412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.668527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.668611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.668645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.668728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.668838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.668866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.669168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.669254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.669282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.669365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.669445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.669472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.669559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.669638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.437 [2024-11-16 17:50:20.669666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.437 qpair failed and we were unable to recover it. 00:30:43.437 [2024-11-16 17:50:20.669762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.669875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.669902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.670011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.670122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.670149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.670225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.670317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 17:50:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:43.438 [2024-11-16 17:50:20.670345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 17:50:20 -- common/autotest_common.sh@862 -- # return 0 00:30:43.438 [2024-11-16 17:50:20.670462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.670546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.670572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 17:50:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:43.438 [2024-11-16 17:50:20.670655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.670745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 17:50:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:43.438 [2024-11-16 17:50:20.670772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.670862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 17:50:20 -- common/autotest_common.sh@10 -- # set +x 00:30:43.438 [2024-11-16 17:50:20.670954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.670980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.671105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.671196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.671224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.671339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.671448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.671475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.671557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.671635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.671662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.671754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.671849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.671875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.671966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.672081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.672108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.672192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.672333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.672359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.672500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.672590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.672622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.672726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.672808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.672834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.672916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.673140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.673399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.673635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.673860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.673969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.674073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.674151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.674177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.674289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.674409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.674435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.674551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.674636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.674672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.674757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.674870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.674896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.675003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.675084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.675111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.675204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.675281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.675308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.438 qpair failed and we were unable to recover it. 00:30:43.438 [2024-11-16 17:50:20.675419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.438 [2024-11-16 17:50:20.675508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.675535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.675626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.675705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.675732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.675817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.675893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.675919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.676038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.676145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.676172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.676258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.676334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.676360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.676480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.676592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.676625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.676711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.676790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.676816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.676951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.677181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.677370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.677639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.677835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.677950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.678031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.678109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.678135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.678249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.678330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.678367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.678478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.678584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.678610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.678705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.678788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.678816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.678937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.679136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.679322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.679515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.679773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.679941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.680025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.680138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.680164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.680246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.680326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.680353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.680471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.680557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.680583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.680703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.680786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.680813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.680899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.681015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.681042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.681125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.681212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.681240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.439 qpair failed and we were unable to recover it. 00:30:43.439 [2024-11-16 17:50:20.681351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.439 [2024-11-16 17:50:20.681495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.681521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.681604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.681701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.681727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.681816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.681902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.681928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.682006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.682149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.682175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.682273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.682421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.682448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.682530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.682614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.682647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.682767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.682849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.682876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.682956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.683137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.683330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.683628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.683839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.683942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.684059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.684182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.684210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.684299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.684387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.684414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.684507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.684620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.684647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.684732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.684839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.684866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.684974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.685197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.685430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.685659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.685878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.685981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.686084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.686302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.686537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.686771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.686879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.440 qpair failed and we were unable to recover it. 00:30:43.440 [2024-11-16 17:50:20.686960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.440 [2024-11-16 17:50:20.687046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.687074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.687184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.687323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.687350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.687461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.687539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.687566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.687680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.687760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.687787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.687902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.688144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.688363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.688590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.688819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.688928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.689068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.689164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.689192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.689336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.689451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.689477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.689595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.689687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.689715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.689831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.689912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.689938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.690026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.690108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.690135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.690226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.690337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.690365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.690480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.690598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.690631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.690754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.690870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.690896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.691010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.691100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.691128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.691211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.691327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.691353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.691441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.691525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.691551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.691692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.691782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.691808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.691896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.692123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.692351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.692609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.692809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.692919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.693027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.693107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.693135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.693215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.693333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.693359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.441 qpair failed and we were unable to recover it. 00:30:43.441 [2024-11-16 17:50:20.693443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.441 [2024-11-16 17:50:20.693530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.693556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.693644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.693732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.693759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.693839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.693919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.693946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.694059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.694139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.694166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.694275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.694348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.694375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.694492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.694633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.694660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.694755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.694835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.694862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.694943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.695060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.695088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.695176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.695259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.695288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 17:50:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:43.442 [2024-11-16 17:50:20.695374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.695453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.695480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.695593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.695701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 17:50:20 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:43.442 [2024-11-16 17:50:20.695729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.695821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 17:50:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.442 [2024-11-16 17:50:20.695938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.695968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.696045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.696156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.696184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.442 17:50:20 -- common/autotest_common.sh@10 -- # set +x 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.696283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.696377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.696407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.696533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.696624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.696653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.696754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.696839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.696867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.696983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.697098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.697126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.697211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.697296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.697324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.697437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.697545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.697572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.697664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.697746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.697774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.697889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.698142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.698363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.698630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.698857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.698977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.699095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.699181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.699208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.699323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.699407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.699434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.699515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.699595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.442 [2024-11-16 17:50:20.699631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.442 qpair failed and we were unable to recover it. 00:30:43.442 [2024-11-16 17:50:20.699721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.699797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.699823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.699913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.700137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.700378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.700571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.700809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.700962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.701073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.701180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.701207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.701321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.701402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.701429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.701508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.701589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.701623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.701714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.701791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.701819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.701898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.702130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.702382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.702635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.702876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.702998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.703106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.703219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.703246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.703344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.703429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.703457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.703547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.703630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.703670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.703785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.703869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.703900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.704020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.704224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.704450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.704683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.704880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.704998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.705136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.705376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.705575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.705786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.705895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.443 qpair failed and we were unable to recover it. 00:30:43.443 [2024-11-16 17:50:20.705991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.443 [2024-11-16 17:50:20.706072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.706213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.706408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.706639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.706843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.706963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.707056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.707170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.707198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.707293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.707385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.707413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.707500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.707582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.707609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.707743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.707824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.707850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.707938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.708174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.708375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.708601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.708874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.708989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.709105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.709398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.709597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.709843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.709993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.710072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.710193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.710220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.710304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.710419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.710446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.710562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.710645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.710681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.710790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.710933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.710961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.711044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.711121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.711149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.711247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.711363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.711392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.711473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.711552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.711580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.711713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.711815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.711845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.444 qpair failed and we were unable to recover it. 00:30:43.444 [2024-11-16 17:50:20.711952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.444 [2024-11-16 17:50:20.712043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.712166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.712424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.712632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.712863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.712987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.713100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.713179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.713206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.713317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.713457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.713484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.713572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.713666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.713692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.713803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.713928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.713955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.714053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.714240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.714418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.714645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.714906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.714988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.715103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.715361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.715559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.715796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.715907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.715984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.716214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.716472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.716704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.716908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.716996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.717025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.717141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.717220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.717248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.717359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.717454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.717483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.717573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.717704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.445 [2024-11-16 17:50:20.717731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.445 qpair failed and we were unable to recover it. 00:30:43.445 [2024-11-16 17:50:20.717842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.717942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.717969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.718055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.718170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.718197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.718276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.718358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.718385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.718466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.718581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.718608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.718739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.718829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.718855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.718946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.719036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.719064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.719195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.719295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.719327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.719423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.719543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.719571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.719728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.719832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.719863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.719998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.720203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.720428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.720621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.720858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.720985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.721110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.721228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.721256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.721375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.721457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.721484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.721566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.721684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.721711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.721790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.721901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.721931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.722046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.722133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.722160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.722280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.722357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.722384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.722477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.722566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.722594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.722695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.722783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.722810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.722896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.723131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.723390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.723583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 Malloc0 00:30:43.446 [2024-11-16 17:50:20.723680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.723785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.723898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 17:50:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.446 [2024-11-16 17:50:20.723980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 [2024-11-16 17:50:20.724100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 17:50:20 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:43.446 [2024-11-16 17:50:20.724128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.446 qpair failed and we were unable to recover it. 00:30:43.446 [2024-11-16 17:50:20.724208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.446 17:50:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.447 [2024-11-16 17:50:20.724291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.724320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 17:50:20 -- common/autotest_common.sh@10 -- # set +x 00:30:43.447 [2024-11-16 17:50:20.724403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.724485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.724512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.724602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.724735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.724762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.724846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.724930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.724958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.725051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.725133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.725160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.725251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.725358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.725385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.725504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.725579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.725606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.725730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.725828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.725857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.725953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.726092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.726119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.726210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.726324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.726350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.726463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.726546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.726572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.726672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.726780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.726807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.726899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.727118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.727261] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:43.447 [2024-11-16 17:50:20.727368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.727593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.727812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.727914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.728004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.728222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xdabf20 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.728446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.728650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.728845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.728955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.729039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.729178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.729205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.729292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.729404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.729431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.729513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.729642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.729681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.729777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.729865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.729902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.730017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.730155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.730181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.730265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.730344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.447 [2024-11-16 17:50:20.730370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.447 qpair failed and we were unable to recover it. 00:30:43.447 [2024-11-16 17:50:20.730459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.730547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.730575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.730688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.730772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.730798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.730886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.730993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.731133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.731362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.731571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.731806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.731930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.732025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.732183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.732214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.732309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.732423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.732450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.732537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.732625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.732653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.732803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.732880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.732916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.733010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.733124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.733152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.733251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.733371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.733400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.733517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.733603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.733637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.733736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.733856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.733882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.733969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.734195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.734459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.734684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.734882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.734990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.735105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.735220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.735248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.735369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.735455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.735482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.448 17:50:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.735574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 17:50:20 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:43.448 [2024-11-16 17:50:20.735670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.735699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 17:50:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.448 [2024-11-16 17:50:20.735817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 17:50:20 -- common/autotest_common.sh@10 -- # set +x 00:30:43.448 [2024-11-16 17:50:20.735900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.735926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.736020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.736128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.736155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.736237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.736314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.736341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.736457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.736538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.736573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.448 [2024-11-16 17:50:20.736668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.736745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.448 [2024-11-16 17:50:20.736772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.448 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.736853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.736932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.736959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.737037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.737145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.737171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.737251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.737359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.737386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.737467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.737580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.737606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.737698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.737778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.737805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.737944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.738132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.738364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.738630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.738830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.738939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.739024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.739117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.739143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.739253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.739330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.739357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.739485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.739612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.739651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.739739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.739836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.739863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.739949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.740152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.740381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.740626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.740836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.740950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.741071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.741158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.741185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.741273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.741399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.741427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.741540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.741652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.741680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.741768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.741855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.741882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.741974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.742058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.742085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.742169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.742255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.449 [2024-11-16 17:50:20.742283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.449 qpair failed and we were unable to recover it. 00:30:43.449 [2024-11-16 17:50:20.742369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.742460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.742487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.742571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.742687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.742715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.742793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.742871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.742898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.742992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.743072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.743104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.743187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.743299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.743326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.743411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.743503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.743531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b9 17:50:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.450 0 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.743644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 17:50:20 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:43.450 [2024-11-16 17:50:20.743732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.743759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 17:50:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.450 [2024-11-16 17:50:20.743850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 17:50:20 -- common/autotest_common.sh@10 -- # set +x 00:30:43.450 [2024-11-16 17:50:20.743970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.743996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.744079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.744165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.744193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.744284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.744425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.744451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.744537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.744651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.744678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.744793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.744876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.744903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.745014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.745102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.745129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.745246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.745356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.745383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.745462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.745567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.745593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.745696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.745814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.745840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.745924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.746184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.746423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.746610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.746844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.746952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.747033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.747115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.747143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.747223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.747335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.747361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.747494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.747599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.747636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.747728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.747846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.747875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.747993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.748077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.748105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.748220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.748335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.748363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.450 qpair failed and we were unable to recover it. 00:30:43.450 [2024-11-16 17:50:20.748449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.748562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.450 [2024-11-16 17:50:20.748589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.748712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.748803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.748831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.748918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.749144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.749374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.749595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.749831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.749969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.750081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.750286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.750480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.750677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.750875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.750986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.751063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.751181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.751207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.751292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.751403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.751429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53b4000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.751518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 17:50:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.451 [2024-11-16 17:50:20.751620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.751649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.751735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 17:50:20 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:43.451 [2024-11-16 17:50:20.751811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.751838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 17:50:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.451 [2024-11-16 17:50:20.751931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 17:50:20 -- common/autotest_common.sh@10 -- # set +x 00:30:43.451 [2024-11-16 17:50:20.752039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.752210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.752407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.752605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.752808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.752921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.753065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.753156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.753183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.753265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.753374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.753401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.753480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.753562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.753590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53ac000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.753733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.753836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.753866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.753984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.754103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.754137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.754221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.754311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.754339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.754423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.754511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.754537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.451 qpair failed and we were unable to recover it. 00:30:43.451 [2024-11-16 17:50:20.754632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.451 [2024-11-16 17:50:20.754720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.452 [2024-11-16 17:50:20.754747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.754826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.452 [2024-11-16 17:50:20.754949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.452 [2024-11-16 17:50:20.754977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.755090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.452 [2024-11-16 17:50:20.755197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.452 [2024-11-16 17:50:20.755224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.755311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.452 [2024-11-16 17:50:20.755392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:43.452 [2024-11-16 17:50:20.755420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f53a8000b90 with addr=10.0.0.2, port=4420 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.755553] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:43.452 [2024-11-16 17:50:20.757967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.758114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.758147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.758173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.758189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.758226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 17:50:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.452 17:50:20 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:43.452 17:50:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:43.452 17:50:20 -- common/autotest_common.sh@10 -- # set +x 00:30:43.452 17:50:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:43.452 [2024-11-16 17:50:20.767818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 17:50:20 -- host/target_disconnect.sh@58 -- # wait 1715202 00:30:43.452 [2024-11-16 17:50:20.767915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.767940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.767955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.767967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.767998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.777807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.777897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.777923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.777937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.777949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.777979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.787871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.787974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.788004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.788020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.788034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.788065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.797915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.798015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.798040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.798055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.798067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.798097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.807860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.807951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.807978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.807998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.808011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.808042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.817914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.818007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.818032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.818047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.818060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.818090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.827930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.828021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.828047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.828061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.828073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.828102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.837884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.837972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.837997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.838012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.838024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.838054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.847940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.848032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.848059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.848073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.848086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.848115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.857969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.452 [2024-11-16 17:50:20.858065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.452 [2024-11-16 17:50:20.858090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.452 [2024-11-16 17:50:20.858105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.452 [2024-11-16 17:50:20.858116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.452 [2024-11-16 17:50:20.858147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.452 qpair failed and we were unable to recover it. 00:30:43.452 [2024-11-16 17:50:20.867983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.453 [2024-11-16 17:50:20.868078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.453 [2024-11-16 17:50:20.868103] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.453 [2024-11-16 17:50:20.868117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.453 [2024-11-16 17:50:20.868130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.453 [2024-11-16 17:50:20.868160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.453 qpair failed and we were unable to recover it. 00:30:43.453 [2024-11-16 17:50:20.878054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.453 [2024-11-16 17:50:20.878147] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.453 [2024-11-16 17:50:20.878173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.453 [2024-11-16 17:50:20.878187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.453 [2024-11-16 17:50:20.878199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.453 [2024-11-16 17:50:20.878242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.453 qpair failed and we were unable to recover it. 00:30:43.453 [2024-11-16 17:50:20.888042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.453 [2024-11-16 17:50:20.888139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.453 [2024-11-16 17:50:20.888164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.453 [2024-11-16 17:50:20.888179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.453 [2024-11-16 17:50:20.888192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.453 [2024-11-16 17:50:20.888221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.453 qpair failed and we were unable to recover it. 00:30:43.712 [2024-11-16 17:50:20.898035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.712 [2024-11-16 17:50:20.898126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.712 [2024-11-16 17:50:20.898158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.712 [2024-11-16 17:50:20.898174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.712 [2024-11-16 17:50:20.898189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.712 [2024-11-16 17:50:20.898219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.712 qpair failed and we were unable to recover it. 00:30:43.712 [2024-11-16 17:50:20.908079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.712 [2024-11-16 17:50:20.908172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.712 [2024-11-16 17:50:20.908198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.712 [2024-11-16 17:50:20.908213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.712 [2024-11-16 17:50:20.908226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.712 [2024-11-16 17:50:20.908256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.712 qpair failed and we were unable to recover it. 00:30:43.712 [2024-11-16 17:50:20.918137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.712 [2024-11-16 17:50:20.918229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.712 [2024-11-16 17:50:20.918259] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.712 [2024-11-16 17:50:20.918275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.712 [2024-11-16 17:50:20.918288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.712 [2024-11-16 17:50:20.918320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.712 qpair failed and we were unable to recover it. 00:30:43.712 [2024-11-16 17:50:20.928138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.712 [2024-11-16 17:50:20.928228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.712 [2024-11-16 17:50:20.928255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.712 [2024-11-16 17:50:20.928271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.712 [2024-11-16 17:50:20.928286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.712 [2024-11-16 17:50:20.928316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.712 qpair failed and we were unable to recover it. 00:30:43.712 [2024-11-16 17:50:20.938163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:20.938257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:20.938284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:20.938300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:20.938314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:20.938351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:20.948184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:20.948271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:20.948297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:20.948312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:20.948325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:20.948356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:20.958304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:20.958402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:20.958428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:20.958443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:20.958456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:20.958488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:20.968248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:20.968340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:20.968366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:20.968380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:20.968394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:20.968424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:20.978284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:20.978379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:20.978404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:20.978420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:20.978434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:20.978466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:20.988314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:20.988417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:20.988455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:20.988472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:20.988486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:20.988516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:20.998360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:20.998447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:20.998474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:20.998488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:20.998502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:20.998531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:21.008349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:21.008442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:21.008469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:21.008484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:21.008497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:21.008527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:21.018385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:21.018475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:21.018504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:21.018521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:21.018535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:21.018566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:21.028426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:21.028521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:21.028549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:21.028564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:21.028578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:21.028634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:21.038431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:21.038525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:21.038552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:21.038567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:21.038581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:21.038611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:21.048491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:21.048631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:21.048657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:21.048673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:21.048686] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:21.048716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:21.058523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.713 [2024-11-16 17:50:21.058623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.713 [2024-11-16 17:50:21.058650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.713 [2024-11-16 17:50:21.058666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.713 [2024-11-16 17:50:21.058679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.713 [2024-11-16 17:50:21.058709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.713 qpair failed and we were unable to recover it. 00:30:43.713 [2024-11-16 17:50:21.068534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.068646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.068672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.068686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.068700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.068732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.078565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.078670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.078695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.078709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.078721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.078751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.088591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.088692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.088717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.088733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.088748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.088779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.098604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.098708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.098735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.098750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.098764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.098794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.108670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.108764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.108791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.108806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.108819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.108850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.118670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.118766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.118793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.118808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.118827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.118871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.128712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.128805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.128832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.128847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.128862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.128893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.138819] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.138920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.138949] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.138964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.138978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.139008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.148792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.148896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.148923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.148938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.148951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.148995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.158794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.158890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.158923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.158939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.158953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.158983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.168809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.168903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.168930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.168945] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.168958] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.168989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.178881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.178969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.178993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.179007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.179019] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.179049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.188893] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.188988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.189015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.714 [2024-11-16 17:50:21.189030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.714 [2024-11-16 17:50:21.189043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.714 [2024-11-16 17:50:21.189073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.714 qpair failed and we were unable to recover it. 00:30:43.714 [2024-11-16 17:50:21.198905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.714 [2024-11-16 17:50:21.199003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.714 [2024-11-16 17:50:21.199028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.715 [2024-11-16 17:50:21.199043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.715 [2024-11-16 17:50:21.199057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.715 [2024-11-16 17:50:21.199086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.715 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.208944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.209037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.209063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.209084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.209099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.209130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.219048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.219142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.219168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.219182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.219195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.219225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.228998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.229097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.229123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.229138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.229152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.229181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.239047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.239150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.239177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.239192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.239206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.239237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.249040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.249133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.249159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.249174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.249187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.249218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.259156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.259244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.259269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.259284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.259297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.259327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.269126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.269226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.269252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.269267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.269281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.269310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.279129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.279219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.279245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.279259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.279273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.279303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.289187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.289284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.289310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.289324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.289338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.289368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.299231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.299332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.299360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.299383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.299397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.299428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.309245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.309347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.309373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.309388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.309401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.309431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.319330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.319432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.319459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.974 [2024-11-16 17:50:21.319473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.974 [2024-11-16 17:50:21.319486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.974 [2024-11-16 17:50:21.319516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.974 qpair failed and we were unable to recover it. 00:30:43.974 [2024-11-16 17:50:21.329279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.974 [2024-11-16 17:50:21.329373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.974 [2024-11-16 17:50:21.329408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.329423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.329437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.329471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.339298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.339386] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.339413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.339428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.339442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.339471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.349376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.349470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.349496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.349511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.349525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.349554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.359364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.359467] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.359495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.359513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.359526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.359558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.369418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.369514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.369541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.369555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.369569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.369599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.379510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.379624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.379651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.379665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.379679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.379709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.389453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.389591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.389640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.389668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.389683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.389712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.399469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.399579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.399628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.399647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.399660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.399692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.409528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.409631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.409657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.409672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.409686] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.409716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.419554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.419660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.419686] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.419701] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.419715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.419758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.429596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.429708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.429735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.429750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.429763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.429799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.439600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.439700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.439726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.439741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.439755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.439784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.449654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.449756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.449786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.449803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.449816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.975 [2024-11-16 17:50:21.449859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.975 qpair failed and we were unable to recover it. 00:30:43.975 [2024-11-16 17:50:21.459691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.975 [2024-11-16 17:50:21.459788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.975 [2024-11-16 17:50:21.459815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.975 [2024-11-16 17:50:21.459830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.975 [2024-11-16 17:50:21.459844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:43.976 [2024-11-16 17:50:21.459875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:43.976 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.469739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.469844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.469870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.469885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.469899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.469949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.479709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.479808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.479840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.479856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.479870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.479900] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.489770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.489867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.489893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.489908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.489923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.489953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.499808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.499934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.499961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.499976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.499989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.500019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.509827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.509971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.509997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.510012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.510025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.510055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.519839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.519936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.519962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.519977] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.519990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.520026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.529921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.530012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.530038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.530052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.530066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.530096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.539896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.540027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.540054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.540069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.540082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.540112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.549938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.550027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.550053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.550068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.550082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.550111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.559937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.560029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.560058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.560075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.560087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.560117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.569956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.570046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.235 [2024-11-16 17:50:21.570078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.235 [2024-11-16 17:50:21.570094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.235 [2024-11-16 17:50:21.570107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.235 [2024-11-16 17:50:21.570137] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.235 qpair failed and we were unable to recover it. 00:30:44.235 [2024-11-16 17:50:21.579997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.235 [2024-11-16 17:50:21.580092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.580118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.580133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.580147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.580177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.590077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.590181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.590207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.590222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.590237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.590266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.600061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.600151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.600178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.600193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.600206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.600236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.610104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.610196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.610222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.610238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.610257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.610301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.620137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.620225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.620252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.620267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.620281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.620311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.630172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.630271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.630298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.630313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.630326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.630358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.640205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.640300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.640326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.640341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.640355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.640385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.650218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.650333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.650359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.650374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.650388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.650418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.660258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.660365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.660395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.660412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.660426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.660457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.670316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.670409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.670435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.670450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.670464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.670494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.680316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.680407] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.680434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.680449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.680463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.680493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.690359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.690465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.690492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.690507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.690521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.690550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.700355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.700451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.700480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.700496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.236 [2024-11-16 17:50:21.700515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.236 [2024-11-16 17:50:21.700547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.236 qpair failed and we were unable to recover it. 00:30:44.236 [2024-11-16 17:50:21.710408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.236 [2024-11-16 17:50:21.710510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.236 [2024-11-16 17:50:21.710536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.236 [2024-11-16 17:50:21.710551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.237 [2024-11-16 17:50:21.710565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.237 [2024-11-16 17:50:21.710595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.237 qpair failed and we were unable to recover it. 00:30:44.237 [2024-11-16 17:50:21.720466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.237 [2024-11-16 17:50:21.720564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.237 [2024-11-16 17:50:21.720592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.237 [2024-11-16 17:50:21.720612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.237 [2024-11-16 17:50:21.720638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.237 [2024-11-16 17:50:21.720671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.237 qpair failed and we were unable to recover it. 00:30:44.496 [2024-11-16 17:50:21.730485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.496 [2024-11-16 17:50:21.730575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.496 [2024-11-16 17:50:21.730600] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.496 [2024-11-16 17:50:21.730621] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.496 [2024-11-16 17:50:21.730636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.496 [2024-11-16 17:50:21.730674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.496 qpair failed and we were unable to recover it. 00:30:44.496 [2024-11-16 17:50:21.740471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.496 [2024-11-16 17:50:21.740554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.496 [2024-11-16 17:50:21.740579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.496 [2024-11-16 17:50:21.740593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.496 [2024-11-16 17:50:21.740606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.496 [2024-11-16 17:50:21.740645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.496 qpair failed and we were unable to recover it. 00:30:44.496 [2024-11-16 17:50:21.750539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.496 [2024-11-16 17:50:21.750665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.496 [2024-11-16 17:50:21.750692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.496 [2024-11-16 17:50:21.750707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.496 [2024-11-16 17:50:21.750720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.496 [2024-11-16 17:50:21.750749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.496 qpair failed and we were unable to recover it. 00:30:44.496 [2024-11-16 17:50:21.760536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.496 [2024-11-16 17:50:21.760634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.496 [2024-11-16 17:50:21.760660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.496 [2024-11-16 17:50:21.760674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.496 [2024-11-16 17:50:21.760687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.496 [2024-11-16 17:50:21.760716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.496 qpair failed and we were unable to recover it. 00:30:44.496 [2024-11-16 17:50:21.770579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.496 [2024-11-16 17:50:21.770677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.496 [2024-11-16 17:50:21.770702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.496 [2024-11-16 17:50:21.770717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.496 [2024-11-16 17:50:21.770729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.496 [2024-11-16 17:50:21.770771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.496 qpair failed and we were unable to recover it. 00:30:44.496 [2024-11-16 17:50:21.780602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.496 [2024-11-16 17:50:21.780701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.496 [2024-11-16 17:50:21.780729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.496 [2024-11-16 17:50:21.780746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.496 [2024-11-16 17:50:21.780758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.496 [2024-11-16 17:50:21.780790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.496 qpair failed and we were unable to recover it. 00:30:44.496 [2024-11-16 17:50:21.790669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.496 [2024-11-16 17:50:21.790773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.496 [2024-11-16 17:50:21.790798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.496 [2024-11-16 17:50:21.790821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.496 [2024-11-16 17:50:21.790835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.496 [2024-11-16 17:50:21.790866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.496 qpair failed and we were unable to recover it. 00:30:44.496 [2024-11-16 17:50:21.800767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.496 [2024-11-16 17:50:21.800858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.496 [2024-11-16 17:50:21.800884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.496 [2024-11-16 17:50:21.800898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.496 [2024-11-16 17:50:21.800910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.800940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.810681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.810815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.810843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.810859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.810872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.810915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.820750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.820845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.820870] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.820884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.820897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.820927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.830766] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.830859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.830884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.830898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.830910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.830940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.840777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.840866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.840891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.840905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.840918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.840947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.850811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.850929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.850953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.850968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.850981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.851011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.860835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.860924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.860950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.860965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.860978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.861008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.870881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.871011] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.871038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.871051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.871064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.871105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.880878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.880973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.881004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.881020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.881032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.881062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.890945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.891065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.891090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.891105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.891117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.891160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.901032] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.901125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.901150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.901164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.901177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.901207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.910983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.911074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.911098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.911111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.911124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.911166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.921030] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.921140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.921164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.921178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.921191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.921221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.931092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.497 [2024-11-16 17:50:21.931190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.497 [2024-11-16 17:50:21.931215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.497 [2024-11-16 17:50:21.931230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.497 [2024-11-16 17:50:21.931242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.497 [2024-11-16 17:50:21.931272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.497 qpair failed and we were unable to recover it. 00:30:44.497 [2024-11-16 17:50:21.941075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.498 [2024-11-16 17:50:21.941158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.498 [2024-11-16 17:50:21.941182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.498 [2024-11-16 17:50:21.941197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.498 [2024-11-16 17:50:21.941209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.498 [2024-11-16 17:50:21.941239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.498 qpair failed and we were unable to recover it. 00:30:44.498 [2024-11-16 17:50:21.951132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.498 [2024-11-16 17:50:21.951223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.498 [2024-11-16 17:50:21.951248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.498 [2024-11-16 17:50:21.951262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.498 [2024-11-16 17:50:21.951275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.498 [2024-11-16 17:50:21.951304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.498 qpair failed and we were unable to recover it. 00:30:44.498 [2024-11-16 17:50:21.961134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.498 [2024-11-16 17:50:21.961221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.498 [2024-11-16 17:50:21.961246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.498 [2024-11-16 17:50:21.961260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.498 [2024-11-16 17:50:21.961273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.498 [2024-11-16 17:50:21.961304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.498 qpair failed and we were unable to recover it. 00:30:44.498 [2024-11-16 17:50:21.971141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.498 [2024-11-16 17:50:21.971225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.498 [2024-11-16 17:50:21.971255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.498 [2024-11-16 17:50:21.971269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.498 [2024-11-16 17:50:21.971282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.498 [2024-11-16 17:50:21.971311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.498 qpair failed and we were unable to recover it. 00:30:44.498 [2024-11-16 17:50:21.981166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.498 [2024-11-16 17:50:21.981287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.498 [2024-11-16 17:50:21.981312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.498 [2024-11-16 17:50:21.981327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.498 [2024-11-16 17:50:21.981340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.498 [2024-11-16 17:50:21.981370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.498 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:21.991237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.757 [2024-11-16 17:50:21.991344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.757 [2024-11-16 17:50:21.991369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.757 [2024-11-16 17:50:21.991383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.757 [2024-11-16 17:50:21.991396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.757 [2024-11-16 17:50:21.991426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.757 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:22.001270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.757 [2024-11-16 17:50:22.001375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.757 [2024-11-16 17:50:22.001400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.757 [2024-11-16 17:50:22.001414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.757 [2024-11-16 17:50:22.001427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.757 [2024-11-16 17:50:22.001457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.757 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:22.011260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.757 [2024-11-16 17:50:22.011355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.757 [2024-11-16 17:50:22.011380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.757 [2024-11-16 17:50:22.011394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.757 [2024-11-16 17:50:22.011406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.757 [2024-11-16 17:50:22.011443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.757 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:22.021277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.757 [2024-11-16 17:50:22.021366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.757 [2024-11-16 17:50:22.021390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.757 [2024-11-16 17:50:22.021405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.757 [2024-11-16 17:50:22.021418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.757 [2024-11-16 17:50:22.021447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.757 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:22.031318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.757 [2024-11-16 17:50:22.031408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.757 [2024-11-16 17:50:22.031433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.757 [2024-11-16 17:50:22.031447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.757 [2024-11-16 17:50:22.031460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.757 [2024-11-16 17:50:22.031490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.757 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:22.041377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.757 [2024-11-16 17:50:22.041469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.757 [2024-11-16 17:50:22.041494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.757 [2024-11-16 17:50:22.041508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.757 [2024-11-16 17:50:22.041520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.757 [2024-11-16 17:50:22.041550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.757 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:22.051430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.757 [2024-11-16 17:50:22.051523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.757 [2024-11-16 17:50:22.051549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.757 [2024-11-16 17:50:22.051563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.757 [2024-11-16 17:50:22.051575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.757 [2024-11-16 17:50:22.051605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.757 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:22.061402] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.757 [2024-11-16 17:50:22.061483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.757 [2024-11-16 17:50:22.061523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.757 [2024-11-16 17:50:22.061539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.757 [2024-11-16 17:50:22.061553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.757 [2024-11-16 17:50:22.061582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.757 qpair failed and we were unable to recover it. 00:30:44.757 [2024-11-16 17:50:22.071448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.071536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.071562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.071577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.071590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.071627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.081474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.081599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.081634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.081649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.081662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.081694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.091500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.091590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.091627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.091646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.091660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.091692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.101523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.101611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.101644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.101659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.101679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.101711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.111560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.111657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.111682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.111696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.111709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.111758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.121582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.121718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.121745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.121761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.121774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.121804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.131634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.131745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.131771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.131785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.131798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.131828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.141712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.141800] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.141826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.141841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.141855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.141896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.151672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.151772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.151801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.151817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.151831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.151862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.161728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.161827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.161853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.161869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.161881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.161913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.171723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.171803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.171829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.171844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.171857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.171888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.181761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.181850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.181881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.181900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.181913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.181943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.191800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.191895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.758 [2024-11-16 17:50:22.191920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.758 [2024-11-16 17:50:22.191934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.758 [2024-11-16 17:50:22.191953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.758 [2024-11-16 17:50:22.191984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.758 qpair failed and we were unable to recover it. 00:30:44.758 [2024-11-16 17:50:22.201813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.758 [2024-11-16 17:50:22.201904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.759 [2024-11-16 17:50:22.201929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.759 [2024-11-16 17:50:22.201943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.759 [2024-11-16 17:50:22.201956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.759 [2024-11-16 17:50:22.201985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.759 qpair failed and we were unable to recover it. 00:30:44.759 [2024-11-16 17:50:22.211887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.759 [2024-11-16 17:50:22.211979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.759 [2024-11-16 17:50:22.212004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.759 [2024-11-16 17:50:22.212018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.759 [2024-11-16 17:50:22.212032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.759 [2024-11-16 17:50:22.212063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.759 qpair failed and we were unable to recover it. 00:30:44.759 [2024-11-16 17:50:22.221920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.759 [2024-11-16 17:50:22.222053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.759 [2024-11-16 17:50:22.222084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.759 [2024-11-16 17:50:22.222108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.759 [2024-11-16 17:50:22.222124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.759 [2024-11-16 17:50:22.222155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.759 qpair failed and we were unable to recover it. 00:30:44.759 [2024-11-16 17:50:22.231886] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.759 [2024-11-16 17:50:22.231977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.759 [2024-11-16 17:50:22.232005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.759 [2024-11-16 17:50:22.232020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.759 [2024-11-16 17:50:22.232032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.759 [2024-11-16 17:50:22.232062] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.759 qpair failed and we were unable to recover it. 00:30:44.759 [2024-11-16 17:50:22.241951] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.759 [2024-11-16 17:50:22.242071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.759 [2024-11-16 17:50:22.242096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.759 [2024-11-16 17:50:22.242111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.759 [2024-11-16 17:50:22.242124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:44.759 [2024-11-16 17:50:22.242154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:44.759 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.251952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.252033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.252057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.252072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.252084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.252114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.261978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.262071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.262097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.262111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.262123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.262153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.272076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.272178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.272202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.272217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.272229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.272259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.282042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.282129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.282153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.282174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.282187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.282217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.292051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.292133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.292158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.292172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.292185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.292214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.302107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.302217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.302242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.302256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.302269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.302299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.312152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.312261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.312286] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.312301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.312313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.312343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.322157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.322274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.322298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.322314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.322326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.322357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.018 [2024-11-16 17:50:22.332183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.018 [2024-11-16 17:50:22.332267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.018 [2024-11-16 17:50:22.332292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.018 [2024-11-16 17:50:22.332307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.018 [2024-11-16 17:50:22.332319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.018 [2024-11-16 17:50:22.332348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.018 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.342192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.342281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.342305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.342319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.342331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.342361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.352256] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.352353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.352377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.352392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.352404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.352433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.362287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.362374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.362398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.362413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.362425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.362455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.372295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.372381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.372406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.372425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.372438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.372468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.382331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.382420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.382445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.382460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.382473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.382517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.392389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.392484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.392509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.392524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.392536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.392566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.402460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.402553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.402578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.402593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.402607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.402646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.412442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.412527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.412553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.412567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.412580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.412610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.422466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.422557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.422582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.422596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.422610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.422653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.432585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.432715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.432743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.432758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.432771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.432803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.442535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.442644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.442670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.442685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.442698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.442729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.452553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.452647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.452674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.452689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.452702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.452744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.462586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.462685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.462716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.019 [2024-11-16 17:50:22.462732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.019 [2024-11-16 17:50:22.462745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.019 [2024-11-16 17:50:22.462775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.019 qpair failed and we were unable to recover it. 00:30:45.019 [2024-11-16 17:50:22.472634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.019 [2024-11-16 17:50:22.472722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.019 [2024-11-16 17:50:22.472747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.020 [2024-11-16 17:50:22.472762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.020 [2024-11-16 17:50:22.472775] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.020 [2024-11-16 17:50:22.472805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.020 qpair failed and we were unable to recover it. 00:30:45.020 [2024-11-16 17:50:22.482608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.020 [2024-11-16 17:50:22.482702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.020 [2024-11-16 17:50:22.482728] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.020 [2024-11-16 17:50:22.482742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.020 [2024-11-16 17:50:22.482756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.020 [2024-11-16 17:50:22.482787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.020 qpair failed and we were unable to recover it. 00:30:45.020 [2024-11-16 17:50:22.492674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.020 [2024-11-16 17:50:22.492765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.020 [2024-11-16 17:50:22.492791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.020 [2024-11-16 17:50:22.492805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.020 [2024-11-16 17:50:22.492818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.020 [2024-11-16 17:50:22.492848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.020 qpair failed and we were unable to recover it. 00:30:45.020 [2024-11-16 17:50:22.502742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.020 [2024-11-16 17:50:22.502844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.020 [2024-11-16 17:50:22.502874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.020 [2024-11-16 17:50:22.502889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.020 [2024-11-16 17:50:22.502902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.020 [2024-11-16 17:50:22.502941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.020 qpair failed and we were unable to recover it. 00:30:45.279 [2024-11-16 17:50:22.512770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.279 [2024-11-16 17:50:22.512868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.279 [2024-11-16 17:50:22.512894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.279 [2024-11-16 17:50:22.512908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.279 [2024-11-16 17:50:22.512922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.279 [2024-11-16 17:50:22.512959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.279 qpair failed and we were unable to recover it. 00:30:45.279 [2024-11-16 17:50:22.522771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.279 [2024-11-16 17:50:22.522903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.279 [2024-11-16 17:50:22.522928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.279 [2024-11-16 17:50:22.522942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.279 [2024-11-16 17:50:22.522955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.279 [2024-11-16 17:50:22.522986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.279 qpair failed and we were unable to recover it. 00:30:45.279 [2024-11-16 17:50:22.532821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.279 [2024-11-16 17:50:22.532919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.279 [2024-11-16 17:50:22.532945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.279 [2024-11-16 17:50:22.532959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.279 [2024-11-16 17:50:22.532972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.279 [2024-11-16 17:50:22.533001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.279 qpair failed and we were unable to recover it. 00:30:45.279 [2024-11-16 17:50:22.542830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.279 [2024-11-16 17:50:22.542924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.279 [2024-11-16 17:50:22.542950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.279 [2024-11-16 17:50:22.542964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.279 [2024-11-16 17:50:22.542977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.279 [2024-11-16 17:50:22.543017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.279 qpair failed and we were unable to recover it. 00:30:45.279 [2024-11-16 17:50:22.552860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.279 [2024-11-16 17:50:22.552957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.279 [2024-11-16 17:50:22.552988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.279 [2024-11-16 17:50:22.553003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.279 [2024-11-16 17:50:22.553016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.279 [2024-11-16 17:50:22.553044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.279 qpair failed and we were unable to recover it. 00:30:45.279 [2024-11-16 17:50:22.562868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.279 [2024-11-16 17:50:22.562963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.279 [2024-11-16 17:50:22.562989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.279 [2024-11-16 17:50:22.563002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.279 [2024-11-16 17:50:22.563014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.279 [2024-11-16 17:50:22.563042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.279 qpair failed and we were unable to recover it. 00:30:45.279 [2024-11-16 17:50:22.572889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.279 [2024-11-16 17:50:22.572972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.279 [2024-11-16 17:50:22.572997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.279 [2024-11-16 17:50:22.573011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.573024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.573053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.582943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.583063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.583088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.583103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.583118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.583147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.592970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.593109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.593134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.593148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.593166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.593196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.602989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.603074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.603100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.603114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.603126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.603156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.613006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.613088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.613113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.613127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.613140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.613182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.623153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.623240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.623265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.623279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.623291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.623321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.633144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.633248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.633274] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.633288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.633300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.633329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.643192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.643287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.643313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.643327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.643339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.643367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.653120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.653205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.653231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.653245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.653258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.653286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.663169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.663254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.663280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.663294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.663307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.663337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.673235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.673352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.673377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.673391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.673403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.673432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.683212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.683297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.683322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.683336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.683354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.683383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.693247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.693342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.693368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.693382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.693394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.693424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.280 [2024-11-16 17:50:22.703276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.280 [2024-11-16 17:50:22.703369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.280 [2024-11-16 17:50:22.703399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.280 [2024-11-16 17:50:22.703414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.280 [2024-11-16 17:50:22.703427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.280 [2024-11-16 17:50:22.703457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.280 qpair failed and we were unable to recover it. 00:30:45.281 [2024-11-16 17:50:22.713331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.281 [2024-11-16 17:50:22.713423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.281 [2024-11-16 17:50:22.713449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.281 [2024-11-16 17:50:22.713463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.281 [2024-11-16 17:50:22.713475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.281 [2024-11-16 17:50:22.713505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.281 qpair failed and we were unable to recover it. 00:30:45.281 [2024-11-16 17:50:22.723348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.281 [2024-11-16 17:50:22.723438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.281 [2024-11-16 17:50:22.723464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.281 [2024-11-16 17:50:22.723478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.281 [2024-11-16 17:50:22.723490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.281 [2024-11-16 17:50:22.723519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.281 qpair failed and we were unable to recover it. 00:30:45.281 [2024-11-16 17:50:22.733374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.281 [2024-11-16 17:50:22.733473] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.281 [2024-11-16 17:50:22.733497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.281 [2024-11-16 17:50:22.733511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.281 [2024-11-16 17:50:22.733522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.281 [2024-11-16 17:50:22.733551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.281 qpair failed and we were unable to recover it. 00:30:45.281 [2024-11-16 17:50:22.743417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.281 [2024-11-16 17:50:22.743503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.281 [2024-11-16 17:50:22.743528] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.281 [2024-11-16 17:50:22.743542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.281 [2024-11-16 17:50:22.743554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.281 [2024-11-16 17:50:22.743584] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.281 qpair failed and we were unable to recover it. 00:30:45.281 [2024-11-16 17:50:22.753452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.281 [2024-11-16 17:50:22.753566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.281 [2024-11-16 17:50:22.753591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.281 [2024-11-16 17:50:22.753604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.281 [2024-11-16 17:50:22.753625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.281 [2024-11-16 17:50:22.753657] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.281 qpair failed and we were unable to recover it. 00:30:45.281 [2024-11-16 17:50:22.763481] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.281 [2024-11-16 17:50:22.763572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.281 [2024-11-16 17:50:22.763597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.281 [2024-11-16 17:50:22.763611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.281 [2024-11-16 17:50:22.763636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.281 [2024-11-16 17:50:22.763666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.281 qpair failed and we were unable to recover it. 00:30:45.540 [2024-11-16 17:50:22.773478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.540 [2024-11-16 17:50:22.773568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.540 [2024-11-16 17:50:22.773593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.540 [2024-11-16 17:50:22.773613] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.540 [2024-11-16 17:50:22.773637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.540 [2024-11-16 17:50:22.773667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.540 qpair failed and we were unable to recover it. 00:30:45.540 [2024-11-16 17:50:22.783515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.540 [2024-11-16 17:50:22.783604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.540 [2024-11-16 17:50:22.783640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.540 [2024-11-16 17:50:22.783654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.540 [2024-11-16 17:50:22.783667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.540 [2024-11-16 17:50:22.783697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.540 qpair failed and we were unable to recover it. 00:30:45.540 [2024-11-16 17:50:22.793546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.540 [2024-11-16 17:50:22.793645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.540 [2024-11-16 17:50:22.793671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.540 [2024-11-16 17:50:22.793685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.540 [2024-11-16 17:50:22.793697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.540 [2024-11-16 17:50:22.793726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.540 qpair failed and we were unable to recover it. 00:30:45.540 [2024-11-16 17:50:22.803574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.540 [2024-11-16 17:50:22.803668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.540 [2024-11-16 17:50:22.803694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.540 [2024-11-16 17:50:22.803707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.540 [2024-11-16 17:50:22.803720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.540 [2024-11-16 17:50:22.803750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.540 qpair failed and we were unable to recover it. 00:30:45.540 [2024-11-16 17:50:22.813733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.540 [2024-11-16 17:50:22.813832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.540 [2024-11-16 17:50:22.813857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.540 [2024-11-16 17:50:22.813871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.540 [2024-11-16 17:50:22.813884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.540 [2024-11-16 17:50:22.813915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.540 qpair failed and we were unable to recover it. 00:30:45.540 [2024-11-16 17:50:22.823694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.540 [2024-11-16 17:50:22.823783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.540 [2024-11-16 17:50:22.823808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.540 [2024-11-16 17:50:22.823822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.540 [2024-11-16 17:50:22.823835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.540 [2024-11-16 17:50:22.823865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.540 qpair failed and we were unable to recover it. 00:30:45.540 [2024-11-16 17:50:22.833746] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.540 [2024-11-16 17:50:22.833871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.833897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.833910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.833923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.833952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.843772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.843864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.843889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.843902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.843915] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.843946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.853723] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.853805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.853830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.853843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.853856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.853885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.863788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.863896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.863921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.863941] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.863955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.863985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.873811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.873902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.873931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.873949] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.873962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.873992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.883839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.883931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.883956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.883970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.883983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.884014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.893845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.893936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.893961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.893975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.893987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.894017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.903890] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.903979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.904005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.904019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.904031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.904061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.913903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.913993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.914021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.914036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.914049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.914078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.923919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.924010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.924036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.924050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.924062] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.924093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.933960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.934080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.934105] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.934118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.934131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.934161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.943969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.944054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.944080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.944094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.944106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.944135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.541 [2024-11-16 17:50:22.954070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.541 [2024-11-16 17:50:22.954160] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.541 [2024-11-16 17:50:22.954191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.541 [2024-11-16 17:50:22.954205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.541 [2024-11-16 17:50:22.954218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.541 [2024-11-16 17:50:22.954247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.541 qpair failed and we were unable to recover it. 00:30:45.542 [2024-11-16 17:50:22.964055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.542 [2024-11-16 17:50:22.964144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.542 [2024-11-16 17:50:22.964169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.542 [2024-11-16 17:50:22.964182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.542 [2024-11-16 17:50:22.964195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.542 [2024-11-16 17:50:22.964224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.542 qpair failed and we were unable to recover it. 00:30:45.542 [2024-11-16 17:50:22.974166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.542 [2024-11-16 17:50:22.974255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.542 [2024-11-16 17:50:22.974285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.542 [2024-11-16 17:50:22.974300] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.542 [2024-11-16 17:50:22.974312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.542 [2024-11-16 17:50:22.974344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.542 qpair failed and we were unable to recover it. 00:30:45.542 [2024-11-16 17:50:22.984129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.542 [2024-11-16 17:50:22.984217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.542 [2024-11-16 17:50:22.984243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.542 [2024-11-16 17:50:22.984257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.542 [2024-11-16 17:50:22.984269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.542 [2024-11-16 17:50:22.984299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.542 qpair failed and we were unable to recover it. 00:30:45.542 [2024-11-16 17:50:22.994144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.542 [2024-11-16 17:50:22.994233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.542 [2024-11-16 17:50:22.994258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.542 [2024-11-16 17:50:22.994272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.542 [2024-11-16 17:50:22.994284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.542 [2024-11-16 17:50:22.994319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.542 qpair failed and we were unable to recover it. 00:30:45.542 [2024-11-16 17:50:23.004203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.542 [2024-11-16 17:50:23.004316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.542 [2024-11-16 17:50:23.004341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.542 [2024-11-16 17:50:23.004354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.542 [2024-11-16 17:50:23.004367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.542 [2024-11-16 17:50:23.004398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.542 qpair failed and we were unable to recover it. 00:30:45.542 [2024-11-16 17:50:23.014284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.542 [2024-11-16 17:50:23.014373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.542 [2024-11-16 17:50:23.014399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.542 [2024-11-16 17:50:23.014413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.542 [2024-11-16 17:50:23.014425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.542 [2024-11-16 17:50:23.014453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.542 qpair failed and we were unable to recover it. 00:30:45.542 [2024-11-16 17:50:23.024240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.542 [2024-11-16 17:50:23.024365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.542 [2024-11-16 17:50:23.024390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.542 [2024-11-16 17:50:23.024403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.542 [2024-11-16 17:50:23.024416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.542 [2024-11-16 17:50:23.024446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.542 qpair failed and we were unable to recover it. 00:30:45.802 [2024-11-16 17:50:23.034237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.802 [2024-11-16 17:50:23.034324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.802 [2024-11-16 17:50:23.034349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.802 [2024-11-16 17:50:23.034363] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.802 [2024-11-16 17:50:23.034376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.802 [2024-11-16 17:50:23.034419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.802 qpair failed and we were unable to recover it. 00:30:45.802 [2024-11-16 17:50:23.044282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.802 [2024-11-16 17:50:23.044376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.802 [2024-11-16 17:50:23.044410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.802 [2024-11-16 17:50:23.044426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.802 [2024-11-16 17:50:23.044439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.802 [2024-11-16 17:50:23.044469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.802 qpair failed and we were unable to recover it. 00:30:45.802 [2024-11-16 17:50:23.054323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.802 [2024-11-16 17:50:23.054409] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.802 [2024-11-16 17:50:23.054435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.802 [2024-11-16 17:50:23.054449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.802 [2024-11-16 17:50:23.054462] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.802 [2024-11-16 17:50:23.054491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.802 qpair failed and we were unable to recover it. 00:30:45.802 [2024-11-16 17:50:23.064374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.802 [2024-11-16 17:50:23.064465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.802 [2024-11-16 17:50:23.064490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.802 [2024-11-16 17:50:23.064504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.802 [2024-11-16 17:50:23.064517] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.802 [2024-11-16 17:50:23.064546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.802 qpair failed and we were unable to recover it. 00:30:45.802 [2024-11-16 17:50:23.074385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.802 [2024-11-16 17:50:23.074474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.802 [2024-11-16 17:50:23.074499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.802 [2024-11-16 17:50:23.074513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.802 [2024-11-16 17:50:23.074526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.802 [2024-11-16 17:50:23.074555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.802 qpair failed and we were unable to recover it. 00:30:45.802 [2024-11-16 17:50:23.084411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.802 [2024-11-16 17:50:23.084541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.802 [2024-11-16 17:50:23.084565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.802 [2024-11-16 17:50:23.084579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.802 [2024-11-16 17:50:23.084592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.802 [2024-11-16 17:50:23.084637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.802 qpair failed and we were unable to recover it. 00:30:45.802 [2024-11-16 17:50:23.094425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.802 [2024-11-16 17:50:23.094509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.802 [2024-11-16 17:50:23.094534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.802 [2024-11-16 17:50:23.094548] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.802 [2024-11-16 17:50:23.094561] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.802 [2024-11-16 17:50:23.094590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.802 qpair failed and we were unable to recover it. 00:30:45.802 [2024-11-16 17:50:23.104438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.802 [2024-11-16 17:50:23.104526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.802 [2024-11-16 17:50:23.104551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.802 [2024-11-16 17:50:23.104564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.802 [2024-11-16 17:50:23.104577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.104607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.114526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.114632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.114658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.114671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.114684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.114714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.124511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.124601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.124635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.124650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.124662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.124693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.134603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.134696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.134727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.134741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.134754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.134783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.144590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.144689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.144714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.144728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.144741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.144771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.154587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.154683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.154708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.154721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.154733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.154762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.164652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.164742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.164767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.164781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.164793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.164823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.174737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.174824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.174849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.174863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.174881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.174910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.184703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.184821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.184847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.184861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.184873] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.184903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.194731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.194847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.194872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.194886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.194899] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.194927] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.204733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.204816] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.204842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.204855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.204868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.204909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.214772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.214862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.214891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.214906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.214919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.214950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.224783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.803 [2024-11-16 17:50:23.224883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.803 [2024-11-16 17:50:23.224909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.803 [2024-11-16 17:50:23.224923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.803 [2024-11-16 17:50:23.224936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.803 [2024-11-16 17:50:23.224966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.803 qpair failed and we were unable to recover it. 00:30:45.803 [2024-11-16 17:50:23.234830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.804 [2024-11-16 17:50:23.234917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.804 [2024-11-16 17:50:23.234943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.804 [2024-11-16 17:50:23.234957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.804 [2024-11-16 17:50:23.234970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.804 [2024-11-16 17:50:23.235011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.804 qpair failed and we were unable to recover it. 00:30:45.804 [2024-11-16 17:50:23.244860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.804 [2024-11-16 17:50:23.244953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.804 [2024-11-16 17:50:23.244978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.804 [2024-11-16 17:50:23.244992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.804 [2024-11-16 17:50:23.245005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.804 [2024-11-16 17:50:23.245036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.804 qpair failed and we were unable to recover it. 00:30:45.804 [2024-11-16 17:50:23.254877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.804 [2024-11-16 17:50:23.255009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.804 [2024-11-16 17:50:23.255034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.804 [2024-11-16 17:50:23.255047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.804 [2024-11-16 17:50:23.255060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.804 [2024-11-16 17:50:23.255089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.804 qpair failed and we were unable to recover it. 00:30:45.804 [2024-11-16 17:50:23.264918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.804 [2024-11-16 17:50:23.265046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.804 [2024-11-16 17:50:23.265071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.804 [2024-11-16 17:50:23.265084] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.804 [2024-11-16 17:50:23.265102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.804 [2024-11-16 17:50:23.265132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.804 qpair failed and we were unable to recover it. 00:30:45.804 [2024-11-16 17:50:23.275063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.804 [2024-11-16 17:50:23.275195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.804 [2024-11-16 17:50:23.275220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.804 [2024-11-16 17:50:23.275234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.804 [2024-11-16 17:50:23.275246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.804 [2024-11-16 17:50:23.275276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.804 qpair failed and we were unable to recover it. 00:30:45.804 [2024-11-16 17:50:23.284946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.804 [2024-11-16 17:50:23.285038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.804 [2024-11-16 17:50:23.285063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.804 [2024-11-16 17:50:23.285077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.804 [2024-11-16 17:50:23.285090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:45.804 [2024-11-16 17:50:23.285120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:45.804 qpair failed and we were unable to recover it. 00:30:46.063 [2024-11-16 17:50:23.295098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.063 [2024-11-16 17:50:23.295189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.063 [2024-11-16 17:50:23.295216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.063 [2024-11-16 17:50:23.295230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.063 [2024-11-16 17:50:23.295243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.063 [2024-11-16 17:50:23.295274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.063 qpair failed and we were unable to recover it. 00:30:46.063 [2024-11-16 17:50:23.304985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.063 [2024-11-16 17:50:23.305068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.063 [2024-11-16 17:50:23.305094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.063 [2024-11-16 17:50:23.305107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.063 [2024-11-16 17:50:23.305120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.063 [2024-11-16 17:50:23.305151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.063 qpair failed and we were unable to recover it. 00:30:46.063 [2024-11-16 17:50:23.315048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.063 [2024-11-16 17:50:23.315185] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.063 [2024-11-16 17:50:23.315211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.063 [2024-11-16 17:50:23.315225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.063 [2024-11-16 17:50:23.315237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.063 [2024-11-16 17:50:23.315269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.063 qpair failed and we were unable to recover it. 00:30:46.063 [2024-11-16 17:50:23.325098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.063 [2024-11-16 17:50:23.325187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.063 [2024-11-16 17:50:23.325212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.063 [2024-11-16 17:50:23.325226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.063 [2024-11-16 17:50:23.325239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.063 [2024-11-16 17:50:23.325268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.063 qpair failed and we were unable to recover it. 00:30:46.063 [2024-11-16 17:50:23.335094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.063 [2024-11-16 17:50:23.335180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.063 [2024-11-16 17:50:23.335205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.063 [2024-11-16 17:50:23.335219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.063 [2024-11-16 17:50:23.335231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.063 [2024-11-16 17:50:23.335260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.063 qpair failed and we were unable to recover it. 00:30:46.063 [2024-11-16 17:50:23.345132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.063 [2024-11-16 17:50:23.345237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.063 [2024-11-16 17:50:23.345262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.063 [2024-11-16 17:50:23.345276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.063 [2024-11-16 17:50:23.345289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.063 [2024-11-16 17:50:23.345318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.063 qpair failed and we were unable to recover it. 00:30:46.063 [2024-11-16 17:50:23.355172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.063 [2024-11-16 17:50:23.355260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.063 [2024-11-16 17:50:23.355285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.063 [2024-11-16 17:50:23.355305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.355318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.355348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.365185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.365274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.365299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.365313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.365325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.365356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.375194] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.375279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.375304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.375317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.375330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.375359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.385243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.385353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.385379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.385392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.385406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.385436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.395254] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.395340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.395366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.395380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.395393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.395422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.405309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.405402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.405428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.405442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.405454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.405484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.415330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.415416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.415441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.415454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.415467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.415498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.425433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.425517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.425545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.425560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.425573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.425603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.435366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.435451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.435476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.435490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.435503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.435532] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.445388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.445507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.445537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.445552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.445565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.445594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.455452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.455536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.455562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.455576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.455590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.455628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.465515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.465599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.465633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.465647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.465662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.465693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.475493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.475589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.475625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.475646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.475658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.064 [2024-11-16 17:50:23.475690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.064 qpair failed and we were unable to recover it. 00:30:46.064 [2024-11-16 17:50:23.485603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.064 [2024-11-16 17:50:23.485710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.064 [2024-11-16 17:50:23.485738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.064 [2024-11-16 17:50:23.485752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.064 [2024-11-16 17:50:23.485765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.065 [2024-11-16 17:50:23.485801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.065 qpair failed and we were unable to recover it. 00:30:46.065 [2024-11-16 17:50:23.495573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.065 [2024-11-16 17:50:23.495672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.065 [2024-11-16 17:50:23.495698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.065 [2024-11-16 17:50:23.495712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.065 [2024-11-16 17:50:23.495724] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.065 [2024-11-16 17:50:23.495755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.065 qpair failed and we were unable to recover it. 00:30:46.065 [2024-11-16 17:50:23.505579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.065 [2024-11-16 17:50:23.505674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.065 [2024-11-16 17:50:23.505701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.065 [2024-11-16 17:50:23.505715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.065 [2024-11-16 17:50:23.505727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.065 [2024-11-16 17:50:23.505771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.065 qpair failed and we were unable to recover it. 00:30:46.065 [2024-11-16 17:50:23.515650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.065 [2024-11-16 17:50:23.515744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.065 [2024-11-16 17:50:23.515769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.065 [2024-11-16 17:50:23.515784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.065 [2024-11-16 17:50:23.515797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.065 [2024-11-16 17:50:23.515826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.065 qpair failed and we were unable to recover it. 00:30:46.065 [2024-11-16 17:50:23.525716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.065 [2024-11-16 17:50:23.525804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.065 [2024-11-16 17:50:23.525833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.065 [2024-11-16 17:50:23.525850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.065 [2024-11-16 17:50:23.525862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.065 [2024-11-16 17:50:23.525892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.065 qpair failed and we were unable to recover it. 00:30:46.065 [2024-11-16 17:50:23.535741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.065 [2024-11-16 17:50:23.535825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.065 [2024-11-16 17:50:23.535856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.065 [2024-11-16 17:50:23.535871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.065 [2024-11-16 17:50:23.535883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.065 [2024-11-16 17:50:23.535913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.065 qpair failed and we were unable to recover it. 00:30:46.065 [2024-11-16 17:50:23.545682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.065 [2024-11-16 17:50:23.545769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.065 [2024-11-16 17:50:23.545794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.065 [2024-11-16 17:50:23.545808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.065 [2024-11-16 17:50:23.545820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.065 [2024-11-16 17:50:23.545850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.065 qpair failed and we were unable to recover it. 00:30:46.324 [2024-11-16 17:50:23.555717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.324 [2024-11-16 17:50:23.555830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.324 [2024-11-16 17:50:23.555855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.324 [2024-11-16 17:50:23.555868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.324 [2024-11-16 17:50:23.555881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.324 [2024-11-16 17:50:23.555910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.324 qpair failed and we were unable to recover it. 00:30:46.324 [2024-11-16 17:50:23.565773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.324 [2024-11-16 17:50:23.565883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.324 [2024-11-16 17:50:23.565909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.324 [2024-11-16 17:50:23.565923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.324 [2024-11-16 17:50:23.565935] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.324 [2024-11-16 17:50:23.565976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.324 qpair failed and we were unable to recover it. 00:30:46.324 [2024-11-16 17:50:23.575817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.324 [2024-11-16 17:50:23.575907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.324 [2024-11-16 17:50:23.575935] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.324 [2024-11-16 17:50:23.575953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.324 [2024-11-16 17:50:23.575966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.324 [2024-11-16 17:50:23.576004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.324 qpair failed and we were unable to recover it. 00:30:46.324 [2024-11-16 17:50:23.585912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.324 [2024-11-16 17:50:23.586028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.324 [2024-11-16 17:50:23.586053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.324 [2024-11-16 17:50:23.586067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.324 [2024-11-16 17:50:23.586080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.324 [2024-11-16 17:50:23.586109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.324 qpair failed and we were unable to recover it. 00:30:46.324 [2024-11-16 17:50:23.595843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.324 [2024-11-16 17:50:23.595936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.324 [2024-11-16 17:50:23.595962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.324 [2024-11-16 17:50:23.595976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.324 [2024-11-16 17:50:23.595988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.324 [2024-11-16 17:50:23.596018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.324 qpair failed and we were unable to recover it. 00:30:46.324 [2024-11-16 17:50:23.605878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.324 [2024-11-16 17:50:23.605982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.324 [2024-11-16 17:50:23.606007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.324 [2024-11-16 17:50:23.606022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.324 [2024-11-16 17:50:23.606034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.324 [2024-11-16 17:50:23.606065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.324 qpair failed and we were unable to recover it. 00:30:46.324 [2024-11-16 17:50:23.615874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.324 [2024-11-16 17:50:23.615973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.324 [2024-11-16 17:50:23.616009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.324 [2024-11-16 17:50:23.616022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.324 [2024-11-16 17:50:23.616035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.324 [2024-11-16 17:50:23.616064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.324 qpair failed and we were unable to recover it. 00:30:46.324 [2024-11-16 17:50:23.625946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.324 [2024-11-16 17:50:23.626065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.324 [2024-11-16 17:50:23.626096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.324 [2024-11-16 17:50:23.626110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.324 [2024-11-16 17:50:23.626123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.324 [2024-11-16 17:50:23.626152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.324 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.635947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.636036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.636061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.636075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.636087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.636117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.645970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.646072] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.646101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.646119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.646132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.646164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.656068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.656162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.656188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.656202] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.656215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.656245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.666021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.666120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.666146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.666160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.666180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.666210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.676065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.676159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.676186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.676199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.676212] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.676242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.686114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.686202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.686228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.686242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.686255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.686284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.696183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.696288] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.696313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.696327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.696339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.696368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.706179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.706283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.706308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.706322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.706334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.706364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.716215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.716336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.716361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.716375] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.716388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.716418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.726226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.726318] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.726344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.726358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.726371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.726414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.736249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.736334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.736358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.736372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.736383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.736412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.746272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.325 [2024-11-16 17:50:23.746358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.325 [2024-11-16 17:50:23.746384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.325 [2024-11-16 17:50:23.746397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.325 [2024-11-16 17:50:23.746410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.325 [2024-11-16 17:50:23.746439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.325 qpair failed and we were unable to recover it. 00:30:46.325 [2024-11-16 17:50:23.756332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.326 [2024-11-16 17:50:23.756426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.326 [2024-11-16 17:50:23.756451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.326 [2024-11-16 17:50:23.756465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.326 [2024-11-16 17:50:23.756483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.326 [2024-11-16 17:50:23.756524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.326 qpair failed and we were unable to recover it. 00:30:46.326 [2024-11-16 17:50:23.766330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.326 [2024-11-16 17:50:23.766424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.326 [2024-11-16 17:50:23.766453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.326 [2024-11-16 17:50:23.766472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.326 [2024-11-16 17:50:23.766486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.326 [2024-11-16 17:50:23.766515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.326 qpair failed and we were unable to recover it. 00:30:46.326 [2024-11-16 17:50:23.776439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.326 [2024-11-16 17:50:23.776542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.326 [2024-11-16 17:50:23.776568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.326 [2024-11-16 17:50:23.776582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.326 [2024-11-16 17:50:23.776594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.326 [2024-11-16 17:50:23.776630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.326 qpair failed and we were unable to recover it. 00:30:46.326 [2024-11-16 17:50:23.786409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.326 [2024-11-16 17:50:23.786541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.326 [2024-11-16 17:50:23.786566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.326 [2024-11-16 17:50:23.786579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.326 [2024-11-16 17:50:23.786591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.326 [2024-11-16 17:50:23.786630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.326 qpair failed and we were unable to recover it. 00:30:46.326 [2024-11-16 17:50:23.796522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.326 [2024-11-16 17:50:23.796610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.326 [2024-11-16 17:50:23.796645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.326 [2024-11-16 17:50:23.796659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.326 [2024-11-16 17:50:23.796672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.326 [2024-11-16 17:50:23.796701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.326 qpair failed and we were unable to recover it. 00:30:46.326 [2024-11-16 17:50:23.806490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.326 [2024-11-16 17:50:23.806623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.326 [2024-11-16 17:50:23.806648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.326 [2024-11-16 17:50:23.806662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.326 [2024-11-16 17:50:23.806674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.326 [2024-11-16 17:50:23.806705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.326 qpair failed and we were unable to recover it. 00:30:46.585 [2024-11-16 17:50:23.816491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.585 [2024-11-16 17:50:23.816589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.585 [2024-11-16 17:50:23.816626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.585 [2024-11-16 17:50:23.816646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.585 [2024-11-16 17:50:23.816660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.585 [2024-11-16 17:50:23.816691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.585 qpair failed and we were unable to recover it. 00:30:46.585 [2024-11-16 17:50:23.826553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.585 [2024-11-16 17:50:23.826682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.585 [2024-11-16 17:50:23.826708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.585 [2024-11-16 17:50:23.826721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.585 [2024-11-16 17:50:23.826735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.585 [2024-11-16 17:50:23.826766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.585 qpair failed and we were unable to recover it. 00:30:46.585 [2024-11-16 17:50:23.836540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.585 [2024-11-16 17:50:23.836643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.585 [2024-11-16 17:50:23.836668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.585 [2024-11-16 17:50:23.836681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.585 [2024-11-16 17:50:23.836697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.585 [2024-11-16 17:50:23.836727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.585 qpair failed and we were unable to recover it. 00:30:46.585 [2024-11-16 17:50:23.846605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.585 [2024-11-16 17:50:23.846702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.585 [2024-11-16 17:50:23.846727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.585 [2024-11-16 17:50:23.846747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.585 [2024-11-16 17:50:23.846760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.585 [2024-11-16 17:50:23.846791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.585 qpair failed and we were unable to recover it. 00:30:46.585 [2024-11-16 17:50:23.856637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.585 [2024-11-16 17:50:23.856773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.585 [2024-11-16 17:50:23.856798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.585 [2024-11-16 17:50:23.856811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.585 [2024-11-16 17:50:23.856824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.585 [2024-11-16 17:50:23.856855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.585 qpair failed and we were unable to recover it. 00:30:46.585 [2024-11-16 17:50:23.866669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.585 [2024-11-16 17:50:23.866756] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.585 [2024-11-16 17:50:23.866781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.585 [2024-11-16 17:50:23.866795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.585 [2024-11-16 17:50:23.866807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.585 [2024-11-16 17:50:23.866837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.585 qpair failed and we were unable to recover it. 00:30:46.585 [2024-11-16 17:50:23.876676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.585 [2024-11-16 17:50:23.876763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.585 [2024-11-16 17:50:23.876789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.585 [2024-11-16 17:50:23.876803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.585 [2024-11-16 17:50:23.876815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.585 [2024-11-16 17:50:23.876857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.585 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.886747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.886862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.886887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.886901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.886913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.886943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.896748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.896835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.896860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.896873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.896885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.896914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.906761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.906858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.906887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.906902] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.906914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.906943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.916836] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.916929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.916954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.916968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.916981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.917010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.926839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.926928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.926953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.926967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.926980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.927011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.936862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.936953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.936978] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.936999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.937012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.937055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.946978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.947066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.947091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.947105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.947118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.947147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.956930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.957024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.957049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.957063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.957076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.957106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.966961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.967093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.967119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.967133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.967145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.967174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.976987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.977067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.977092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.977107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.977119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.977161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.987085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.987176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.987202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.987216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.987230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.987259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:23.997133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:23.997266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.586 [2024-11-16 17:50:23.997293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.586 [2024-11-16 17:50:23.997309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.586 [2024-11-16 17:50:23.997323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.586 [2024-11-16 17:50:23.997357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.586 qpair failed and we were unable to recover it. 00:30:46.586 [2024-11-16 17:50:24.007090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.586 [2024-11-16 17:50:24.007180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.587 [2024-11-16 17:50:24.007206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.587 [2024-11-16 17:50:24.007220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.587 [2024-11-16 17:50:24.007233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.587 [2024-11-16 17:50:24.007263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.587 qpair failed and we were unable to recover it. 00:30:46.587 [2024-11-16 17:50:24.017121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.587 [2024-11-16 17:50:24.017219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.587 [2024-11-16 17:50:24.017244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.587 [2024-11-16 17:50:24.017258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.587 [2024-11-16 17:50:24.017271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.587 [2024-11-16 17:50:24.017300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.587 qpair failed and we were unable to recover it. 00:30:46.587 [2024-11-16 17:50:24.027165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.587 [2024-11-16 17:50:24.027250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.587 [2024-11-16 17:50:24.027281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.587 [2024-11-16 17:50:24.027296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.587 [2024-11-16 17:50:24.027309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.587 [2024-11-16 17:50:24.027338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.587 qpair failed and we were unable to recover it. 00:30:46.587 [2024-11-16 17:50:24.037156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.587 [2024-11-16 17:50:24.037247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.587 [2024-11-16 17:50:24.037272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.587 [2024-11-16 17:50:24.037286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.587 [2024-11-16 17:50:24.037299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.587 [2024-11-16 17:50:24.037328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.587 qpair failed and we were unable to recover it. 00:30:46.587 [2024-11-16 17:50:24.047213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.587 [2024-11-16 17:50:24.047345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.587 [2024-11-16 17:50:24.047371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.587 [2024-11-16 17:50:24.047385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.587 [2024-11-16 17:50:24.047397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.587 [2024-11-16 17:50:24.047427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.587 qpair failed and we were unable to recover it. 00:30:46.587 [2024-11-16 17:50:24.057274] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.587 [2024-11-16 17:50:24.057361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.587 [2024-11-16 17:50:24.057386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.587 [2024-11-16 17:50:24.057400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.587 [2024-11-16 17:50:24.057413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.587 [2024-11-16 17:50:24.057441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.587 qpair failed and we were unable to recover it. 00:30:46.587 [2024-11-16 17:50:24.067267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.587 [2024-11-16 17:50:24.067397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.587 [2024-11-16 17:50:24.067422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.587 [2024-11-16 17:50:24.067436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.587 [2024-11-16 17:50:24.067450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.587 [2024-11-16 17:50:24.067486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.587 qpair failed and we were unable to recover it. 00:30:46.846 [2024-11-16 17:50:24.077332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.846 [2024-11-16 17:50:24.077422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.846 [2024-11-16 17:50:24.077447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.846 [2024-11-16 17:50:24.077460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.846 [2024-11-16 17:50:24.077473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.846 [2024-11-16 17:50:24.077502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.846 qpair failed and we were unable to recover it. 00:30:46.846 [2024-11-16 17:50:24.087298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.846 [2024-11-16 17:50:24.087394] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.846 [2024-11-16 17:50:24.087419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.846 [2024-11-16 17:50:24.087433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.846 [2024-11-16 17:50:24.087446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.846 [2024-11-16 17:50:24.087475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.846 qpair failed and we were unable to recover it. 00:30:46.846 [2024-11-16 17:50:24.097360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.846 [2024-11-16 17:50:24.097451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.846 [2024-11-16 17:50:24.097476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.846 [2024-11-16 17:50:24.097489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.846 [2024-11-16 17:50:24.097503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.097533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.107355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.107464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.107489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.107503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.107516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.107546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.117409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.117499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.117531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.117545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.117558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.117587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.127411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.127502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.127528] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.127541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.127554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.127583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.137433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.137527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.137553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.137567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.137580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.137609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.147493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.147595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.147627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.147642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.147655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.147697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.157508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.157595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.157626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.157642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.157660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.157692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.167609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.167716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.167741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.167754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.167767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.167797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.177554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.177646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.177672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.177686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.177698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.177728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.187602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.187691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.187718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.187731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.187744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.187785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.197642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.197753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.197778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.197791] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.197803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.197833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.207644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.207736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.207761] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.207774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.207787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.207816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.217684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.217769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.217795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.217809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.217822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.217864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.847 [2024-11-16 17:50:24.227792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.847 [2024-11-16 17:50:24.227907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.847 [2024-11-16 17:50:24.227933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.847 [2024-11-16 17:50:24.227946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.847 [2024-11-16 17:50:24.227960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.847 [2024-11-16 17:50:24.227991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.847 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.237769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.237857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.237882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.237896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.237909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.237937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.247788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.247888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.247913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.247927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.247946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.247977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.257871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.257975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.258000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.258013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.258026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.258056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.267880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.268014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.268039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.268053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.268066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.268096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.277895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.277986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.278010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.278024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.278037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.278066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.287907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.288038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.288063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.288076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.288089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.288118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.297930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.298025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.298051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.298064] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.298077] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.298106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.307934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.308060] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.308086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.308099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.308112] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.308141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.318069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.318188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.318213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.318226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.318239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.318269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:46.848 [2024-11-16 17:50:24.328016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:46.848 [2024-11-16 17:50:24.328103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:46.848 [2024-11-16 17:50:24.328128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:46.848 [2024-11-16 17:50:24.328142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:46.848 [2024-11-16 17:50:24.328155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:46.848 [2024-11-16 17:50:24.328184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:46.848 qpair failed and we were unable to recover it. 00:30:47.107 [2024-11-16 17:50:24.338048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.107 [2024-11-16 17:50:24.338142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.107 [2024-11-16 17:50:24.338168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.107 [2024-11-16 17:50:24.338188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.107 [2024-11-16 17:50:24.338201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.107 [2024-11-16 17:50:24.338230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.107 qpair failed and we were unable to recover it. 00:30:47.107 [2024-11-16 17:50:24.348089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.107 [2024-11-16 17:50:24.348180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.107 [2024-11-16 17:50:24.348205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.107 [2024-11-16 17:50:24.348219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.107 [2024-11-16 17:50:24.348232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.107 [2024-11-16 17:50:24.348261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.107 qpair failed and we were unable to recover it. 00:30:47.107 [2024-11-16 17:50:24.358156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.107 [2024-11-16 17:50:24.358247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.358272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.358285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.358298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.358329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.368129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.368219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.368244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.368258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.368271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.368302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.378132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.378228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.378253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.378268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.378280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.378309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.388171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.388289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.388314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.388328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.388340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.388370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.398206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.398295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.398320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.398334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.398346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.398376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.408234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.408320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.408345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.408359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.408371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.408401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.418268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.418374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.418400] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.418414] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.418427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.418456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.428307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.428437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.428462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.428482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.428496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.428526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.438366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.438456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.438482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.438496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.438509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.438552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.448398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.448488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.448514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.448528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.448541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.448571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.458378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.458463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.458488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.458502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.458515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.458544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.468383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.468468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.468494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.468507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.468520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.468550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.478475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.108 [2024-11-16 17:50:24.478565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.108 [2024-11-16 17:50:24.478590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.108 [2024-11-16 17:50:24.478604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.108 [2024-11-16 17:50:24.478625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.108 [2024-11-16 17:50:24.478658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.108 qpair failed and we were unable to recover it. 00:30:47.108 [2024-11-16 17:50:24.488536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.488630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.488659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.488679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.488691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.488721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.498517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.498642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.498671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.498686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.498699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.498731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.508583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.508670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.508695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.508709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.508721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.508752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.518549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.518641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.518682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.518696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.518709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.518738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.528642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.528744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.528770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.528783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.528796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.528839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.538605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.538737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.538762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.538776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.538788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.538817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.548684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.548804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.548829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.548843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.548856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.548886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.558685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.558778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.558803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.558816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.558829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.558864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.568702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.568793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.568818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.568831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.568843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.568871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.578760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.578843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.578869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.578883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.578896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.578925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.109 [2024-11-16 17:50:24.588750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.109 [2024-11-16 17:50:24.588853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.109 [2024-11-16 17:50:24.588878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.109 [2024-11-16 17:50:24.588892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.109 [2024-11-16 17:50:24.588905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.109 [2024-11-16 17:50:24.588934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.109 qpair failed and we were unable to recover it. 00:30:47.368 [2024-11-16 17:50:24.598800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.368 [2024-11-16 17:50:24.598893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.368 [2024-11-16 17:50:24.598918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.368 [2024-11-16 17:50:24.598931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.368 [2024-11-16 17:50:24.598944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.368 [2024-11-16 17:50:24.598973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.368 qpair failed and we were unable to recover it. 00:30:47.368 [2024-11-16 17:50:24.608864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.368 [2024-11-16 17:50:24.608957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.368 [2024-11-16 17:50:24.608988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.368 [2024-11-16 17:50:24.609002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.368 [2024-11-16 17:50:24.609015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.368 [2024-11-16 17:50:24.609044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.368 qpair failed and we were unable to recover it. 00:30:47.368 [2024-11-16 17:50:24.618854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.368 [2024-11-16 17:50:24.618975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.368 [2024-11-16 17:50:24.619001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.368 [2024-11-16 17:50:24.619015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.368 [2024-11-16 17:50:24.619027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.368 [2024-11-16 17:50:24.619058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.368 qpair failed and we were unable to recover it. 00:30:47.368 [2024-11-16 17:50:24.628856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.368 [2024-11-16 17:50:24.628942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.368 [2024-11-16 17:50:24.628967] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.368 [2024-11-16 17:50:24.628980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.368 [2024-11-16 17:50:24.628993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.368 [2024-11-16 17:50:24.629023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.368 qpair failed and we were unable to recover it. 00:30:47.368 [2024-11-16 17:50:24.638927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.368 [2024-11-16 17:50:24.639017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.368 [2024-11-16 17:50:24.639042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.368 [2024-11-16 17:50:24.639056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.639068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.639099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.648930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.649019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.649044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.649058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.649070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.649106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.658945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.659033] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.659058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.659071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.659084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.659113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.668994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.669076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.669101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.669115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.669128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.669157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.679014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.679100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.679126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.679140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.679153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.679194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.689084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.689168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.689197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.689212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.689225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.689267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.699060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.699151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.699183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.699198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.699210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.699240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.709111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.709200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.709225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.709239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.709252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.709282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.719177] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.719275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.719304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.719319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.719333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.719363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.729143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.729242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.729268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.729282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.729294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.729336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.739315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.739442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.739466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.739479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.739499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.739529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.749210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.749327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.749353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.749367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.749379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.749408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.759366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.369 [2024-11-16 17:50:24.759494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.369 [2024-11-16 17:50:24.759519] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.369 [2024-11-16 17:50:24.759533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.369 [2024-11-16 17:50:24.759545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.369 [2024-11-16 17:50:24.759575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.369 qpair failed and we were unable to recover it. 00:30:47.369 [2024-11-16 17:50:24.769313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.769417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.769442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.769455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.769468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.769497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.779307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.779395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.779421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.779436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.779448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.779478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.789368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.789456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.789482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.789496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.789508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.789551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.799363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.799470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.799496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.799510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.799523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.799551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.809389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.809474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.809500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.809513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.809526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.809567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.819505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.819601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.819636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.819651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.819664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.819694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.829425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.829510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.829536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.829555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.829569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.829599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.839533] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.839644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.839672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.839686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.839701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.839732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.849529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.849624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.849651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.849668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.849681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.849711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.370 [2024-11-16 17:50:24.859554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.370 [2024-11-16 17:50:24.859655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.370 [2024-11-16 17:50:24.859680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.370 [2024-11-16 17:50:24.859695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.370 [2024-11-16 17:50:24.859707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.370 [2024-11-16 17:50:24.859736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.370 qpair failed and we were unable to recover it. 00:30:47.629 [2024-11-16 17:50:24.869570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.629 [2024-11-16 17:50:24.869701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.629 [2024-11-16 17:50:24.869727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.629 [2024-11-16 17:50:24.869740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.629 [2024-11-16 17:50:24.869752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.629 [2024-11-16 17:50:24.869781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.629 qpair failed and we were unable to recover it. 00:30:47.629 [2024-11-16 17:50:24.879631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.629 [2024-11-16 17:50:24.879742] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.629 [2024-11-16 17:50:24.879770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.629 [2024-11-16 17:50:24.879785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.629 [2024-11-16 17:50:24.879798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.629 [2024-11-16 17:50:24.879828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.629 qpair failed and we were unable to recover it. 00:30:47.629 [2024-11-16 17:50:24.889636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.629 [2024-11-16 17:50:24.889769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.629 [2024-11-16 17:50:24.889795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.629 [2024-11-16 17:50:24.889809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.629 [2024-11-16 17:50:24.889822] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.629 [2024-11-16 17:50:24.889850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.629 qpair failed and we were unable to recover it. 00:30:47.629 [2024-11-16 17:50:24.899684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.629 [2024-11-16 17:50:24.899815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.629 [2024-11-16 17:50:24.899840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.629 [2024-11-16 17:50:24.899856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.629 [2024-11-16 17:50:24.899869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.899898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.909758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.909856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.909885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.909900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.909913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.909943] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.919783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.919881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.919908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.919932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.919948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.919979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.929782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.929872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.929898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.929911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.929923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.929953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.939815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.939942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.939968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.939982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.939995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.940026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.949811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.949892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.949917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.949931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.949944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.949974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.959873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.959965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.959991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.960005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.960018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.960048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.969877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.969963] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.969989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.970003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.970016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.970056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.979935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.980050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.980076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.980090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.980102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.980144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.989986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:24.990099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:24.990125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:24.990139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:24.990152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:24.990180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:24.999964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:25.000091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:25.000116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:25.000130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:25.000143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:25.000173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:25.010011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:25.010093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:25.010123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:25.010137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:25.010150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:25.010180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:25.020055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:25.020168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:25.020198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:25.020213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.630 [2024-11-16 17:50:25.020226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.630 [2024-11-16 17:50:25.020268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.630 qpair failed and we were unable to recover it. 00:30:47.630 [2024-11-16 17:50:25.030142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.630 [2024-11-16 17:50:25.030229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.630 [2024-11-16 17:50:25.030255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.630 [2024-11-16 17:50:25.030269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.030282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.030311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.040078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.040171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.040197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.040211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.040223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.040252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.050085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.050171] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.050196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.050210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.050222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.050257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.060152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.060236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.060262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.060275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.060288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.060317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.070191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.070276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.070302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.070316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.070328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.070357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.080225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.080315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.080340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.080354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.080367] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.080396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.090260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.090365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.090393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.090409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.090422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.090453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.100262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.100352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.100383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.100397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.100410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.100439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.110249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.110377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.110403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.110416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.110429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.110458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.631 [2024-11-16 17:50:25.120341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.631 [2024-11-16 17:50:25.120441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.631 [2024-11-16 17:50:25.120467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.631 [2024-11-16 17:50:25.120480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.631 [2024-11-16 17:50:25.120492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.631 [2024-11-16 17:50:25.120521] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.631 qpair failed and we were unable to recover it. 00:30:47.890 [2024-11-16 17:50:25.130347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.890 [2024-11-16 17:50:25.130435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.890 [2024-11-16 17:50:25.130461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.890 [2024-11-16 17:50:25.130474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.890 [2024-11-16 17:50:25.130488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.890 [2024-11-16 17:50:25.130518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.890 qpair failed and we were unable to recover it. 00:30:47.890 [2024-11-16 17:50:25.140432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.890 [2024-11-16 17:50:25.140519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.140544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.140557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.140569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.140605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.150501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.150638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.150663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.150677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.150690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.150720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.160419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.160506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.160531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.160544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.160557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.160586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.170446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.170555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.170580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.170593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.170606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.170646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.180464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.180554] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.180579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.180592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.180605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.180641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.190496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.190587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.190625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.190642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.190655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.190698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.200552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.200672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.200697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.200712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.200723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.200753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.210560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.210655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.210681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.210694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.210707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.210737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.220567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.220668] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.220693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.220707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.220719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.220750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.230609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.230702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.230727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.230741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.230759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.230788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.240676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.240775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.240799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.240814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.240826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.240855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.250715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.250819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.250845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.250859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.250871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.250902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.260743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.260828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.260853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.891 [2024-11-16 17:50:25.260867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.891 [2024-11-16 17:50:25.260880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.891 [2024-11-16 17:50:25.260909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.891 qpair failed and we were unable to recover it. 00:30:47.891 [2024-11-16 17:50:25.270778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.891 [2024-11-16 17:50:25.270894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.891 [2024-11-16 17:50:25.270919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.270932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.270945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.270974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.280815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.280961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.280986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.281000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.281012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.281042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.290882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.290970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.290995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.291008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.291021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.291051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.300879] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.301003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.301028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.301042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.301054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.301083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.310839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.310934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.310959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.310973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.310985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.311015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.320995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.321089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.321115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.321129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.321147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.321177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.330934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.331021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.331046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.331060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.331072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.331101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.340937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.341063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.341089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.341102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.341115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.341144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.351006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.351094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.351119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.351133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.351146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.351175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.361009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.361133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.361158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.361172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.361184] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.361214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.371113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.371216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.371242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.371255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.371268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.371296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:47.892 [2024-11-16 17:50:25.381052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:47.892 [2024-11-16 17:50:25.381138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:47.892 [2024-11-16 17:50:25.381163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:47.892 [2024-11-16 17:50:25.381177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:47.892 [2024-11-16 17:50:25.381189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:47.892 [2024-11-16 17:50:25.381219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:47.892 qpair failed and we were unable to recover it. 00:30:48.151 [2024-11-16 17:50:25.391136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.151 [2024-11-16 17:50:25.391224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.151 [2024-11-16 17:50:25.391249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.151 [2024-11-16 17:50:25.391262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.151 [2024-11-16 17:50:25.391275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.151 [2024-11-16 17:50:25.391305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.151 qpair failed and we were unable to recover it. 00:30:48.151 [2024-11-16 17:50:25.401156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.151 [2024-11-16 17:50:25.401254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.151 [2024-11-16 17:50:25.401280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.151 [2024-11-16 17:50:25.401294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.151 [2024-11-16 17:50:25.401307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.151 [2024-11-16 17:50:25.401337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.151 qpair failed and we were unable to recover it. 00:30:48.151 [2024-11-16 17:50:25.411155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.151 [2024-11-16 17:50:25.411247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.151 [2024-11-16 17:50:25.411273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.151 [2024-11-16 17:50:25.411293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.151 [2024-11-16 17:50:25.411307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.151 [2024-11-16 17:50:25.411337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.151 qpair failed and we were unable to recover it. 00:30:48.151 [2024-11-16 17:50:25.421234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.151 [2024-11-16 17:50:25.421354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.151 [2024-11-16 17:50:25.421379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.151 [2024-11-16 17:50:25.421393] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.151 [2024-11-16 17:50:25.421406] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.151 [2024-11-16 17:50:25.421436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.151 qpair failed and we were unable to recover it. 00:30:48.151 [2024-11-16 17:50:25.431252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.151 [2024-11-16 17:50:25.431373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.151 [2024-11-16 17:50:25.431398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.151 [2024-11-16 17:50:25.431411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.151 [2024-11-16 17:50:25.431426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.151 [2024-11-16 17:50:25.431455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.151 qpair failed and we were unable to recover it. 00:30:48.151 [2024-11-16 17:50:25.441304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.151 [2024-11-16 17:50:25.441393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.151 [2024-11-16 17:50:25.441418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.151 [2024-11-16 17:50:25.441431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.151 [2024-11-16 17:50:25.441444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.151 [2024-11-16 17:50:25.441474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.151 qpair failed and we were unable to recover it. 00:30:48.151 [2024-11-16 17:50:25.451278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.151 [2024-11-16 17:50:25.451363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.151 [2024-11-16 17:50:25.451389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.451403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.451415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.451445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.461323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.461440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.461465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.461480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.461492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.461522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.471322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.471404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.471430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.471443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.471456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.471488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.481399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.481492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.481517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.481530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.481543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.481572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.491401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.491518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.491544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.491557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.491570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.491599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.501467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.501555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.501580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.501604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.501625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.501658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.511467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.511588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.511614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.511639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.511653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.511695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.521480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.521575] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.521607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.521635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.521651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.521682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.531508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.531592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.531628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.531647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.531660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.531705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.541639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.541726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.541752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.541766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.541778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.541809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.551581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.551677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.551705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.551721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.551734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.551765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.561630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.561759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.561785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.561799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.561811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.561841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.571635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.571722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.571748] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.571762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.152 [2024-11-16 17:50:25.571774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.152 [2024-11-16 17:50:25.571803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.152 qpair failed and we were unable to recover it. 00:30:48.152 [2024-11-16 17:50:25.581681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.152 [2024-11-16 17:50:25.581771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.152 [2024-11-16 17:50:25.581797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.152 [2024-11-16 17:50:25.581811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.153 [2024-11-16 17:50:25.581824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.153 [2024-11-16 17:50:25.581854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.153 qpair failed and we were unable to recover it. 00:30:48.153 [2024-11-16 17:50:25.591826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.153 [2024-11-16 17:50:25.591955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.153 [2024-11-16 17:50:25.591985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.153 [2024-11-16 17:50:25.592000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.153 [2024-11-16 17:50:25.592013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.153 [2024-11-16 17:50:25.592042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.153 qpair failed and we were unable to recover it. 00:30:48.153 [2024-11-16 17:50:25.601728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.153 [2024-11-16 17:50:25.601815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.153 [2024-11-16 17:50:25.601840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.153 [2024-11-16 17:50:25.601854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.153 [2024-11-16 17:50:25.601867] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.153 [2024-11-16 17:50:25.601897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.153 qpair failed and we were unable to recover it. 00:30:48.153 [2024-11-16 17:50:25.611842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.153 [2024-11-16 17:50:25.611941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.153 [2024-11-16 17:50:25.611966] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.153 [2024-11-16 17:50:25.611980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.153 [2024-11-16 17:50:25.611992] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.153 [2024-11-16 17:50:25.612022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.153 qpair failed and we were unable to recover it. 00:30:48.153 [2024-11-16 17:50:25.621803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.153 [2024-11-16 17:50:25.621900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.153 [2024-11-16 17:50:25.621925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.153 [2024-11-16 17:50:25.621939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.153 [2024-11-16 17:50:25.621951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.153 [2024-11-16 17:50:25.621980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.153 qpair failed and we were unable to recover it. 00:30:48.153 [2024-11-16 17:50:25.631852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.153 [2024-11-16 17:50:25.631984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.153 [2024-11-16 17:50:25.632009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.153 [2024-11-16 17:50:25.632022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.153 [2024-11-16 17:50:25.632035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.153 [2024-11-16 17:50:25.632071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.153 qpair failed and we were unable to recover it. 00:30:48.153 [2024-11-16 17:50:25.641887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.153 [2024-11-16 17:50:25.641980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.153 [2024-11-16 17:50:25.642005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.153 [2024-11-16 17:50:25.642018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.153 [2024-11-16 17:50:25.642031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.153 [2024-11-16 17:50:25.642059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.153 qpair failed and we were unable to recover it. 00:30:48.412 [2024-11-16 17:50:25.651926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.412 [2024-11-16 17:50:25.652039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.412 [2024-11-16 17:50:25.652064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.412 [2024-11-16 17:50:25.652077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.412 [2024-11-16 17:50:25.652090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.412 [2024-11-16 17:50:25.652118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.412 qpair failed and we were unable to recover it. 00:30:48.412 [2024-11-16 17:50:25.661911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.412 [2024-11-16 17:50:25.662004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.412 [2024-11-16 17:50:25.662030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.412 [2024-11-16 17:50:25.662044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.412 [2024-11-16 17:50:25.662056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.662085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.671922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.672014] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.672039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.672053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.672065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.672094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.682009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.682107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.682138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.682152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.682165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.682194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.692004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.692091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.692116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.692130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.692143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.692171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.702060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.702177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.702203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.702216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.702229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.702258] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.712095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.712186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.712213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.712227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.712240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.712270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.722140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.722232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.722258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.722272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.722290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.722321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.732189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.732280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.732305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.732318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.732331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.732360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.742205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.742302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.742327] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.742340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.742352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.742393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.752155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.752254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.752279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.752292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.752305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.752334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.762201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.762292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.762316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.762330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.762342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.762373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.772240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.772333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.772359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.772373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.772385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.772416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.782333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.782425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.413 [2024-11-16 17:50:25.782454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.413 [2024-11-16 17:50:25.782469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.413 [2024-11-16 17:50:25.782482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.413 [2024-11-16 17:50:25.782513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.413 qpair failed and we were unable to recover it. 00:30:48.413 [2024-11-16 17:50:25.792294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.413 [2024-11-16 17:50:25.792381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.792407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.792421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.792435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.414 [2024-11-16 17:50:25.792476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.802349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.802474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.802500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.802513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.802527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.414 [2024-11-16 17:50:25.802556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.812324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.812423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.812450] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.812464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.812482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.414 [2024-11-16 17:50:25.812512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.822357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.822442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.822469] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.822484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.822497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.414 [2024-11-16 17:50:25.822526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.832396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.832484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.832510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.832524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.832536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.414 [2024-11-16 17:50:25.832566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.842469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.842603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.842637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.842652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.842664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53b4000b90 00:30:48.414 [2024-11-16 17:50:25.842693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.852487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.852576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.852609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.852634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.852647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53ac000b90 00:30:48.414 [2024-11-16 17:50:25.852679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.862495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.862590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.862629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.862647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.862660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xdabf20 00:30:48.414 [2024-11-16 17:50:25.862690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.872506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.872593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.872628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.872646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.872658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0xdabf20 00:30:48.414 [2024-11-16 17:50:25.872688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.882547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.882649] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.882682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.882698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.882711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53ac000b90 00:30:48.414 [2024-11-16 17:50:25.882743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.882846] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:48.414 A controller has encountered a failure and is being reset. 00:30:48.414 [2024-11-16 17:50:25.892572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.892672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.892706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.892722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.892735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53a8000b90 00:30:48.414 [2024-11-16 17:50:25.892766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.414 [2024-11-16 17:50:25.902589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:48.414 [2024-11-16 17:50:25.902688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:48.414 [2024-11-16 17:50:25.902720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:48.414 [2024-11-16 17:50:25.902742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:48.414 [2024-11-16 17:50:25.902755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f53a8000b90 00:30:48.414 [2024-11-16 17:50:25.902785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:48.414 qpair failed and we were unable to recover it. 00:30:48.673 Controller properly reset. 00:30:48.673 Initializing NVMe Controllers 00:30:48.673 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:48.673 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:48.673 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:48.673 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:48.673 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:48.673 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:48.673 Initialization complete. Launching workers. 00:30:48.673 Starting thread on core 1 00:30:48.673 Starting thread on core 2 00:30:48.673 Starting thread on core 3 00:30:48.673 Starting thread on core 0 00:30:48.673 17:50:26 -- host/target_disconnect.sh@59 -- # sync 00:30:48.673 00:30:48.673 real 0m11.611s 00:30:48.673 user 0m21.794s 00:30:48.673 sys 0m5.315s 00:30:48.673 17:50:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:48.673 17:50:26 -- common/autotest_common.sh@10 -- # set +x 00:30:48.673 ************************************ 00:30:48.673 END TEST nvmf_target_disconnect_tc2 00:30:48.673 ************************************ 00:30:48.673 17:50:26 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:48.673 17:50:26 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:48.673 17:50:26 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:48.673 17:50:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:48.673 17:50:26 -- nvmf/common.sh@116 -- # sync 00:30:48.673 17:50:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:48.673 17:50:26 -- nvmf/common.sh@119 -- # set +e 00:30:48.673 17:50:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:48.673 17:50:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:48.673 rmmod nvme_tcp 00:30:48.673 rmmod nvme_fabrics 00:30:48.673 rmmod nvme_keyring 00:30:48.673 17:50:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:48.673 17:50:26 -- nvmf/common.sh@123 -- # set -e 00:30:48.673 17:50:26 -- nvmf/common.sh@124 -- # return 0 00:30:48.673 17:50:26 -- nvmf/common.sh@477 -- # '[' -n 1715740 ']' 00:30:48.673 17:50:26 -- nvmf/common.sh@478 -- # killprocess 1715740 00:30:48.673 17:50:26 -- common/autotest_common.sh@936 -- # '[' -z 1715740 ']' 00:30:48.673 17:50:26 -- common/autotest_common.sh@940 -- # kill -0 1715740 00:30:48.673 17:50:26 -- common/autotest_common.sh@941 -- # uname 00:30:48.673 17:50:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:48.673 17:50:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1715740 00:30:48.931 17:50:26 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:48.931 17:50:26 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:48.931 17:50:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1715740' 00:30:48.931 killing process with pid 1715740 00:30:48.931 17:50:26 -- common/autotest_common.sh@955 -- # kill 1715740 00:30:48.931 17:50:26 -- common/autotest_common.sh@960 -- # wait 1715740 00:30:49.189 17:50:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:49.190 17:50:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:49.190 17:50:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:49.190 17:50:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:49.190 17:50:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:49.190 17:50:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:49.190 17:50:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:49.190 17:50:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:51.094 17:50:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:51.094 00:30:51.094 real 0m16.356s 00:30:51.094 user 0m48.597s 00:30:51.094 sys 0m7.255s 00:30:51.094 17:50:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:51.094 17:50:28 -- common/autotest_common.sh@10 -- # set +x 00:30:51.094 ************************************ 00:30:51.094 END TEST nvmf_target_disconnect 00:30:51.094 ************************************ 00:30:51.094 17:50:28 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:51.094 17:50:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:51.094 17:50:28 -- common/autotest_common.sh@10 -- # set +x 00:30:51.094 17:50:28 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:51.094 00:30:51.094 real 22m59.477s 00:30:51.094 user 66m30.205s 00:30:51.094 sys 5m36.887s 00:30:51.094 17:50:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:51.094 17:50:28 -- common/autotest_common.sh@10 -- # set +x 00:30:51.094 ************************************ 00:30:51.094 END TEST nvmf_tcp 00:30:51.094 ************************************ 00:30:51.094 17:50:28 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:51.094 17:50:28 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:51.094 17:50:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:51.094 17:50:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:51.094 17:50:28 -- common/autotest_common.sh@10 -- # set +x 00:30:51.094 ************************************ 00:30:51.094 START TEST spdkcli_nvmf_tcp 00:30:51.095 ************************************ 00:30:51.095 17:50:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:51.353 * Looking for test storage... 00:30:51.353 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:51.353 17:50:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:51.353 17:50:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:51.353 17:50:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:51.353 17:50:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:51.353 17:50:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:51.353 17:50:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:51.353 17:50:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:51.353 17:50:28 -- scripts/common.sh@335 -- # IFS=.-: 00:30:51.353 17:50:28 -- scripts/common.sh@335 -- # read -ra ver1 00:30:51.353 17:50:28 -- scripts/common.sh@336 -- # IFS=.-: 00:30:51.353 17:50:28 -- scripts/common.sh@336 -- # read -ra ver2 00:30:51.353 17:50:28 -- scripts/common.sh@337 -- # local 'op=<' 00:30:51.353 17:50:28 -- scripts/common.sh@339 -- # ver1_l=2 00:30:51.353 17:50:28 -- scripts/common.sh@340 -- # ver2_l=1 00:30:51.353 17:50:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:51.353 17:50:28 -- scripts/common.sh@343 -- # case "$op" in 00:30:51.353 17:50:28 -- scripts/common.sh@344 -- # : 1 00:30:51.353 17:50:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:51.353 17:50:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:51.353 17:50:28 -- scripts/common.sh@364 -- # decimal 1 00:30:51.353 17:50:28 -- scripts/common.sh@352 -- # local d=1 00:30:51.353 17:50:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:51.353 17:50:28 -- scripts/common.sh@354 -- # echo 1 00:30:51.353 17:50:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:51.353 17:50:28 -- scripts/common.sh@365 -- # decimal 2 00:30:51.353 17:50:28 -- scripts/common.sh@352 -- # local d=2 00:30:51.353 17:50:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:51.353 17:50:28 -- scripts/common.sh@354 -- # echo 2 00:30:51.353 17:50:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:51.353 17:50:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:51.353 17:50:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:51.353 17:50:28 -- scripts/common.sh@367 -- # return 0 00:30:51.353 17:50:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:51.354 17:50:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:51.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:51.354 --rc genhtml_branch_coverage=1 00:30:51.354 --rc genhtml_function_coverage=1 00:30:51.354 --rc genhtml_legend=1 00:30:51.354 --rc geninfo_all_blocks=1 00:30:51.354 --rc geninfo_unexecuted_blocks=1 00:30:51.354 00:30:51.354 ' 00:30:51.354 17:50:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:51.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:51.354 --rc genhtml_branch_coverage=1 00:30:51.354 --rc genhtml_function_coverage=1 00:30:51.354 --rc genhtml_legend=1 00:30:51.354 --rc geninfo_all_blocks=1 00:30:51.354 --rc geninfo_unexecuted_blocks=1 00:30:51.354 00:30:51.354 ' 00:30:51.354 17:50:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:51.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:51.354 --rc genhtml_branch_coverage=1 00:30:51.354 --rc genhtml_function_coverage=1 00:30:51.354 --rc genhtml_legend=1 00:30:51.354 --rc geninfo_all_blocks=1 00:30:51.354 --rc geninfo_unexecuted_blocks=1 00:30:51.354 00:30:51.354 ' 00:30:51.354 17:50:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:51.354 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:51.354 --rc genhtml_branch_coverage=1 00:30:51.354 --rc genhtml_function_coverage=1 00:30:51.354 --rc genhtml_legend=1 00:30:51.354 --rc geninfo_all_blocks=1 00:30:51.354 --rc geninfo_unexecuted_blocks=1 00:30:51.354 00:30:51.354 ' 00:30:51.354 17:50:28 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:51.354 17:50:28 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:51.354 17:50:28 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:51.354 17:50:28 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:51.354 17:50:28 -- nvmf/common.sh@7 -- # uname -s 00:30:51.354 17:50:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:51.354 17:50:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:51.354 17:50:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:51.354 17:50:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:51.354 17:50:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:51.354 17:50:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:51.354 17:50:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:51.354 17:50:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:51.354 17:50:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:51.354 17:50:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:51.354 17:50:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:51.354 17:50:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:51.354 17:50:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:51.354 17:50:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:51.354 17:50:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:51.354 17:50:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:51.354 17:50:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:51.354 17:50:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:51.354 17:50:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:51.354 17:50:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:51.354 17:50:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:51.354 17:50:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:51.354 17:50:28 -- paths/export.sh@5 -- # export PATH 00:30:51.354 17:50:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:51.354 17:50:28 -- nvmf/common.sh@46 -- # : 0 00:30:51.354 17:50:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:51.354 17:50:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:51.354 17:50:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:51.354 17:50:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:51.354 17:50:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:51.354 17:50:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:51.354 17:50:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:51.354 17:50:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:51.354 17:50:28 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:51.354 17:50:28 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:51.354 17:50:28 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:51.354 17:50:28 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:51.354 17:50:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:51.354 17:50:28 -- common/autotest_common.sh@10 -- # set +x 00:30:51.354 17:50:28 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:51.354 17:50:28 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1716970 00:30:51.354 17:50:28 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:51.354 17:50:28 -- spdkcli/common.sh@34 -- # waitforlisten 1716970 00:30:51.354 17:50:28 -- common/autotest_common.sh@829 -- # '[' -z 1716970 ']' 00:30:51.354 17:50:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:51.354 17:50:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:51.354 17:50:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:51.354 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:51.354 17:50:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:51.354 17:50:28 -- common/autotest_common.sh@10 -- # set +x 00:30:51.354 [2024-11-16 17:50:28.733973] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:51.354 [2024-11-16 17:50:28.734060] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1716970 ] 00:30:51.354 EAL: No free 2048 kB hugepages reported on node 1 00:30:51.354 [2024-11-16 17:50:28.792086] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:51.612 [2024-11-16 17:50:28.881967] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:51.612 [2024-11-16 17:50:28.884639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:51.612 [2024-11-16 17:50:28.884653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:52.545 17:50:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:52.545 17:50:29 -- common/autotest_common.sh@862 -- # return 0 00:30:52.545 17:50:29 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:52.545 17:50:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:52.545 17:50:29 -- common/autotest_common.sh@10 -- # set +x 00:30:52.545 17:50:29 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:52.545 17:50:29 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:52.545 17:50:29 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:52.545 17:50:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:52.545 17:50:29 -- common/autotest_common.sh@10 -- # set +x 00:30:52.545 17:50:29 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:52.545 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:52.545 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:52.545 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:52.545 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:52.545 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:52.545 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:52.545 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:52.545 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:52.545 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:52.545 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:52.545 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:52.545 ' 00:30:52.803 [2024-11-16 17:50:30.115688] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:55.334 [2024-11-16 17:50:32.280377] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:56.268 [2024-11-16 17:50:33.520883] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:58.795 [2024-11-16 17:50:35.824089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:31:00.692 [2024-11-16 17:50:37.822750] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:31:02.063 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:31:02.063 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:31:02.064 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:31:02.064 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:31:02.064 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:31:02.064 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:31:02.064 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:31:02.064 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:02.064 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:02.064 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:31:02.064 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:31:02.064 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:31:02.064 17:50:39 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:31:02.064 17:50:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:02.064 17:50:39 -- common/autotest_common.sh@10 -- # set +x 00:31:02.064 17:50:39 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:31:02.064 17:50:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:02.064 17:50:39 -- common/autotest_common.sh@10 -- # set +x 00:31:02.064 17:50:39 -- spdkcli/nvmf.sh@69 -- # check_match 00:31:02.064 17:50:39 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:31:02.629 17:50:39 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:31:02.629 17:50:39 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:31:02.629 17:50:39 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:31:02.629 17:50:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:02.629 17:50:39 -- common/autotest_common.sh@10 -- # set +x 00:31:02.629 17:50:39 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:31:02.629 17:50:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:02.629 17:50:39 -- common/autotest_common.sh@10 -- # set +x 00:31:02.629 17:50:39 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:31:02.629 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:31:02.629 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:02.629 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:31:02.629 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:31:02.629 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:31:02.629 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:31:02.629 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:31:02.629 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:31:02.629 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:31:02.629 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:31:02.629 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:31:02.629 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:31:02.629 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:31:02.629 ' 00:31:07.893 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:07.893 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:07.893 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:07.893 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:07.893 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:07.893 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:07.893 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:07.893 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:07.893 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:07.893 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:07.893 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:07.893 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:07.893 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:07.893 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:07.893 17:50:45 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:07.893 17:50:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:07.893 17:50:45 -- common/autotest_common.sh@10 -- # set +x 00:31:07.893 17:50:45 -- spdkcli/nvmf.sh@90 -- # killprocess 1716970 00:31:07.893 17:50:45 -- common/autotest_common.sh@936 -- # '[' -z 1716970 ']' 00:31:07.893 17:50:45 -- common/autotest_common.sh@940 -- # kill -0 1716970 00:31:07.893 17:50:45 -- common/autotest_common.sh@941 -- # uname 00:31:07.893 17:50:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:07.893 17:50:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1716970 00:31:07.893 17:50:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:07.893 17:50:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:07.893 17:50:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1716970' 00:31:07.893 killing process with pid 1716970 00:31:07.893 17:50:45 -- common/autotest_common.sh@955 -- # kill 1716970 00:31:07.893 [2024-11-16 17:50:45.302726] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:07.893 17:50:45 -- common/autotest_common.sh@960 -- # wait 1716970 00:31:08.151 17:50:45 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:08.151 17:50:45 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:08.151 17:50:45 -- spdkcli/common.sh@13 -- # '[' -n 1716970 ']' 00:31:08.151 17:50:45 -- spdkcli/common.sh@14 -- # killprocess 1716970 00:31:08.151 17:50:45 -- common/autotest_common.sh@936 -- # '[' -z 1716970 ']' 00:31:08.151 17:50:45 -- common/autotest_common.sh@940 -- # kill -0 1716970 00:31:08.151 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1716970) - No such process 00:31:08.151 17:50:45 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1716970 is not found' 00:31:08.151 Process with pid 1716970 is not found 00:31:08.151 17:50:45 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:08.151 17:50:45 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:08.151 17:50:45 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:08.151 00:31:08.151 real 0m16.976s 00:31:08.151 user 0m36.219s 00:31:08.151 sys 0m0.805s 00:31:08.151 17:50:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:08.151 17:50:45 -- common/autotest_common.sh@10 -- # set +x 00:31:08.151 ************************************ 00:31:08.151 END TEST spdkcli_nvmf_tcp 00:31:08.151 ************************************ 00:31:08.151 17:50:45 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:08.151 17:50:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:08.151 17:50:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:08.151 17:50:45 -- common/autotest_common.sh@10 -- # set +x 00:31:08.151 ************************************ 00:31:08.151 START TEST nvmf_identify_passthru 00:31:08.151 ************************************ 00:31:08.151 17:50:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:08.152 * Looking for test storage... 00:31:08.152 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:08.152 17:50:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:08.152 17:50:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:08.152 17:50:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:08.411 17:50:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:08.411 17:50:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:08.411 17:50:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:08.411 17:50:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:08.411 17:50:45 -- scripts/common.sh@335 -- # IFS=.-: 00:31:08.411 17:50:45 -- scripts/common.sh@335 -- # read -ra ver1 00:31:08.411 17:50:45 -- scripts/common.sh@336 -- # IFS=.-: 00:31:08.411 17:50:45 -- scripts/common.sh@336 -- # read -ra ver2 00:31:08.411 17:50:45 -- scripts/common.sh@337 -- # local 'op=<' 00:31:08.411 17:50:45 -- scripts/common.sh@339 -- # ver1_l=2 00:31:08.411 17:50:45 -- scripts/common.sh@340 -- # ver2_l=1 00:31:08.411 17:50:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:08.411 17:50:45 -- scripts/common.sh@343 -- # case "$op" in 00:31:08.411 17:50:45 -- scripts/common.sh@344 -- # : 1 00:31:08.411 17:50:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:08.411 17:50:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:08.411 17:50:45 -- scripts/common.sh@364 -- # decimal 1 00:31:08.411 17:50:45 -- scripts/common.sh@352 -- # local d=1 00:31:08.411 17:50:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:08.411 17:50:45 -- scripts/common.sh@354 -- # echo 1 00:31:08.411 17:50:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:08.411 17:50:45 -- scripts/common.sh@365 -- # decimal 2 00:31:08.411 17:50:45 -- scripts/common.sh@352 -- # local d=2 00:31:08.411 17:50:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:08.411 17:50:45 -- scripts/common.sh@354 -- # echo 2 00:31:08.411 17:50:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:08.411 17:50:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:08.411 17:50:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:08.411 17:50:45 -- scripts/common.sh@367 -- # return 0 00:31:08.411 17:50:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:08.411 17:50:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:08.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.411 --rc genhtml_branch_coverage=1 00:31:08.411 --rc genhtml_function_coverage=1 00:31:08.411 --rc genhtml_legend=1 00:31:08.411 --rc geninfo_all_blocks=1 00:31:08.411 --rc geninfo_unexecuted_blocks=1 00:31:08.411 00:31:08.411 ' 00:31:08.411 17:50:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:08.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.411 --rc genhtml_branch_coverage=1 00:31:08.411 --rc genhtml_function_coverage=1 00:31:08.411 --rc genhtml_legend=1 00:31:08.411 --rc geninfo_all_blocks=1 00:31:08.411 --rc geninfo_unexecuted_blocks=1 00:31:08.411 00:31:08.411 ' 00:31:08.411 17:50:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:08.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.411 --rc genhtml_branch_coverage=1 00:31:08.411 --rc genhtml_function_coverage=1 00:31:08.411 --rc genhtml_legend=1 00:31:08.411 --rc geninfo_all_blocks=1 00:31:08.411 --rc geninfo_unexecuted_blocks=1 00:31:08.411 00:31:08.411 ' 00:31:08.411 17:50:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:08.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:08.411 --rc genhtml_branch_coverage=1 00:31:08.411 --rc genhtml_function_coverage=1 00:31:08.411 --rc genhtml_legend=1 00:31:08.411 --rc geninfo_all_blocks=1 00:31:08.411 --rc geninfo_unexecuted_blocks=1 00:31:08.411 00:31:08.411 ' 00:31:08.411 17:50:45 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:08.411 17:50:45 -- nvmf/common.sh@7 -- # uname -s 00:31:08.411 17:50:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:08.411 17:50:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:08.411 17:50:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:08.411 17:50:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:08.411 17:50:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:08.411 17:50:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:08.411 17:50:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:08.411 17:50:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:08.411 17:50:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:08.411 17:50:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:08.411 17:50:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:08.411 17:50:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:08.411 17:50:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:08.411 17:50:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:08.411 17:50:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:08.411 17:50:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:08.411 17:50:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:08.411 17:50:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:08.411 17:50:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:08.411 17:50:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.411 17:50:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.411 17:50:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.411 17:50:45 -- paths/export.sh@5 -- # export PATH 00:31:08.411 17:50:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.411 17:50:45 -- nvmf/common.sh@46 -- # : 0 00:31:08.411 17:50:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:08.411 17:50:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:08.411 17:50:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:08.411 17:50:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:08.411 17:50:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:08.411 17:50:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:08.411 17:50:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:08.411 17:50:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:08.411 17:50:45 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:08.411 17:50:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:08.411 17:50:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:08.411 17:50:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:08.411 17:50:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.412 17:50:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.412 17:50:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.412 17:50:45 -- paths/export.sh@5 -- # export PATH 00:31:08.412 17:50:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:08.412 17:50:45 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:08.412 17:50:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:08.412 17:50:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:08.412 17:50:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:08.412 17:50:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:08.412 17:50:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:08.412 17:50:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:08.412 17:50:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:08.412 17:50:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:08.412 17:50:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:08.412 17:50:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:08.412 17:50:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:08.412 17:50:45 -- common/autotest_common.sh@10 -- # set +x 00:31:10.317 17:50:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:10.317 17:50:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:10.317 17:50:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:10.317 17:50:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:10.317 17:50:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:10.317 17:50:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:10.317 17:50:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:10.317 17:50:47 -- nvmf/common.sh@294 -- # net_devs=() 00:31:10.317 17:50:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:10.317 17:50:47 -- nvmf/common.sh@295 -- # e810=() 00:31:10.317 17:50:47 -- nvmf/common.sh@295 -- # local -ga e810 00:31:10.317 17:50:47 -- nvmf/common.sh@296 -- # x722=() 00:31:10.317 17:50:47 -- nvmf/common.sh@296 -- # local -ga x722 00:31:10.317 17:50:47 -- nvmf/common.sh@297 -- # mlx=() 00:31:10.317 17:50:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:10.317 17:50:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:10.317 17:50:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:10.317 17:50:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:10.317 17:50:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:10.317 17:50:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:10.317 17:50:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:10.317 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:10.317 17:50:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:10.317 17:50:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:10.317 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:10.317 17:50:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:10.317 17:50:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:10.317 17:50:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:10.317 17:50:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:10.317 17:50:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:10.317 17:50:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:10.317 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:10.317 17:50:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:10.317 17:50:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:10.317 17:50:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:10.317 17:50:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:10.317 17:50:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:10.317 17:50:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:10.317 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:10.317 17:50:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:10.317 17:50:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:10.317 17:50:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:10.317 17:50:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:10.317 17:50:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:10.317 17:50:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:10.317 17:50:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:10.317 17:50:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:10.317 17:50:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:10.317 17:50:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:10.317 17:50:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:10.317 17:50:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:10.317 17:50:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:10.317 17:50:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:10.317 17:50:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:10.317 17:50:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:10.317 17:50:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:10.317 17:50:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:10.317 17:50:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:10.317 17:50:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:10.317 17:50:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:10.317 17:50:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:10.317 17:50:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:10.317 17:50:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:10.317 17:50:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:10.576 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:10.576 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:31:10.576 00:31:10.576 --- 10.0.0.2 ping statistics --- 00:31:10.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:10.576 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:31:10.576 17:50:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:10.576 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:10.576 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:31:10.576 00:31:10.576 --- 10.0.0.1 ping statistics --- 00:31:10.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:10.576 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:31:10.576 17:50:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:10.576 17:50:47 -- nvmf/common.sh@410 -- # return 0 00:31:10.576 17:50:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:10.576 17:50:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:10.576 17:50:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:10.576 17:50:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:10.576 17:50:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:10.576 17:50:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:10.576 17:50:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:10.576 17:50:47 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:10.576 17:50:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:10.576 17:50:47 -- common/autotest_common.sh@10 -- # set +x 00:31:10.576 17:50:47 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:10.576 17:50:47 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:10.576 17:50:47 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:10.576 17:50:47 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:10.576 17:50:47 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:10.576 17:50:47 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:10.576 17:50:47 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:10.576 17:50:47 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:10.576 17:50:47 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:10.576 17:50:47 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:10.576 17:50:47 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:10.576 17:50:47 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:10.576 17:50:47 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:10.576 17:50:47 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:10.576 17:50:47 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:10.576 17:50:47 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:10.576 17:50:47 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:10.576 17:50:47 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:10.576 EAL: No free 2048 kB hugepages reported on node 1 00:31:14.774 17:50:52 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:14.774 17:50:52 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:14.774 17:50:52 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:14.774 17:50:52 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:14.774 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.045 17:50:56 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:19.045 17:50:56 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:19.045 17:50:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:19.045 17:50:56 -- common/autotest_common.sh@10 -- # set +x 00:31:19.045 17:50:56 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:19.045 17:50:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:19.045 17:50:56 -- common/autotest_common.sh@10 -- # set +x 00:31:19.045 17:50:56 -- target/identify_passthru.sh@31 -- # nvmfpid=1721707 00:31:19.045 17:50:56 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:19.045 17:50:56 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:19.045 17:50:56 -- target/identify_passthru.sh@35 -- # waitforlisten 1721707 00:31:19.045 17:50:56 -- common/autotest_common.sh@829 -- # '[' -z 1721707 ']' 00:31:19.045 17:50:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:19.045 17:50:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:19.045 17:50:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:19.045 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:19.045 17:50:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:19.045 17:50:56 -- common/autotest_common.sh@10 -- # set +x 00:31:19.045 [2024-11-16 17:50:56.342932] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:19.045 [2024-11-16 17:50:56.343041] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:19.045 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.045 [2024-11-16 17:50:56.408940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:19.045 [2024-11-16 17:50:56.498614] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:19.045 [2024-11-16 17:50:56.498764] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:19.045 [2024-11-16 17:50:56.498781] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:19.045 [2024-11-16 17:50:56.498794] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:19.045 [2024-11-16 17:50:56.498857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:19.045 [2024-11-16 17:50:56.498912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:19.045 [2024-11-16 17:50:56.498975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:19.045 [2024-11-16 17:50:56.498978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:19.305 17:50:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:19.305 17:50:56 -- common/autotest_common.sh@862 -- # return 0 00:31:19.305 17:50:56 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:19.305 17:50:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.305 17:50:56 -- common/autotest_common.sh@10 -- # set +x 00:31:19.305 INFO: Log level set to 20 00:31:19.305 INFO: Requests: 00:31:19.305 { 00:31:19.305 "jsonrpc": "2.0", 00:31:19.305 "method": "nvmf_set_config", 00:31:19.305 "id": 1, 00:31:19.305 "params": { 00:31:19.305 "admin_cmd_passthru": { 00:31:19.305 "identify_ctrlr": true 00:31:19.305 } 00:31:19.305 } 00:31:19.305 } 00:31:19.305 00:31:19.305 INFO: response: 00:31:19.305 { 00:31:19.305 "jsonrpc": "2.0", 00:31:19.305 "id": 1, 00:31:19.305 "result": true 00:31:19.305 } 00:31:19.305 00:31:19.305 17:50:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.305 17:50:56 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:19.305 17:50:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.305 17:50:56 -- common/autotest_common.sh@10 -- # set +x 00:31:19.305 INFO: Setting log level to 20 00:31:19.305 INFO: Setting log level to 20 00:31:19.305 INFO: Log level set to 20 00:31:19.305 INFO: Log level set to 20 00:31:19.305 INFO: Requests: 00:31:19.305 { 00:31:19.305 "jsonrpc": "2.0", 00:31:19.305 "method": "framework_start_init", 00:31:19.305 "id": 1 00:31:19.305 } 00:31:19.305 00:31:19.305 INFO: Requests: 00:31:19.305 { 00:31:19.305 "jsonrpc": "2.0", 00:31:19.305 "method": "framework_start_init", 00:31:19.305 "id": 1 00:31:19.305 } 00:31:19.305 00:31:19.305 [2024-11-16 17:50:56.691896] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:19.305 INFO: response: 00:31:19.305 { 00:31:19.305 "jsonrpc": "2.0", 00:31:19.305 "id": 1, 00:31:19.305 "result": true 00:31:19.305 } 00:31:19.305 00:31:19.305 INFO: response: 00:31:19.305 { 00:31:19.306 "jsonrpc": "2.0", 00:31:19.306 "id": 1, 00:31:19.306 "result": true 00:31:19.306 } 00:31:19.306 00:31:19.306 17:50:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.306 17:50:56 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:19.306 17:50:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.306 17:50:56 -- common/autotest_common.sh@10 -- # set +x 00:31:19.306 INFO: Setting log level to 40 00:31:19.306 INFO: Setting log level to 40 00:31:19.306 INFO: Setting log level to 40 00:31:19.306 [2024-11-16 17:50:56.701981] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:19.306 17:50:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.306 17:50:56 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:19.306 17:50:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:19.306 17:50:56 -- common/autotest_common.sh@10 -- # set +x 00:31:19.306 17:50:56 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:19.306 17:50:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.306 17:50:56 -- common/autotest_common.sh@10 -- # set +x 00:31:22.592 Nvme0n1 00:31:22.592 17:50:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.592 17:50:59 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:22.592 17:50:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.592 17:50:59 -- common/autotest_common.sh@10 -- # set +x 00:31:22.592 17:50:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.592 17:50:59 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:22.592 17:50:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.592 17:50:59 -- common/autotest_common.sh@10 -- # set +x 00:31:22.592 17:50:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.592 17:50:59 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:22.592 17:50:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.592 17:50:59 -- common/autotest_common.sh@10 -- # set +x 00:31:22.592 [2024-11-16 17:50:59.601737] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:22.592 17:50:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.592 17:50:59 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:22.592 17:50:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.592 17:50:59 -- common/autotest_common.sh@10 -- # set +x 00:31:22.592 [2024-11-16 17:50:59.609456] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:22.592 [ 00:31:22.592 { 00:31:22.592 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:22.592 "subtype": "Discovery", 00:31:22.592 "listen_addresses": [], 00:31:22.592 "allow_any_host": true, 00:31:22.592 "hosts": [] 00:31:22.592 }, 00:31:22.592 { 00:31:22.592 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:22.592 "subtype": "NVMe", 00:31:22.592 "listen_addresses": [ 00:31:22.592 { 00:31:22.592 "transport": "TCP", 00:31:22.592 "trtype": "TCP", 00:31:22.592 "adrfam": "IPv4", 00:31:22.592 "traddr": "10.0.0.2", 00:31:22.592 "trsvcid": "4420" 00:31:22.592 } 00:31:22.592 ], 00:31:22.592 "allow_any_host": true, 00:31:22.592 "hosts": [], 00:31:22.592 "serial_number": "SPDK00000000000001", 00:31:22.592 "model_number": "SPDK bdev Controller", 00:31:22.592 "max_namespaces": 1, 00:31:22.592 "min_cntlid": 1, 00:31:22.592 "max_cntlid": 65519, 00:31:22.592 "namespaces": [ 00:31:22.592 { 00:31:22.592 "nsid": 1, 00:31:22.592 "bdev_name": "Nvme0n1", 00:31:22.592 "name": "Nvme0n1", 00:31:22.592 "nguid": "648F189223B4416C8D0245CF71A3DC54", 00:31:22.592 "uuid": "648f1892-23b4-416c-8d02-45cf71a3dc54" 00:31:22.592 } 00:31:22.592 ] 00:31:22.592 } 00:31:22.592 ] 00:31:22.593 17:50:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.593 17:50:59 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:22.593 17:50:59 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:22.593 17:50:59 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:22.593 EAL: No free 2048 kB hugepages reported on node 1 00:31:22.593 17:50:59 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:22.593 17:50:59 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:22.593 17:50:59 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:22.593 17:50:59 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:22.593 EAL: No free 2048 kB hugepages reported on node 1 00:31:22.851 17:51:00 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:22.851 17:51:00 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:22.851 17:51:00 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:22.851 17:51:00 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:22.851 17:51:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:22.851 17:51:00 -- common/autotest_common.sh@10 -- # set +x 00:31:22.851 17:51:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:22.851 17:51:00 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:22.851 17:51:00 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:22.851 17:51:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:22.851 17:51:00 -- nvmf/common.sh@116 -- # sync 00:31:22.851 17:51:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:22.851 17:51:00 -- nvmf/common.sh@119 -- # set +e 00:31:22.851 17:51:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:22.851 17:51:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:22.851 rmmod nvme_tcp 00:31:22.851 rmmod nvme_fabrics 00:31:22.851 rmmod nvme_keyring 00:31:22.851 17:51:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:22.851 17:51:00 -- nvmf/common.sh@123 -- # set -e 00:31:22.851 17:51:00 -- nvmf/common.sh@124 -- # return 0 00:31:22.851 17:51:00 -- nvmf/common.sh@477 -- # '[' -n 1721707 ']' 00:31:22.851 17:51:00 -- nvmf/common.sh@478 -- # killprocess 1721707 00:31:22.851 17:51:00 -- common/autotest_common.sh@936 -- # '[' -z 1721707 ']' 00:31:22.851 17:51:00 -- common/autotest_common.sh@940 -- # kill -0 1721707 00:31:22.851 17:51:00 -- common/autotest_common.sh@941 -- # uname 00:31:22.851 17:51:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:22.851 17:51:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1721707 00:31:22.851 17:51:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:22.851 17:51:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:22.851 17:51:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1721707' 00:31:22.851 killing process with pid 1721707 00:31:22.851 17:51:00 -- common/autotest_common.sh@955 -- # kill 1721707 00:31:22.851 [2024-11-16 17:51:00.211194] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:22.851 17:51:00 -- common/autotest_common.sh@960 -- # wait 1721707 00:31:24.755 17:51:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:24.755 17:51:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:24.755 17:51:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:24.755 17:51:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:24.755 17:51:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:24.755 17:51:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:24.755 17:51:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:24.755 17:51:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:26.661 17:51:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:26.661 00:31:26.661 real 0m18.299s 00:31:26.661 user 0m27.618s 00:31:26.661 sys 0m2.362s 00:31:26.661 17:51:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:26.661 17:51:03 -- common/autotest_common.sh@10 -- # set +x 00:31:26.661 ************************************ 00:31:26.661 END TEST nvmf_identify_passthru 00:31:26.661 ************************************ 00:31:26.661 17:51:03 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:26.661 17:51:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:26.661 17:51:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:26.661 17:51:03 -- common/autotest_common.sh@10 -- # set +x 00:31:26.661 ************************************ 00:31:26.661 START TEST nvmf_dif 00:31:26.661 ************************************ 00:31:26.661 17:51:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:26.661 * Looking for test storage... 00:31:26.661 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:26.661 17:51:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:26.662 17:51:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:26.662 17:51:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:26.662 17:51:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:26.662 17:51:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:26.662 17:51:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:26.662 17:51:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:26.662 17:51:04 -- scripts/common.sh@335 -- # IFS=.-: 00:31:26.662 17:51:04 -- scripts/common.sh@335 -- # read -ra ver1 00:31:26.662 17:51:04 -- scripts/common.sh@336 -- # IFS=.-: 00:31:26.662 17:51:04 -- scripts/common.sh@336 -- # read -ra ver2 00:31:26.662 17:51:04 -- scripts/common.sh@337 -- # local 'op=<' 00:31:26.662 17:51:04 -- scripts/common.sh@339 -- # ver1_l=2 00:31:26.662 17:51:04 -- scripts/common.sh@340 -- # ver2_l=1 00:31:26.662 17:51:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:26.662 17:51:04 -- scripts/common.sh@343 -- # case "$op" in 00:31:26.662 17:51:04 -- scripts/common.sh@344 -- # : 1 00:31:26.662 17:51:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:26.662 17:51:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:26.662 17:51:04 -- scripts/common.sh@364 -- # decimal 1 00:31:26.662 17:51:04 -- scripts/common.sh@352 -- # local d=1 00:31:26.662 17:51:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:26.662 17:51:04 -- scripts/common.sh@354 -- # echo 1 00:31:26.662 17:51:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:26.662 17:51:04 -- scripts/common.sh@365 -- # decimal 2 00:31:26.662 17:51:04 -- scripts/common.sh@352 -- # local d=2 00:31:26.662 17:51:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:26.662 17:51:04 -- scripts/common.sh@354 -- # echo 2 00:31:26.662 17:51:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:26.662 17:51:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:26.662 17:51:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:26.662 17:51:04 -- scripts/common.sh@367 -- # return 0 00:31:26.662 17:51:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:26.662 17:51:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:26.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.662 --rc genhtml_branch_coverage=1 00:31:26.662 --rc genhtml_function_coverage=1 00:31:26.662 --rc genhtml_legend=1 00:31:26.662 --rc geninfo_all_blocks=1 00:31:26.662 --rc geninfo_unexecuted_blocks=1 00:31:26.662 00:31:26.662 ' 00:31:26.662 17:51:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:26.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.662 --rc genhtml_branch_coverage=1 00:31:26.662 --rc genhtml_function_coverage=1 00:31:26.662 --rc genhtml_legend=1 00:31:26.662 --rc geninfo_all_blocks=1 00:31:26.662 --rc geninfo_unexecuted_blocks=1 00:31:26.662 00:31:26.662 ' 00:31:26.662 17:51:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:26.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.662 --rc genhtml_branch_coverage=1 00:31:26.662 --rc genhtml_function_coverage=1 00:31:26.662 --rc genhtml_legend=1 00:31:26.662 --rc geninfo_all_blocks=1 00:31:26.662 --rc geninfo_unexecuted_blocks=1 00:31:26.662 00:31:26.662 ' 00:31:26.662 17:51:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:26.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:26.662 --rc genhtml_branch_coverage=1 00:31:26.662 --rc genhtml_function_coverage=1 00:31:26.662 --rc genhtml_legend=1 00:31:26.662 --rc geninfo_all_blocks=1 00:31:26.662 --rc geninfo_unexecuted_blocks=1 00:31:26.662 00:31:26.662 ' 00:31:26.662 17:51:04 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:26.662 17:51:04 -- nvmf/common.sh@7 -- # uname -s 00:31:26.662 17:51:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:26.662 17:51:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:26.662 17:51:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:26.662 17:51:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:26.662 17:51:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:26.662 17:51:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:26.662 17:51:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:26.662 17:51:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:26.662 17:51:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:26.662 17:51:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:26.662 17:51:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:26.662 17:51:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:26.662 17:51:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:26.662 17:51:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:26.662 17:51:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:26.662 17:51:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:26.662 17:51:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:26.662 17:51:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:26.662 17:51:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:26.662 17:51:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.662 17:51:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.662 17:51:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.662 17:51:04 -- paths/export.sh@5 -- # export PATH 00:31:26.662 17:51:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:26.662 17:51:04 -- nvmf/common.sh@46 -- # : 0 00:31:26.662 17:51:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:26.662 17:51:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:26.662 17:51:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:26.662 17:51:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:26.662 17:51:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:26.662 17:51:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:26.662 17:51:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:26.662 17:51:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:26.662 17:51:04 -- target/dif.sh@15 -- # NULL_META=16 00:31:26.662 17:51:04 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:26.662 17:51:04 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:26.662 17:51:04 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:26.662 17:51:04 -- target/dif.sh@135 -- # nvmftestinit 00:31:26.662 17:51:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:26.662 17:51:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:26.662 17:51:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:26.662 17:51:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:26.663 17:51:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:26.663 17:51:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:26.663 17:51:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:26.663 17:51:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:26.663 17:51:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:26.663 17:51:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:26.663 17:51:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:26.663 17:51:04 -- common/autotest_common.sh@10 -- # set +x 00:31:28.572 17:51:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:28.572 17:51:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:28.572 17:51:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:28.572 17:51:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:28.572 17:51:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:28.572 17:51:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:28.572 17:51:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:28.572 17:51:06 -- nvmf/common.sh@294 -- # net_devs=() 00:31:28.572 17:51:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:28.572 17:51:06 -- nvmf/common.sh@295 -- # e810=() 00:31:28.572 17:51:06 -- nvmf/common.sh@295 -- # local -ga e810 00:31:28.572 17:51:06 -- nvmf/common.sh@296 -- # x722=() 00:31:28.572 17:51:06 -- nvmf/common.sh@296 -- # local -ga x722 00:31:28.572 17:51:06 -- nvmf/common.sh@297 -- # mlx=() 00:31:28.572 17:51:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:28.572 17:51:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:28.572 17:51:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:28.572 17:51:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:28.572 17:51:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:28.572 17:51:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:28.572 17:51:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:28.572 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:28.572 17:51:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:28.572 17:51:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:28.572 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:28.572 17:51:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:28.572 17:51:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:28.572 17:51:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:28.572 17:51:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:28.572 17:51:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:28.572 17:51:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:28.572 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:28.572 17:51:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:28.572 17:51:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:28.572 17:51:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:28.572 17:51:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:28.572 17:51:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:28.572 17:51:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:28.572 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:28.572 17:51:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:28.572 17:51:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:28.572 17:51:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:28.572 17:51:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:28.572 17:51:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:28.833 17:51:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:28.833 17:51:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:28.833 17:51:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:28.833 17:51:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:28.833 17:51:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:28.833 17:51:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:28.833 17:51:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:28.833 17:51:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:28.833 17:51:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:28.833 17:51:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:28.833 17:51:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:28.833 17:51:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:28.833 17:51:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:28.833 17:51:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:28.833 17:51:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:28.833 17:51:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:28.833 17:51:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:28.833 17:51:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:28.833 17:51:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:28.833 17:51:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:28.833 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:28.833 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:31:28.833 00:31:28.833 --- 10.0.0.2 ping statistics --- 00:31:28.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:28.833 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:31:28.833 17:51:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:28.833 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:28.833 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:31:28.833 00:31:28.833 --- 10.0.0.1 ping statistics --- 00:31:28.833 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:28.833 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:31:28.833 17:51:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:28.833 17:51:06 -- nvmf/common.sh@410 -- # return 0 00:31:28.833 17:51:06 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:28.833 17:51:06 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:30.211 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:30.211 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:30.211 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:30.211 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:30.211 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:30.211 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:30.211 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:30.211 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:30.211 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:30.211 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:30.211 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:30.211 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:30.211 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:30.211 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:30.211 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:30.211 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:30.211 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:30.211 17:51:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:30.211 17:51:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:30.211 17:51:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:30.211 17:51:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:30.211 17:51:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:30.211 17:51:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:30.211 17:51:07 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:30.211 17:51:07 -- target/dif.sh@137 -- # nvmfappstart 00:31:30.211 17:51:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:30.211 17:51:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:30.211 17:51:07 -- common/autotest_common.sh@10 -- # set +x 00:31:30.211 17:51:07 -- nvmf/common.sh@469 -- # nvmfpid=1725389 00:31:30.211 17:51:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:30.211 17:51:07 -- nvmf/common.sh@470 -- # waitforlisten 1725389 00:31:30.211 17:51:07 -- common/autotest_common.sh@829 -- # '[' -z 1725389 ']' 00:31:30.211 17:51:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:30.211 17:51:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:30.211 17:51:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:30.211 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:30.211 17:51:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:30.211 17:51:07 -- common/autotest_common.sh@10 -- # set +x 00:31:30.211 [2024-11-16 17:51:07.555415] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:30.211 [2024-11-16 17:51:07.555483] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:30.211 EAL: No free 2048 kB hugepages reported on node 1 00:31:30.211 [2024-11-16 17:51:07.623211] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:30.469 [2024-11-16 17:51:07.711725] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:30.469 [2024-11-16 17:51:07.711896] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:30.469 [2024-11-16 17:51:07.711928] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:30.469 [2024-11-16 17:51:07.711943] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:30.469 [2024-11-16 17:51:07.711982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:31.403 17:51:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:31.403 17:51:08 -- common/autotest_common.sh@862 -- # return 0 00:31:31.403 17:51:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:31.403 17:51:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:31.403 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:31:31.403 17:51:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:31.403 17:51:08 -- target/dif.sh@139 -- # create_transport 00:31:31.403 17:51:08 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:31.404 17:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.404 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:31:31.404 [2024-11-16 17:51:08.553079] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:31.404 17:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.404 17:51:08 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:31.404 17:51:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:31.404 17:51:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:31.404 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:31:31.404 ************************************ 00:31:31.404 START TEST fio_dif_1_default 00:31:31.404 ************************************ 00:31:31.404 17:51:08 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:31.404 17:51:08 -- target/dif.sh@86 -- # create_subsystems 0 00:31:31.404 17:51:08 -- target/dif.sh@28 -- # local sub 00:31:31.404 17:51:08 -- target/dif.sh@30 -- # for sub in "$@" 00:31:31.404 17:51:08 -- target/dif.sh@31 -- # create_subsystem 0 00:31:31.404 17:51:08 -- target/dif.sh@18 -- # local sub_id=0 00:31:31.404 17:51:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:31.404 17:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.404 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:31:31.404 bdev_null0 00:31:31.404 17:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.404 17:51:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:31.404 17:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.404 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:31:31.404 17:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.404 17:51:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:31.404 17:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.404 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:31:31.404 17:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.404 17:51:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:31.404 17:51:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.404 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:31:31.404 [2024-11-16 17:51:08.589350] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:31.404 17:51:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.404 17:51:08 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:31.404 17:51:08 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:31.404 17:51:08 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:31.404 17:51:08 -- nvmf/common.sh@520 -- # config=() 00:31:31.404 17:51:08 -- nvmf/common.sh@520 -- # local subsystem config 00:31:31.404 17:51:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:31.404 17:51:08 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.404 17:51:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:31.404 { 00:31:31.404 "params": { 00:31:31.404 "name": "Nvme$subsystem", 00:31:31.404 "trtype": "$TEST_TRANSPORT", 00:31:31.404 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:31.404 "adrfam": "ipv4", 00:31:31.404 "trsvcid": "$NVMF_PORT", 00:31:31.404 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:31.404 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:31.404 "hdgst": ${hdgst:-false}, 00:31:31.404 "ddgst": ${ddgst:-false} 00:31:31.404 }, 00:31:31.404 "method": "bdev_nvme_attach_controller" 00:31:31.404 } 00:31:31.404 EOF 00:31:31.404 )") 00:31:31.404 17:51:08 -- target/dif.sh@82 -- # gen_fio_conf 00:31:31.404 17:51:08 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.404 17:51:08 -- target/dif.sh@54 -- # local file 00:31:31.404 17:51:08 -- target/dif.sh@56 -- # cat 00:31:31.404 17:51:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:31.404 17:51:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:31.404 17:51:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:31.404 17:51:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.404 17:51:08 -- common/autotest_common.sh@1330 -- # shift 00:31:31.404 17:51:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:31.404 17:51:08 -- nvmf/common.sh@542 -- # cat 00:31:31.404 17:51:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:31.404 17:51:08 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:31.404 17:51:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.404 17:51:08 -- target/dif.sh@72 -- # (( file <= files )) 00:31:31.404 17:51:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:31.404 17:51:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:31.404 17:51:08 -- nvmf/common.sh@544 -- # jq . 00:31:31.404 17:51:08 -- nvmf/common.sh@545 -- # IFS=, 00:31:31.404 17:51:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:31.404 "params": { 00:31:31.404 "name": "Nvme0", 00:31:31.404 "trtype": "tcp", 00:31:31.404 "traddr": "10.0.0.2", 00:31:31.404 "adrfam": "ipv4", 00:31:31.404 "trsvcid": "4420", 00:31:31.404 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:31.404 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:31.404 "hdgst": false, 00:31:31.404 "ddgst": false 00:31:31.404 }, 00:31:31.404 "method": "bdev_nvme_attach_controller" 00:31:31.404 }' 00:31:31.404 17:51:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:31.404 17:51:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:31.404 17:51:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:31.404 17:51:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.404 17:51:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:31.404 17:51:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:31.404 17:51:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:31.404 17:51:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:31.404 17:51:08 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:31.404 17:51:08 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.404 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:31.404 fio-3.35 00:31:31.404 Starting 1 thread 00:31:31.404 EAL: No free 2048 kB hugepages reported on node 1 00:31:31.972 [2024-11-16 17:51:09.379704] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:31.972 [2024-11-16 17:51:09.379779] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:44.181 00:31:44.181 filename0: (groupid=0, jobs=1): err= 0: pid=1726017: Sat Nov 16 17:51:19 2024 00:31:44.181 read: IOPS=99, BW=396KiB/s (406kB/s)(3968KiB/10015msec) 00:31:44.181 slat (nsec): min=5309, max=76536, avg=8600.34, stdev=3301.79 00:31:44.181 clat (usec): min=686, max=47589, avg=40354.59, stdev=5091.76 00:31:44.181 lat (usec): min=693, max=47616, avg=40363.19, stdev=5091.19 00:31:44.181 clat percentiles (usec): 00:31:44.181 | 1.00th=[ 750], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:44.181 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:44.181 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:44.181 | 99.00th=[41157], 99.50th=[41157], 99.90th=[47449], 99.95th=[47449], 00:31:44.181 | 99.99th=[47449] 00:31:44.181 bw ( KiB/s): min= 384, max= 448, per=99.70%, avg=395.20, stdev=18.79, samples=20 00:31:44.181 iops : min= 96, max= 112, avg=98.80, stdev= 4.70, samples=20 00:31:44.181 lat (usec) : 750=0.71%, 1000=0.91% 00:31:44.181 lat (msec) : 50=98.39% 00:31:44.181 cpu : usr=91.78%, sys=7.94%, ctx=27, majf=0, minf=240 00:31:44.181 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:44.181 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.181 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:44.181 issued rwts: total=992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:44.181 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:44.181 00:31:44.181 Run status group 0 (all jobs): 00:31:44.181 READ: bw=396KiB/s (406kB/s), 396KiB/s-396KiB/s (406kB/s-406kB/s), io=3968KiB (4063kB), run=10015-10015msec 00:31:44.181 17:51:19 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:44.181 17:51:19 -- target/dif.sh@43 -- # local sub 00:31:44.181 17:51:19 -- target/dif.sh@45 -- # for sub in "$@" 00:31:44.181 17:51:19 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:44.181 17:51:19 -- target/dif.sh@36 -- # local sub_id=0 00:31:44.181 17:51:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 00:31:44.181 real 0m11.192s 00:31:44.181 user 0m10.379s 00:31:44.181 sys 0m1.056s 00:31:44.181 17:51:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 ************************************ 00:31:44.181 END TEST fio_dif_1_default 00:31:44.181 ************************************ 00:31:44.181 17:51:19 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:44.181 17:51:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:44.181 17:51:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 ************************************ 00:31:44.181 START TEST fio_dif_1_multi_subsystems 00:31:44.181 ************************************ 00:31:44.181 17:51:19 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:44.181 17:51:19 -- target/dif.sh@92 -- # local files=1 00:31:44.181 17:51:19 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:44.181 17:51:19 -- target/dif.sh@28 -- # local sub 00:31:44.181 17:51:19 -- target/dif.sh@30 -- # for sub in "$@" 00:31:44.181 17:51:19 -- target/dif.sh@31 -- # create_subsystem 0 00:31:44.181 17:51:19 -- target/dif.sh@18 -- # local sub_id=0 00:31:44.181 17:51:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 bdev_null0 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 [2024-11-16 17:51:19.808788] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@30 -- # for sub in "$@" 00:31:44.181 17:51:19 -- target/dif.sh@31 -- # create_subsystem 1 00:31:44.181 17:51:19 -- target/dif.sh@18 -- # local sub_id=1 00:31:44.181 17:51:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 bdev_null1 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:44.181 17:51:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.181 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:31:44.181 17:51:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.181 17:51:19 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:44.181 17:51:19 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:44.181 17:51:19 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:44.181 17:51:19 -- nvmf/common.sh@520 -- # config=() 00:31:44.181 17:51:19 -- nvmf/common.sh@520 -- # local subsystem config 00:31:44.181 17:51:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:44.181 17:51:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:44.181 { 00:31:44.181 "params": { 00:31:44.181 "name": "Nvme$subsystem", 00:31:44.181 "trtype": "$TEST_TRANSPORT", 00:31:44.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:44.182 "adrfam": "ipv4", 00:31:44.182 "trsvcid": "$NVMF_PORT", 00:31:44.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:44.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:44.182 "hdgst": ${hdgst:-false}, 00:31:44.182 "ddgst": ${ddgst:-false} 00:31:44.182 }, 00:31:44.182 "method": "bdev_nvme_attach_controller" 00:31:44.182 } 00:31:44.182 EOF 00:31:44.182 )") 00:31:44.182 17:51:19 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.182 17:51:19 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.182 17:51:19 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:44.182 17:51:19 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:44.182 17:51:19 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:44.182 17:51:19 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.182 17:51:19 -- target/dif.sh@82 -- # gen_fio_conf 00:31:44.182 17:51:19 -- common/autotest_common.sh@1330 -- # shift 00:31:44.182 17:51:19 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:44.182 17:51:19 -- target/dif.sh@54 -- # local file 00:31:44.182 17:51:19 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.182 17:51:19 -- target/dif.sh@56 -- # cat 00:31:44.182 17:51:19 -- nvmf/common.sh@542 -- # cat 00:31:44.182 17:51:19 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.182 17:51:19 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:44.182 17:51:19 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.182 17:51:19 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:44.182 17:51:19 -- target/dif.sh@72 -- # (( file <= files )) 00:31:44.182 17:51:19 -- target/dif.sh@73 -- # cat 00:31:44.182 17:51:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:44.182 17:51:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:44.182 { 00:31:44.182 "params": { 00:31:44.182 "name": "Nvme$subsystem", 00:31:44.182 "trtype": "$TEST_TRANSPORT", 00:31:44.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:44.182 "adrfam": "ipv4", 00:31:44.182 "trsvcid": "$NVMF_PORT", 00:31:44.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:44.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:44.182 "hdgst": ${hdgst:-false}, 00:31:44.182 "ddgst": ${ddgst:-false} 00:31:44.182 }, 00:31:44.182 "method": "bdev_nvme_attach_controller" 00:31:44.182 } 00:31:44.182 EOF 00:31:44.182 )") 00:31:44.182 17:51:19 -- nvmf/common.sh@542 -- # cat 00:31:44.182 17:51:19 -- target/dif.sh@72 -- # (( file++ )) 00:31:44.182 17:51:19 -- target/dif.sh@72 -- # (( file <= files )) 00:31:44.182 17:51:19 -- nvmf/common.sh@544 -- # jq . 00:31:44.182 17:51:19 -- nvmf/common.sh@545 -- # IFS=, 00:31:44.182 17:51:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:44.182 "params": { 00:31:44.182 "name": "Nvme0", 00:31:44.182 "trtype": "tcp", 00:31:44.182 "traddr": "10.0.0.2", 00:31:44.182 "adrfam": "ipv4", 00:31:44.182 "trsvcid": "4420", 00:31:44.182 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:44.182 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:44.182 "hdgst": false, 00:31:44.182 "ddgst": false 00:31:44.182 }, 00:31:44.182 "method": "bdev_nvme_attach_controller" 00:31:44.182 },{ 00:31:44.182 "params": { 00:31:44.182 "name": "Nvme1", 00:31:44.182 "trtype": "tcp", 00:31:44.182 "traddr": "10.0.0.2", 00:31:44.182 "adrfam": "ipv4", 00:31:44.182 "trsvcid": "4420", 00:31:44.182 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:44.182 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:44.182 "hdgst": false, 00:31:44.182 "ddgst": false 00:31:44.182 }, 00:31:44.182 "method": "bdev_nvme_attach_controller" 00:31:44.182 }' 00:31:44.182 17:51:19 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.182 17:51:19 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.182 17:51:19 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.182 17:51:19 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.182 17:51:19 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:44.182 17:51:19 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.182 17:51:19 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.182 17:51:19 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.182 17:51:19 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:44.182 17:51:19 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.182 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:44.182 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:44.182 fio-3.35 00:31:44.182 Starting 2 threads 00:31:44.182 EAL: No free 2048 kB hugepages reported on node 1 00:31:44.182 [2024-11-16 17:51:20.792705] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:44.182 [2024-11-16 17:51:20.792790] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:54.157 00:31:54.157 filename0: (groupid=0, jobs=1): err= 0: pid=1727465: Sat Nov 16 17:51:30 2024 00:31:54.157 read: IOPS=189, BW=757KiB/s (776kB/s)(7600KiB/10035msec) 00:31:54.157 slat (nsec): min=7457, max=25619, avg=9501.52, stdev=2412.32 00:31:54.157 clat (usec): min=561, max=44197, avg=21095.23, stdev=20284.42 00:31:54.157 lat (usec): min=569, max=44210, avg=21104.73, stdev=20284.33 00:31:54.157 clat percentiles (usec): 00:31:54.157 | 1.00th=[ 594], 5.00th=[ 668], 10.00th=[ 685], 20.00th=[ 717], 00:31:54.157 | 30.00th=[ 734], 40.00th=[ 750], 50.00th=[40633], 60.00th=[41157], 00:31:54.157 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:31:54.157 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:31:54.157 | 99.99th=[44303] 00:31:54.157 bw ( KiB/s): min= 704, max= 768, per=50.52%, avg=758.40, stdev=23.45, samples=20 00:31:54.157 iops : min= 176, max= 192, avg=189.60, stdev= 5.86, samples=20 00:31:54.157 lat (usec) : 750=40.37%, 1000=4.47% 00:31:54.157 lat (msec) : 2=5.05%, 50=50.11% 00:31:54.157 cpu : usr=94.75%, sys=4.93%, ctx=28, majf=0, minf=130 00:31:54.157 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.157 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.157 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.157 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.157 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:54.157 filename1: (groupid=0, jobs=1): err= 0: pid=1727466: Sat Nov 16 17:51:30 2024 00:31:54.157 read: IOPS=185, BW=743KiB/s (761kB/s)(7456KiB/10029msec) 00:31:54.157 slat (nsec): min=7517, max=50813, avg=9390.35, stdev=2482.73 00:31:54.157 clat (usec): min=559, max=44116, avg=21490.35, stdev=20399.16 00:31:54.157 lat (usec): min=567, max=44131, avg=21499.74, stdev=20399.00 00:31:54.157 clat percentiles (usec): 00:31:54.157 | 1.00th=[ 570], 5.00th=[ 594], 10.00th=[ 603], 20.00th=[ 611], 00:31:54.157 | 30.00th=[ 627], 40.00th=[ 742], 50.00th=[41157], 60.00th=[41157], 00:31:54.157 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:31:54.157 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:31:54.157 | 99.99th=[44303] 00:31:54.157 bw ( KiB/s): min= 640, max= 768, per=49.59%, avg=744.00, stdev=40.04, samples=20 00:31:54.157 iops : min= 160, max= 192, avg=186.00, stdev=10.01, samples=20 00:31:54.157 lat (usec) : 750=42.44%, 1000=6.49% 00:31:54.157 lat (msec) : 50=51.07% 00:31:54.157 cpu : usr=95.10%, sys=4.61%, ctx=13, majf=0, minf=189 00:31:54.157 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.157 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.157 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.157 issued rwts: total=1864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.157 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:54.157 00:31:54.157 Run status group 0 (all jobs): 00:31:54.157 READ: bw=1500KiB/s (1536kB/s), 743KiB/s-757KiB/s (761kB/s-776kB/s), io=14.7MiB (15.4MB), run=10029-10035msec 00:31:54.157 17:51:31 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:54.157 17:51:31 -- target/dif.sh@43 -- # local sub 00:31:54.157 17:51:31 -- target/dif.sh@45 -- # for sub in "$@" 00:31:54.157 17:51:31 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:54.157 17:51:31 -- target/dif.sh@36 -- # local sub_id=0 00:31:54.157 17:51:31 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:54.157 17:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:54.157 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.157 17:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:54.157 17:51:31 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:54.157 17:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:54.157 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.157 17:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:54.157 17:51:31 -- target/dif.sh@45 -- # for sub in "$@" 00:31:54.157 17:51:31 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:54.157 17:51:31 -- target/dif.sh@36 -- # local sub_id=1 00:31:54.157 17:51:31 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:54.157 17:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:54.157 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.157 17:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:54.157 17:51:31 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:54.157 17:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:54.157 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.157 17:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:54.157 00:31:54.157 real 0m11.475s 00:31:54.157 user 0m20.608s 00:31:54.157 sys 0m1.254s 00:31:54.157 17:51:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:54.157 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.157 ************************************ 00:31:54.157 END TEST fio_dif_1_multi_subsystems 00:31:54.157 ************************************ 00:31:54.158 17:51:31 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:54.158 17:51:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:54.158 17:51:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:54.158 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.158 ************************************ 00:31:54.158 START TEST fio_dif_rand_params 00:31:54.158 ************************************ 00:31:54.158 17:51:31 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:54.158 17:51:31 -- target/dif.sh@100 -- # local NULL_DIF 00:31:54.158 17:51:31 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:54.158 17:51:31 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:54.158 17:51:31 -- target/dif.sh@103 -- # bs=128k 00:31:54.158 17:51:31 -- target/dif.sh@103 -- # numjobs=3 00:31:54.158 17:51:31 -- target/dif.sh@103 -- # iodepth=3 00:31:54.158 17:51:31 -- target/dif.sh@103 -- # runtime=5 00:31:54.158 17:51:31 -- target/dif.sh@105 -- # create_subsystems 0 00:31:54.158 17:51:31 -- target/dif.sh@28 -- # local sub 00:31:54.158 17:51:31 -- target/dif.sh@30 -- # for sub in "$@" 00:31:54.158 17:51:31 -- target/dif.sh@31 -- # create_subsystem 0 00:31:54.158 17:51:31 -- target/dif.sh@18 -- # local sub_id=0 00:31:54.158 17:51:31 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:54.158 17:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:54.158 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.158 bdev_null0 00:31:54.158 17:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:54.158 17:51:31 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:54.158 17:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:54.158 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.158 17:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:54.158 17:51:31 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:54.158 17:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:54.158 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.158 17:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:54.158 17:51:31 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:54.158 17:51:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:54.158 17:51:31 -- common/autotest_common.sh@10 -- # set +x 00:31:54.158 [2024-11-16 17:51:31.314247] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:54.158 17:51:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:54.158 17:51:31 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:54.158 17:51:31 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:54.158 17:51:31 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:54.158 17:51:31 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:54.158 17:51:31 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:54.158 17:51:31 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:54.158 17:51:31 -- target/dif.sh@82 -- # gen_fio_conf 00:31:54.158 17:51:31 -- nvmf/common.sh@520 -- # config=() 00:31:54.158 17:51:31 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:54.158 17:51:31 -- nvmf/common.sh@520 -- # local subsystem config 00:31:54.158 17:51:31 -- target/dif.sh@54 -- # local file 00:31:54.158 17:51:31 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:54.158 17:51:31 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:54.158 17:51:31 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:54.158 17:51:31 -- target/dif.sh@56 -- # cat 00:31:54.158 17:51:31 -- common/autotest_common.sh@1330 -- # shift 00:31:54.158 17:51:31 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:54.158 { 00:31:54.158 "params": { 00:31:54.158 "name": "Nvme$subsystem", 00:31:54.158 "trtype": "$TEST_TRANSPORT", 00:31:54.158 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:54.158 "adrfam": "ipv4", 00:31:54.158 "trsvcid": "$NVMF_PORT", 00:31:54.158 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:54.158 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:54.158 "hdgst": ${hdgst:-false}, 00:31:54.158 "ddgst": ${ddgst:-false} 00:31:54.158 }, 00:31:54.158 "method": "bdev_nvme_attach_controller" 00:31:54.158 } 00:31:54.158 EOF 00:31:54.158 )") 00:31:54.158 17:51:31 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:54.158 17:51:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:54.158 17:51:31 -- nvmf/common.sh@542 -- # cat 00:31:54.158 17:51:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:54.158 17:51:31 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:54.158 17:51:31 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:54.158 17:51:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:54.158 17:51:31 -- target/dif.sh@72 -- # (( file <= files )) 00:31:54.158 17:51:31 -- nvmf/common.sh@544 -- # jq . 00:31:54.158 17:51:31 -- nvmf/common.sh@545 -- # IFS=, 00:31:54.158 17:51:31 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:54.158 "params": { 00:31:54.158 "name": "Nvme0", 00:31:54.158 "trtype": "tcp", 00:31:54.158 "traddr": "10.0.0.2", 00:31:54.158 "adrfam": "ipv4", 00:31:54.158 "trsvcid": "4420", 00:31:54.158 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:54.158 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:54.158 "hdgst": false, 00:31:54.158 "ddgst": false 00:31:54.158 }, 00:31:54.158 "method": "bdev_nvme_attach_controller" 00:31:54.158 }' 00:31:54.158 17:51:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:54.158 17:51:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:54.158 17:51:31 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:54.158 17:51:31 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:54.158 17:51:31 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:54.158 17:51:31 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:54.158 17:51:31 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:54.158 17:51:31 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:54.158 17:51:31 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:54.158 17:51:31 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:54.158 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:54.158 ... 00:31:54.158 fio-3.35 00:31:54.158 Starting 3 threads 00:31:54.158 EAL: No free 2048 kB hugepages reported on node 1 00:31:54.724 [2024-11-16 17:51:31.988328] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:54.725 [2024-11-16 17:51:31.988401] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:59.999 00:31:59.999 filename0: (groupid=0, jobs=1): err= 0: pid=1728902: Sat Nov 16 17:51:37 2024 00:31:59.999 read: IOPS=240, BW=30.1MiB/s (31.5MB/s)(151MiB/5029msec) 00:31:59.999 slat (nsec): min=4258, max=86355, avg=15095.37, stdev=5092.28 00:31:59.999 clat (usec): min=4325, max=57142, avg=12447.07, stdev=6068.55 00:31:59.999 lat (usec): min=4333, max=57155, avg=12462.16, stdev=6068.61 00:31:59.999 clat percentiles (usec): 00:31:59.999 | 1.00th=[ 4555], 5.00th=[ 5538], 10.00th=[ 8029], 20.00th=[ 9372], 00:31:59.999 | 30.00th=[10814], 40.00th=[11600], 50.00th=[12256], 60.00th=[12780], 00:31:59.999 | 70.00th=[13435], 80.00th=[14091], 90.00th=[14746], 95.00th=[15664], 00:31:59.999 | 99.00th=[51119], 99.50th=[52167], 99.90th=[52691], 99.95th=[56886], 00:31:59.999 | 99.99th=[56886] 00:31:59.999 bw ( KiB/s): min=21248, max=39680, per=34.43%, avg=30899.20, stdev=4584.31, samples=10 00:31:59.999 iops : min= 166, max= 310, avg=241.40, stdev=35.81, samples=10 00:31:59.999 lat (msec) : 10=23.39%, 20=74.63%, 50=0.66%, 100=1.32% 00:31:59.999 cpu : usr=89.78%, sys=8.17%, ctx=292, majf=0, minf=156 00:31:59.999 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:59.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.999 issued rwts: total=1210,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:59.999 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:59.999 filename0: (groupid=0, jobs=1): err= 0: pid=1728903: Sat Nov 16 17:51:37 2024 00:31:59.999 read: IOPS=229, BW=28.6MiB/s (30.0MB/s)(144MiB/5019msec) 00:31:59.999 slat (nsec): min=4394, max=40251, avg=15474.61, stdev=4575.64 00:31:59.999 clat (usec): min=4453, max=94559, avg=13070.64, stdev=9386.88 00:31:59.999 lat (usec): min=4465, max=94573, avg=13086.11, stdev=9386.70 00:31:59.999 clat percentiles (usec): 00:31:59.999 | 1.00th=[ 5407], 5.00th=[ 7701], 10.00th=[ 9241], 20.00th=[10159], 00:31:59.999 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11207], 60.00th=[11600], 00:31:59.999 | 70.00th=[11863], 80.00th=[12387], 90.00th=[13566], 95.00th=[18220], 00:31:59.999 | 99.00th=[53216], 99.50th=[53740], 99.90th=[93848], 99.95th=[94897], 00:31:59.999 | 99.99th=[94897] 00:31:59.999 bw ( KiB/s): min=22272, max=39168, per=32.72%, avg=29363.20, stdev=4683.32, samples=10 00:31:59.999 iops : min= 174, max= 306, avg=229.40, stdev=36.59, samples=10 00:31:59.999 lat (msec) : 10=17.22%, 20=78.00%, 50=0.52%, 100=4.26% 00:31:59.999 cpu : usr=84.87%, sys=9.59%, ctx=246, majf=0, minf=93 00:31:59.999 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:59.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:59.999 issued rwts: total=1150,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:59.999 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:59.999 filename0: (groupid=0, jobs=1): err= 0: pid=1728904: Sat Nov 16 17:51:37 2024 00:31:59.999 read: IOPS=232, BW=29.1MiB/s (30.5MB/s)(146MiB/5008msec) 00:32:00.000 slat (nsec): min=4642, max=52185, avg=15519.82, stdev=3003.77 00:32:00.000 clat (usec): min=4798, max=91596, avg=12861.82, stdev=5852.24 00:32:00.000 lat (usec): min=4812, max=91610, avg=12877.34, stdev=5852.24 00:32:00.000 clat percentiles (usec): 00:32:00.000 | 1.00th=[ 5866], 5.00th=[ 7701], 10.00th=[ 8455], 20.00th=[10159], 00:32:00.000 | 30.00th=[11338], 40.00th=[11994], 50.00th=[12649], 60.00th=[13173], 00:32:00.000 | 70.00th=[13698], 80.00th=[14222], 90.00th=[15270], 95.00th=[15926], 00:32:00.000 | 99.00th=[49546], 99.50th=[50594], 99.90th=[53216], 99.95th=[91751], 00:32:00.000 | 99.99th=[91751] 00:32:00.000 bw ( KiB/s): min=25088, max=33280, per=33.18%, avg=29777.80, stdev=2915.57, samples=10 00:32:00.000 iops : min= 196, max= 260, avg=232.60, stdev=22.84, samples=10 00:32:00.000 lat (msec) : 10=19.38%, 20=78.64%, 50=1.29%, 100=0.69% 00:32:00.000 cpu : usr=91.75%, sys=6.55%, ctx=83, majf=0, minf=41 00:32:00.000 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:00.000 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.000 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:00.000 issued rwts: total=1166,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:00.000 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:00.000 00:32:00.000 Run status group 0 (all jobs): 00:32:00.000 READ: bw=87.6MiB/s (91.9MB/s), 28.6MiB/s-30.1MiB/s (30.0MB/s-31.5MB/s), io=441MiB (462MB), run=5008-5029msec 00:32:00.000 17:51:37 -- target/dif.sh@107 -- # destroy_subsystems 0 00:32:00.000 17:51:37 -- target/dif.sh@43 -- # local sub 00:32:00.000 17:51:37 -- target/dif.sh@45 -- # for sub in "$@" 00:32:00.000 17:51:37 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:00.000 17:51:37 -- target/dif.sh@36 -- # local sub_id=0 00:32:00.000 17:51:37 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@109 -- # NULL_DIF=2 00:32:00.000 17:51:37 -- target/dif.sh@109 -- # bs=4k 00:32:00.000 17:51:37 -- target/dif.sh@109 -- # numjobs=8 00:32:00.000 17:51:37 -- target/dif.sh@109 -- # iodepth=16 00:32:00.000 17:51:37 -- target/dif.sh@109 -- # runtime= 00:32:00.000 17:51:37 -- target/dif.sh@109 -- # files=2 00:32:00.000 17:51:37 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:32:00.000 17:51:37 -- target/dif.sh@28 -- # local sub 00:32:00.000 17:51:37 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.000 17:51:37 -- target/dif.sh@31 -- # create_subsystem 0 00:32:00.000 17:51:37 -- target/dif.sh@18 -- # local sub_id=0 00:32:00.000 17:51:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 bdev_null0 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 [2024-11-16 17:51:37.449922] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.000 17:51:37 -- target/dif.sh@31 -- # create_subsystem 1 00:32:00.000 17:51:37 -- target/dif.sh@18 -- # local sub_id=1 00:32:00.000 17:51:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 bdev_null1 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.000 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.000 17:51:37 -- target/dif.sh@30 -- # for sub in "$@" 00:32:00.000 17:51:37 -- target/dif.sh@31 -- # create_subsystem 2 00:32:00.000 17:51:37 -- target/dif.sh@18 -- # local sub_id=2 00:32:00.000 17:51:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:32:00.000 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.000 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.259 bdev_null2 00:32:00.259 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.259 17:51:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:32:00.259 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.259 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.259 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.259 17:51:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:32:00.259 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.259 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.259 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.259 17:51:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:32:00.259 17:51:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:00.259 17:51:37 -- common/autotest_common.sh@10 -- # set +x 00:32:00.259 17:51:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:00.259 17:51:37 -- target/dif.sh@112 -- # fio /dev/fd/62 00:32:00.259 17:51:37 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:32:00.259 17:51:37 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:32:00.259 17:51:37 -- nvmf/common.sh@520 -- # config=() 00:32:00.259 17:51:37 -- nvmf/common.sh@520 -- # local subsystem config 00:32:00.259 17:51:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.259 17:51:37 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.259 17:51:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.259 { 00:32:00.259 "params": { 00:32:00.259 "name": "Nvme$subsystem", 00:32:00.259 "trtype": "$TEST_TRANSPORT", 00:32:00.259 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.259 "adrfam": "ipv4", 00:32:00.259 "trsvcid": "$NVMF_PORT", 00:32:00.259 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.259 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.259 "hdgst": ${hdgst:-false}, 00:32:00.259 "ddgst": ${ddgst:-false} 00:32:00.259 }, 00:32:00.259 "method": "bdev_nvme_attach_controller" 00:32:00.259 } 00:32:00.259 EOF 00:32:00.259 )") 00:32:00.259 17:51:37 -- target/dif.sh@82 -- # gen_fio_conf 00:32:00.259 17:51:37 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.259 17:51:37 -- target/dif.sh@54 -- # local file 00:32:00.259 17:51:37 -- target/dif.sh@56 -- # cat 00:32:00.259 17:51:37 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:00.259 17:51:37 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:00.259 17:51:37 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:00.259 17:51:37 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.259 17:51:37 -- common/autotest_common.sh@1330 -- # shift 00:32:00.259 17:51:37 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:00.259 17:51:37 -- nvmf/common.sh@542 -- # cat 00:32:00.259 17:51:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:00.259 17:51:37 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:00.259 17:51:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.259 17:51:37 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.259 17:51:37 -- target/dif.sh@73 -- # cat 00:32:00.259 17:51:37 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:00.259 17:51:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:00.259 17:51:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.259 17:51:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.259 { 00:32:00.259 "params": { 00:32:00.259 "name": "Nvme$subsystem", 00:32:00.259 "trtype": "$TEST_TRANSPORT", 00:32:00.259 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.259 "adrfam": "ipv4", 00:32:00.259 "trsvcid": "$NVMF_PORT", 00:32:00.259 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.259 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.259 "hdgst": ${hdgst:-false}, 00:32:00.259 "ddgst": ${ddgst:-false} 00:32:00.259 }, 00:32:00.259 "method": "bdev_nvme_attach_controller" 00:32:00.259 } 00:32:00.259 EOF 00:32:00.259 )") 00:32:00.259 17:51:37 -- nvmf/common.sh@542 -- # cat 00:32:00.259 17:51:37 -- target/dif.sh@72 -- # (( file++ )) 00:32:00.259 17:51:37 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.259 17:51:37 -- target/dif.sh@73 -- # cat 00:32:00.259 17:51:37 -- target/dif.sh@72 -- # (( file++ )) 00:32:00.259 17:51:37 -- target/dif.sh@72 -- # (( file <= files )) 00:32:00.259 17:51:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:00.259 17:51:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:00.259 { 00:32:00.259 "params": { 00:32:00.259 "name": "Nvme$subsystem", 00:32:00.259 "trtype": "$TEST_TRANSPORT", 00:32:00.259 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:00.259 "adrfam": "ipv4", 00:32:00.259 "trsvcid": "$NVMF_PORT", 00:32:00.259 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:00.259 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:00.259 "hdgst": ${hdgst:-false}, 00:32:00.259 "ddgst": ${ddgst:-false} 00:32:00.259 }, 00:32:00.259 "method": "bdev_nvme_attach_controller" 00:32:00.259 } 00:32:00.259 EOF 00:32:00.259 )") 00:32:00.259 17:51:37 -- nvmf/common.sh@542 -- # cat 00:32:00.259 17:51:37 -- nvmf/common.sh@544 -- # jq . 00:32:00.259 17:51:37 -- nvmf/common.sh@545 -- # IFS=, 00:32:00.259 17:51:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:00.259 "params": { 00:32:00.259 "name": "Nvme0", 00:32:00.259 "trtype": "tcp", 00:32:00.259 "traddr": "10.0.0.2", 00:32:00.259 "adrfam": "ipv4", 00:32:00.259 "trsvcid": "4420", 00:32:00.259 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:00.259 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:00.259 "hdgst": false, 00:32:00.259 "ddgst": false 00:32:00.259 }, 00:32:00.259 "method": "bdev_nvme_attach_controller" 00:32:00.259 },{ 00:32:00.259 "params": { 00:32:00.259 "name": "Nvme1", 00:32:00.259 "trtype": "tcp", 00:32:00.259 "traddr": "10.0.0.2", 00:32:00.259 "adrfam": "ipv4", 00:32:00.259 "trsvcid": "4420", 00:32:00.259 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:00.259 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:00.259 "hdgst": false, 00:32:00.259 "ddgst": false 00:32:00.259 }, 00:32:00.259 "method": "bdev_nvme_attach_controller" 00:32:00.259 },{ 00:32:00.259 "params": { 00:32:00.259 "name": "Nvme2", 00:32:00.259 "trtype": "tcp", 00:32:00.259 "traddr": "10.0.0.2", 00:32:00.259 "adrfam": "ipv4", 00:32:00.259 "trsvcid": "4420", 00:32:00.259 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:32:00.259 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:32:00.259 "hdgst": false, 00:32:00.259 "ddgst": false 00:32:00.259 }, 00:32:00.259 "method": "bdev_nvme_attach_controller" 00:32:00.259 }' 00:32:00.259 17:51:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:00.259 17:51:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:00.259 17:51:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:00.260 17:51:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:00.260 17:51:37 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:00.260 17:51:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:00.260 17:51:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:00.260 17:51:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:00.260 17:51:37 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:00.260 17:51:37 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:00.518 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:00.518 ... 00:32:00.518 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:00.518 ... 00:32:00.518 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:32:00.518 ... 00:32:00.518 fio-3.35 00:32:00.518 Starting 24 threads 00:32:00.518 EAL: No free 2048 kB hugepages reported on node 1 00:32:01.451 [2024-11-16 17:51:38.586046] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:01.451 [2024-11-16 17:51:38.586101] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:11.474 00:32:11.474 filename0: (groupid=0, jobs=1): err= 0: pid=1729787: Sat Nov 16 17:51:48 2024 00:32:11.474 read: IOPS=486, BW=1948KiB/s (1994kB/s)(19.1MiB/10023msec) 00:32:11.474 slat (usec): min=7, max=141, avg=51.65, stdev=40.87 00:32:11.474 clat (msec): min=15, max=182, avg=32.40, stdev=11.85 00:32:11.474 lat (msec): min=15, max=182, avg=32.45, stdev=11.85 00:32:11.474 clat percentiles (msec): 00:32:11.474 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.474 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.474 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.474 | 99.00th=[ 77], 99.50th=[ 153], 99.90th=[ 182], 99.95th=[ 184], 00:32:11.474 | 99.99th=[ 184] 00:32:11.474 bw ( KiB/s): min= 384, max= 2048, per=4.16%, avg=1945.60, stdev=370.51, samples=20 00:32:11.474 iops : min= 96, max= 512, avg=486.40, stdev=92.63, samples=20 00:32:11.474 lat (msec) : 20=0.08%, 50=98.61%, 100=0.61%, 250=0.70% 00:32:11.474 cpu : usr=96.86%, sys=1.89%, ctx=151, majf=0, minf=21 00:32:11.474 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.474 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.474 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.474 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.474 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.474 filename0: (groupid=0, jobs=1): err= 0: pid=1729788: Sat Nov 16 17:51:48 2024 00:32:11.474 read: IOPS=532, BW=2128KiB/s (2179kB/s)(20.8MiB/10018msec) 00:32:11.474 slat (usec): min=8, max=171, avg=37.65, stdev=32.48 00:32:11.474 clat (msec): min=14, max=244, avg=29.85, stdev=12.95 00:32:11.474 lat (msec): min=14, max=244, avg=29.89, stdev=12.94 00:32:11.474 clat percentiles (msec): 00:32:11.474 | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], 00:32:11.475 | 30.00th=[ 29], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.475 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:32:11.475 | 99.00th=[ 83], 99.50th=[ 146], 99.90th=[ 205], 99.95th=[ 205], 00:32:11.475 | 99.99th=[ 245] 00:32:11.475 bw ( KiB/s): min= 561, max= 2656, per=4.55%, avg=2125.65, stdev=448.28, samples=20 00:32:11.475 iops : min= 140, max= 664, avg=531.40, stdev=112.11, samples=20 00:32:11.475 lat (msec) : 20=7.17%, 50=91.82%, 100=0.30%, 250=0.71% 00:32:11.475 cpu : usr=97.40%, sys=1.63%, ctx=219, majf=0, minf=24 00:32:11.475 IO depths : 1=3.9%, 2=7.9%, 4=17.8%, 8=61.6%, 16=8.8%, 32=0.0%, >=64=0.0% 00:32:11.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 complete : 0=0.0%, 4=92.0%, 8=2.5%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 issued rwts: total=5330,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.475 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.475 filename0: (groupid=0, jobs=1): err= 0: pid=1729789: Sat Nov 16 17:51:48 2024 00:32:11.475 read: IOPS=485, BW=1943KiB/s (1989kB/s)(19.0MiB/10015msec) 00:32:11.475 slat (usec): min=7, max=134, avg=42.13, stdev=22.66 00:32:11.475 clat (msec): min=19, max=321, avg=32.58, stdev=17.91 00:32:11.475 lat (msec): min=19, max=321, avg=32.62, stdev=17.91 00:32:11.475 clat percentiles (msec): 00:32:11.475 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.475 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.475 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.475 | 99.00th=[ 42], 99.50th=[ 148], 99.90th=[ 321], 99.95th=[ 321], 00:32:11.475 | 99.99th=[ 321] 00:32:11.475 bw ( KiB/s): min= 256, max= 2048, per=4.15%, avg=1937.75, stdev=398.56, samples=20 00:32:11.475 iops : min= 64, max= 512, avg=484.40, stdev=99.63, samples=20 00:32:11.475 lat (msec) : 20=0.29%, 50=99.05%, 250=0.33%, 500=0.33% 00:32:11.475 cpu : usr=98.29%, sys=1.19%, ctx=75, majf=0, minf=21 00:32:11.475 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:32:11.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.475 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.475 filename0: (groupid=0, jobs=1): err= 0: pid=1729790: Sat Nov 16 17:51:48 2024 00:32:11.475 read: IOPS=486, BW=1944KiB/s (1991kB/s)(19.0MiB/10007msec) 00:32:11.475 slat (nsec): min=7706, max=76900, avg=30628.52, stdev=10031.82 00:32:11.475 clat (msec): min=20, max=312, avg=32.66, stdev=17.44 00:32:11.475 lat (msec): min=20, max=312, avg=32.69, stdev=17.44 00:32:11.475 clat percentiles (msec): 00:32:11.475 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.475 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.475 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.475 | 99.00th=[ 34], 99.50th=[ 148], 99.90th=[ 313], 99.95th=[ 313], 00:32:11.475 | 99.99th=[ 313] 00:32:11.475 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1939.20, stdev=369.76, samples=20 00:32:11.475 iops : min= 96, max= 512, avg=484.80, stdev=92.44, samples=20 00:32:11.475 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.475 cpu : usr=98.34%, sys=1.18%, ctx=30, majf=0, minf=17 00:32:11.475 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:11.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.475 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.475 filename0: (groupid=0, jobs=1): err= 0: pid=1729791: Sat Nov 16 17:51:48 2024 00:32:11.475 read: IOPS=485, BW=1941KiB/s (1988kB/s)(19.0MiB/10022msec) 00:32:11.475 slat (usec): min=5, max=129, avg=39.51, stdev=14.42 00:32:11.475 clat (msec): min=25, max=263, avg=32.61, stdev=16.68 00:32:11.475 lat (msec): min=25, max=263, avg=32.65, stdev=16.68 00:32:11.475 clat percentiles (msec): 00:32:11.475 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.475 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.475 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.475 | 99.00th=[ 34], 99.50th=[ 207], 99.90th=[ 264], 99.95th=[ 264], 00:32:11.475 | 99.99th=[ 264] 00:32:11.475 bw ( KiB/s): min= 255, max= 2048, per=4.15%, avg=1939.15, stdev=399.15, samples=20 00:32:11.475 iops : min= 63, max= 512, avg=484.75, stdev=99.95, samples=20 00:32:11.475 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.475 cpu : usr=98.32%, sys=1.28%, ctx=30, majf=0, minf=24 00:32:11.475 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.475 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.475 filename0: (groupid=0, jobs=1): err= 0: pid=1729792: Sat Nov 16 17:51:48 2024 00:32:11.475 read: IOPS=485, BW=1941KiB/s (1988kB/s)(19.0MiB/10022msec) 00:32:11.475 slat (usec): min=6, max=113, avg=37.19, stdev=16.75 00:32:11.475 clat (msec): min=25, max=263, avg=32.65, stdev=16.65 00:32:11.475 lat (msec): min=25, max=263, avg=32.69, stdev=16.65 00:32:11.475 clat percentiles (msec): 00:32:11.475 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.475 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.475 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.475 | 99.00th=[ 34], 99.50th=[ 207], 99.90th=[ 264], 99.95th=[ 264], 00:32:11.475 | 99.99th=[ 264] 00:32:11.475 bw ( KiB/s): min= 256, max= 2064, per=4.15%, avg=1939.20, stdev=398.96, samples=20 00:32:11.475 iops : min= 64, max= 516, avg=484.80, stdev=99.74, samples=20 00:32:11.475 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.475 cpu : usr=98.11%, sys=1.25%, ctx=54, majf=0, minf=23 00:32:11.475 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.475 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.475 filename0: (groupid=0, jobs=1): err= 0: pid=1729793: Sat Nov 16 17:51:48 2024 00:32:11.475 read: IOPS=493, BW=1974KiB/s (2022kB/s)(19.3MiB/10004msec) 00:32:11.475 slat (usec): min=8, max=154, avg=63.51, stdev=38.81 00:32:11.475 clat (msec): min=17, max=394, avg=31.88, stdev=20.99 00:32:11.475 lat (msec): min=17, max=394, avg=31.94, stdev=20.98 00:32:11.475 clat percentiles (msec): 00:32:11.475 | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 31], 00:32:11.475 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.475 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.475 | 99.00th=[ 45], 99.50th=[ 75], 99.90th=[ 397], 99.95th=[ 397], 00:32:11.475 | 99.99th=[ 397] 00:32:11.475 bw ( KiB/s): min= 256, max= 2544, per=4.22%, avg=1971.37, stdev=432.51, samples=19 00:32:11.475 iops : min= 64, max= 636, avg=492.84, stdev=108.13, samples=19 00:32:11.475 lat (msec) : 20=1.72%, 50=97.63%, 100=0.32%, 500=0.32% 00:32:11.475 cpu : usr=96.83%, sys=1.89%, ctx=86, majf=0, minf=24 00:32:11.475 IO depths : 1=4.9%, 2=10.6%, 4=23.5%, 8=53.4%, 16=7.7%, 32=0.0%, >=64=0.0% 00:32:11.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 complete : 0=0.0%, 4=93.7%, 8=0.5%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 issued rwts: total=4938,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.475 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.475 filename0: (groupid=0, jobs=1): err= 0: pid=1729794: Sat Nov 16 17:51:48 2024 00:32:11.475 read: IOPS=486, BW=1944KiB/s (1991kB/s)(19.0MiB/10007msec) 00:32:11.475 slat (usec): min=4, max=172, avg=83.94, stdev=35.03 00:32:11.475 clat (msec): min=19, max=313, avg=32.21, stdev=17.53 00:32:11.475 lat (msec): min=19, max=313, avg=32.30, stdev=17.52 00:32:11.475 clat percentiles (msec): 00:32:11.475 | 1.00th=[ 29], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:11.475 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.475 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.475 | 99.00th=[ 34], 99.50th=[ 148], 99.90th=[ 313], 99.95th=[ 313], 00:32:11.475 | 99.99th=[ 313] 00:32:11.475 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1939.20, stdev=369.76, samples=20 00:32:11.475 iops : min= 96, max= 512, avg=484.80, stdev=92.44, samples=20 00:32:11.475 lat (msec) : 20=0.04%, 50=99.30%, 250=0.33%, 500=0.33% 00:32:11.475 cpu : usr=97.88%, sys=1.34%, ctx=80, majf=0, minf=29 00:32:11.475 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:11.475 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.475 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.475 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.475 filename1: (groupid=0, jobs=1): err= 0: pid=1729795: Sat Nov 16 17:51:48 2024 00:32:11.475 read: IOPS=485, BW=1943KiB/s (1990kB/s)(19.0MiB/10012msec) 00:32:11.475 slat (usec): min=3, max=504, avg=92.42, stdev=31.62 00:32:11.475 clat (msec): min=27, max=207, avg=32.13, stdev=13.79 00:32:11.475 lat (msec): min=27, max=207, avg=32.23, stdev=13.79 00:32:11.475 clat percentiles (msec): 00:32:11.475 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:11.475 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:11.475 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.475 | 99.00th=[ 37], 99.50th=[ 182], 99.90th=[ 207], 99.95th=[ 209], 00:32:11.475 | 99.99th=[ 209] 00:32:11.475 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1939.20, stdev=369.76, samples=20 00:32:11.475 iops : min= 96, max= 512, avg=484.80, stdev=92.44, samples=20 00:32:11.475 lat (msec) : 50=99.01%, 100=0.29%, 250=0.70% 00:32:11.475 cpu : usr=97.29%, sys=1.52%, ctx=164, majf=0, minf=30 00:32:11.475 IO depths : 1=5.8%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:11.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.476 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.476 filename1: (groupid=0, jobs=1): err= 0: pid=1729796: Sat Nov 16 17:51:48 2024 00:32:11.476 read: IOPS=485, BW=1941KiB/s (1988kB/s)(19.0MiB/10022msec) 00:32:11.476 slat (nsec): min=8179, max=65618, avg=34860.69, stdev=10610.27 00:32:11.476 clat (msec): min=25, max=328, avg=32.66, stdev=18.16 00:32:11.476 lat (msec): min=25, max=328, avg=32.70, stdev=18.16 00:32:11.476 clat percentiles (msec): 00:32:11.476 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.476 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.476 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.476 | 99.00th=[ 34], 99.50th=[ 142], 99.90th=[ 330], 99.95th=[ 330], 00:32:11.476 | 99.99th=[ 330] 00:32:11.476 bw ( KiB/s): min= 256, max= 2048, per=4.15%, avg=1939.20, stdev=398.92, samples=20 00:32:11.476 iops : min= 64, max= 512, avg=484.80, stdev=99.73, samples=20 00:32:11.476 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.476 cpu : usr=98.41%, sys=1.21%, ctx=19, majf=0, minf=28 00:32:11.476 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:11.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.476 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.476 filename1: (groupid=0, jobs=1): err= 0: pid=1729797: Sat Nov 16 17:51:48 2024 00:32:11.476 read: IOPS=485, BW=1941KiB/s (1988kB/s)(19.0MiB/10022msec) 00:32:11.476 slat (usec): min=10, max=169, avg=43.47, stdev=23.07 00:32:11.476 clat (msec): min=24, max=263, avg=32.58, stdev=16.67 00:32:11.476 lat (msec): min=24, max=263, avg=32.62, stdev=16.66 00:32:11.476 clat percentiles (msec): 00:32:11.476 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.476 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.476 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.476 | 99.00th=[ 34], 99.50th=[ 207], 99.90th=[ 264], 99.95th=[ 264], 00:32:11.476 | 99.99th=[ 264] 00:32:11.476 bw ( KiB/s): min= 256, max= 2048, per=4.15%, avg=1939.20, stdev=398.92, samples=20 00:32:11.476 iops : min= 64, max= 512, avg=484.80, stdev=99.73, samples=20 00:32:11.476 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.476 cpu : usr=98.20%, sys=1.26%, ctx=48, majf=0, minf=23 00:32:11.476 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:11.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.476 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.476 filename1: (groupid=0, jobs=1): err= 0: pid=1729798: Sat Nov 16 17:51:48 2024 00:32:11.476 read: IOPS=486, BW=1945KiB/s (1991kB/s)(19.0MiB/10004msec) 00:32:11.476 slat (usec): min=8, max=113, avg=38.37, stdev=16.30 00:32:11.476 clat (msec): min=19, max=310, avg=32.56, stdev=17.31 00:32:11.476 lat (msec): min=19, max=310, avg=32.60, stdev=17.31 00:32:11.476 clat percentiles (msec): 00:32:11.476 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.476 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.476 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.476 | 99.00th=[ 34], 99.50th=[ 148], 99.90th=[ 313], 99.95th=[ 313], 00:32:11.476 | 99.99th=[ 313] 00:32:11.476 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1940.21, stdev=379.86, samples=19 00:32:11.476 iops : min= 96, max= 512, avg=485.05, stdev=94.97, samples=19 00:32:11.476 lat (msec) : 20=0.04%, 50=99.30%, 250=0.33%, 500=0.33% 00:32:11.476 cpu : usr=98.17%, sys=1.24%, ctx=36, majf=0, minf=21 00:32:11.476 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.476 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.476 filename1: (groupid=0, jobs=1): err= 0: pid=1729799: Sat Nov 16 17:51:48 2024 00:32:11.476 read: IOPS=488, BW=1955KiB/s (2002kB/s)(19.1MiB/10018msec) 00:32:11.476 slat (usec): min=8, max=154, avg=57.08, stdev=36.25 00:32:11.476 clat (msec): min=14, max=196, avg=32.25, stdev=11.77 00:32:11.476 lat (msec): min=14, max=196, avg=32.30, stdev=11.76 00:32:11.476 clat percentiles (msec): 00:32:11.476 | 1.00th=[ 30], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.476 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.476 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.476 | 99.00th=[ 65], 99.50th=[ 153], 99.90th=[ 184], 99.95th=[ 184], 00:32:11.476 | 99.99th=[ 197] 00:32:11.476 bw ( KiB/s): min= 625, max= 2048, per=4.18%, avg=1952.05, stdev=316.44, samples=20 00:32:11.476 iops : min= 156, max= 512, avg=488.00, stdev=79.16, samples=20 00:32:11.476 lat (msec) : 20=0.33%, 50=98.41%, 100=0.61%, 250=0.65% 00:32:11.476 cpu : usr=94.53%, sys=3.01%, ctx=422, majf=0, minf=25 00:32:11.476 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 issued rwts: total=4896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.476 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.476 filename1: (groupid=0, jobs=1): err= 0: pid=1729800: Sat Nov 16 17:51:48 2024 00:32:11.476 read: IOPS=487, BW=1948KiB/s (1995kB/s)(19.1MiB/10018msec) 00:32:11.476 slat (nsec): min=4638, max=64648, avg=22757.96, stdev=12170.16 00:32:11.476 clat (msec): min=20, max=182, avg=32.66, stdev=11.80 00:32:11.476 lat (msec): min=20, max=182, avg=32.68, stdev=11.79 00:32:11.476 clat percentiles (msec): 00:32:11.476 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 32], 00:32:11.476 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.476 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.476 | 99.00th=[ 75], 99.50th=[ 153], 99.90th=[ 184], 99.95th=[ 184], 00:32:11.476 | 99.99th=[ 184] 00:32:11.476 bw ( KiB/s): min= 496, max= 2048, per=4.16%, avg=1945.60, stdev=344.94, samples=20 00:32:11.476 iops : min= 124, max= 512, avg=486.40, stdev=86.23, samples=20 00:32:11.476 lat (msec) : 50=98.69%, 100=0.66%, 250=0.66% 00:32:11.476 cpu : usr=97.39%, sys=1.64%, ctx=96, majf=0, minf=25 00:32:11.476 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 issued rwts: total=4880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.476 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.476 filename1: (groupid=0, jobs=1): err= 0: pid=1729801: Sat Nov 16 17:51:48 2024 00:32:11.476 read: IOPS=486, BW=1944KiB/s (1991kB/s)(19.0MiB/10007msec) 00:32:11.476 slat (usec): min=13, max=175, avg=97.78, stdev=25.82 00:32:11.476 clat (msec): min=19, max=313, avg=32.06, stdev=17.50 00:32:11.476 lat (msec): min=19, max=313, avg=32.16, stdev=17.50 00:32:11.476 clat percentiles (msec): 00:32:11.476 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:11.476 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:11.476 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:32:11.476 | 99.00th=[ 34], 99.50th=[ 148], 99.90th=[ 313], 99.95th=[ 313], 00:32:11.476 | 99.99th=[ 313] 00:32:11.476 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1939.20, stdev=369.76, samples=20 00:32:11.476 iops : min= 96, max= 512, avg=484.80, stdev=92.44, samples=20 00:32:11.476 lat (msec) : 20=0.08%, 50=99.26%, 250=0.33%, 500=0.33% 00:32:11.476 cpu : usr=97.44%, sys=1.49%, ctx=79, majf=0, minf=22 00:32:11.476 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:11.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.476 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.476 filename1: (groupid=0, jobs=1): err= 0: pid=1729802: Sat Nov 16 17:51:48 2024 00:32:11.476 read: IOPS=496, BW=1984KiB/s (2032kB/s)(19.4MiB/10004msec) 00:32:11.476 slat (usec): min=8, max=100, avg=33.77, stdev=16.84 00:32:11.476 clat (msec): min=17, max=450, avg=31.96, stdev=21.41 00:32:11.476 lat (msec): min=17, max=450, avg=31.99, stdev=21.41 00:32:11.476 clat percentiles (msec): 00:32:11.476 | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.476 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.476 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:32:11.476 | 99.00th=[ 45], 99.50th=[ 75], 99.90th=[ 397], 99.95th=[ 397], 00:32:11.476 | 99.99th=[ 451] 00:32:11.476 bw ( KiB/s): min= 256, max= 2496, per=4.24%, avg=1981.47, stdev=432.67, samples=19 00:32:11.476 iops : min= 64, max= 624, avg=495.37, stdev=108.17, samples=19 00:32:11.476 lat (msec) : 20=1.61%, 50=97.78%, 100=0.28%, 500=0.32% 00:32:11.476 cpu : usr=98.38%, sys=1.02%, ctx=39, majf=0, minf=25 00:32:11.476 IO depths : 1=5.1%, 2=10.4%, 4=21.9%, 8=54.9%, 16=7.6%, 32=0.0%, >=64=0.0% 00:32:11.476 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 complete : 0=0.0%, 4=93.3%, 8=1.2%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.476 issued rwts: total=4962,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.476 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.476 filename2: (groupid=0, jobs=1): err= 0: pid=1729803: Sat Nov 16 17:51:48 2024 00:32:11.476 read: IOPS=489, BW=1959KiB/s (2006kB/s)(19.2MiB/10028msec) 00:32:11.476 slat (usec): min=4, max=162, avg=56.91, stdev=41.84 00:32:11.476 clat (msec): min=3, max=225, avg=32.16, stdev=12.79 00:32:11.476 lat (msec): min=3, max=225, avg=32.22, stdev=12.79 00:32:11.476 clat percentiles (msec): 00:32:11.476 | 1.00th=[ 21], 5.00th=[ 30], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.476 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.477 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.477 | 99.00th=[ 77], 99.50th=[ 109], 99.90th=[ 226], 99.95th=[ 226], 00:32:11.477 | 99.99th=[ 226] 00:32:11.477 bw ( KiB/s): min= 640, max= 2176, per=4.19%, avg=1958.40, stdev=318.96, samples=20 00:32:11.477 iops : min= 160, max= 544, avg=489.60, stdev=79.74, samples=20 00:32:11.477 lat (msec) : 4=0.33%, 20=0.71%, 50=97.66%, 100=0.65%, 250=0.65% 00:32:11.477 cpu : usr=96.86%, sys=1.74%, ctx=166, majf=0, minf=29 00:32:11.477 IO depths : 1=5.8%, 2=12.0%, 4=24.9%, 8=50.6%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:11.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 issued rwts: total=4912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.477 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.477 filename2: (groupid=0, jobs=1): err= 0: pid=1729804: Sat Nov 16 17:51:48 2024 00:32:11.477 read: IOPS=485, BW=1941KiB/s (1988kB/s)(19.0MiB/10022msec) 00:32:11.477 slat (usec): min=8, max=123, avg=34.10, stdev=12.69 00:32:11.477 clat (msec): min=24, max=328, avg=32.67, stdev=16.85 00:32:11.477 lat (msec): min=24, max=328, avg=32.71, stdev=16.85 00:32:11.477 clat percentiles (msec): 00:32:11.477 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.477 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.477 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.477 | 99.00th=[ 34], 99.50th=[ 207], 99.90th=[ 264], 99.95th=[ 264], 00:32:11.477 | 99.99th=[ 330] 00:32:11.477 bw ( KiB/s): min= 256, max= 2064, per=4.15%, avg=1939.20, stdev=398.96, samples=20 00:32:11.477 iops : min= 64, max= 516, avg=484.80, stdev=99.74, samples=20 00:32:11.477 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.477 cpu : usr=97.04%, sys=1.75%, ctx=201, majf=0, minf=22 00:32:11.477 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:11.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.477 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.477 filename2: (groupid=0, jobs=1): err= 0: pid=1729805: Sat Nov 16 17:51:48 2024 00:32:11.477 read: IOPS=486, BW=1945KiB/s (1991kB/s)(19.0MiB/10005msec) 00:32:11.477 slat (usec): min=8, max=110, avg=36.82, stdev=14.86 00:32:11.477 clat (msec): min=19, max=311, avg=32.58, stdev=17.36 00:32:11.477 lat (msec): min=19, max=311, avg=32.62, stdev=17.36 00:32:11.477 clat percentiles (msec): 00:32:11.477 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.477 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.477 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.477 | 99.00th=[ 34], 99.50th=[ 148], 99.90th=[ 313], 99.95th=[ 313], 00:32:11.477 | 99.99th=[ 313] 00:32:11.477 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1940.21, stdev=379.60, samples=19 00:32:11.477 iops : min= 96, max= 512, avg=485.05, stdev=94.90, samples=19 00:32:11.477 lat (msec) : 20=0.08%, 50=99.26%, 250=0.33%, 500=0.33% 00:32:11.477 cpu : usr=97.39%, sys=1.51%, ctx=233, majf=0, minf=19 00:32:11.477 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:11.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.477 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.477 filename2: (groupid=0, jobs=1): err= 0: pid=1729806: Sat Nov 16 17:51:48 2024 00:32:11.477 read: IOPS=485, BW=1941KiB/s (1988kB/s)(19.0MiB/10022msec) 00:32:11.477 slat (nsec): min=8694, max=67156, avg=35207.57, stdev=10541.99 00:32:11.477 clat (msec): min=24, max=263, avg=32.65, stdev=16.67 00:32:11.477 lat (msec): min=24, max=263, avg=32.68, stdev=16.66 00:32:11.477 clat percentiles (msec): 00:32:11.477 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.477 | 30.00th=[ 31], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.477 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.477 | 99.00th=[ 35], 99.50th=[ 207], 99.90th=[ 264], 99.95th=[ 264], 00:32:11.477 | 99.99th=[ 264] 00:32:11.477 bw ( KiB/s): min= 255, max= 2048, per=4.15%, avg=1939.15, stdev=399.15, samples=20 00:32:11.477 iops : min= 63, max= 512, avg=484.75, stdev=99.95, samples=20 00:32:11.477 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.477 cpu : usr=98.51%, sys=1.09%, ctx=17, majf=0, minf=20 00:32:11.477 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:32:11.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.477 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.477 filename2: (groupid=0, jobs=1): err= 0: pid=1729807: Sat Nov 16 17:51:48 2024 00:32:11.477 read: IOPS=485, BW=1941KiB/s (1988kB/s)(19.0MiB/10022msec) 00:32:11.477 slat (usec): min=7, max=164, avg=78.74, stdev=34.39 00:32:11.477 clat (msec): min=25, max=263, avg=32.28, stdev=16.70 00:32:11.477 lat (msec): min=25, max=263, avg=32.36, stdev=16.69 00:32:11.477 clat percentiles (msec): 00:32:11.477 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:11.477 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.477 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.477 | 99.00th=[ 34], 99.50th=[ 207], 99.90th=[ 264], 99.95th=[ 264], 00:32:11.477 | 99.99th=[ 264] 00:32:11.477 bw ( KiB/s): min= 256, max= 2048, per=4.15%, avg=1939.20, stdev=398.92, samples=20 00:32:11.477 iops : min= 64, max= 512, avg=484.80, stdev=99.73, samples=20 00:32:11.477 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.477 cpu : usr=94.68%, sys=2.85%, ctx=485, majf=0, minf=28 00:32:11.477 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.477 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.477 filename2: (groupid=0, jobs=1): err= 0: pid=1729808: Sat Nov 16 17:51:48 2024 00:32:11.477 read: IOPS=485, BW=1944KiB/s (1991kB/s)(19.0MiB/10009msec) 00:32:11.477 slat (usec): min=7, max=193, avg=42.44, stdev=31.87 00:32:11.477 clat (msec): min=27, max=207, avg=32.58, stdev=13.72 00:32:11.477 lat (msec): min=27, max=207, avg=32.62, stdev=13.72 00:32:11.477 clat percentiles (msec): 00:32:11.477 | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], 00:32:11.477 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 32], 60.00th=[ 32], 00:32:11.477 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 33], 95.00th=[ 33], 00:32:11.477 | 99.00th=[ 35], 99.50th=[ 184], 99.90th=[ 207], 99.95th=[ 207], 00:32:11.477 | 99.99th=[ 209] 00:32:11.477 bw ( KiB/s): min= 384, max= 2048, per=4.15%, avg=1939.20, stdev=369.76, samples=20 00:32:11.477 iops : min= 96, max= 512, avg=484.80, stdev=92.44, samples=20 00:32:11.477 lat (msec) : 50=99.01%, 100=0.33%, 250=0.66% 00:32:11.477 cpu : usr=97.88%, sys=1.24%, ctx=58, majf=0, minf=28 00:32:11.477 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.477 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.477 filename2: (groupid=0, jobs=1): err= 0: pid=1729809: Sat Nov 16 17:51:48 2024 00:32:11.477 read: IOPS=445, BW=1782KiB/s (1825kB/s)(17.4MiB/10004msec) 00:32:11.477 slat (usec): min=7, max=159, avg=66.76, stdev=39.94 00:32:11.477 clat (msec): min=14, max=395, avg=35.56, stdev=22.92 00:32:11.477 lat (msec): min=14, max=395, avg=35.63, stdev=22.92 00:32:11.477 clat percentiles (msec): 00:32:11.477 | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 31], 00:32:11.477 | 30.00th=[ 32], 40.00th=[ 32], 50.00th=[ 33], 60.00th=[ 34], 00:32:11.477 | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 47], 95.00th=[ 47], 00:32:11.477 | 99.00th=[ 50], 99.50th=[ 75], 99.90th=[ 397], 99.95th=[ 397], 00:32:11.477 | 99.99th=[ 397] 00:32:11.477 bw ( KiB/s): min= 256, max= 2352, per=3.74%, avg=1747.79, stdev=450.42, samples=19 00:32:11.477 iops : min= 64, max= 588, avg=436.95, stdev=112.60, samples=19 00:32:11.477 lat (msec) : 20=3.50%, 50=95.60%, 100=0.54%, 500=0.36% 00:32:11.477 cpu : usr=97.78%, sys=1.36%, ctx=134, majf=0, minf=25 00:32:11.477 IO depths : 1=0.7%, 2=2.3%, 4=7.5%, 8=74.6%, 16=14.9%, 32=0.0%, >=64=0.0% 00:32:11.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 complete : 0=0.0%, 4=90.3%, 8=7.1%, 16=2.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 issued rwts: total=4457,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.477 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.477 filename2: (groupid=0, jobs=1): err= 0: pid=1729810: Sat Nov 16 17:51:48 2024 00:32:11.477 read: IOPS=486, BW=1944KiB/s (1991kB/s)(19.0MiB/10008msec) 00:32:11.477 slat (usec): min=13, max=178, avg=85.82, stdev=35.60 00:32:11.477 clat (msec): min=20, max=314, avg=32.16, stdev=17.55 00:32:11.477 lat (msec): min=20, max=314, avg=32.25, stdev=17.55 00:32:11.477 clat percentiles (msec): 00:32:11.477 | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 31], 00:32:11.477 | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 32], 00:32:11.477 | 70.00th=[ 32], 80.00th=[ 32], 90.00th=[ 32], 95.00th=[ 33], 00:32:11.477 | 99.00th=[ 34], 99.50th=[ 148], 99.90th=[ 313], 99.95th=[ 313], 00:32:11.477 | 99.99th=[ 313] 00:32:11.477 bw ( KiB/s): min= 368, max= 2048, per=4.15%, avg=1939.20, stdev=373.27, samples=20 00:32:11.477 iops : min= 92, max= 512, avg=484.80, stdev=93.32, samples=20 00:32:11.477 lat (msec) : 50=99.34%, 250=0.33%, 500=0.33% 00:32:11.477 cpu : usr=92.86%, sys=3.91%, ctx=480, majf=0, minf=22 00:32:11.477 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:11.477 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.477 issued rwts: total=4864,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.477 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:11.477 00:32:11.478 Run status group 0 (all jobs): 00:32:11.478 READ: bw=45.6MiB/s (47.8MB/s), 1782KiB/s-2128KiB/s (1825kB/s-2179kB/s), io=457MiB (480MB), run=10004-10028msec 00:32:11.736 17:51:49 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:11.736 17:51:49 -- target/dif.sh@43 -- # local sub 00:32:11.736 17:51:49 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.736 17:51:49 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:11.736 17:51:49 -- target/dif.sh@36 -- # local sub_id=0 00:32:11.736 17:51:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:11.736 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.736 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.736 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.736 17:51:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:11.736 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.736 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.736 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.736 17:51:49 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.736 17:51:49 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:11.736 17:51:49 -- target/dif.sh@36 -- # local sub_id=1 00:32:11.736 17:51:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:11.736 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.736 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.736 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.736 17:51:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:11.736 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.736 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.736 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.736 17:51:49 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.736 17:51:49 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:11.736 17:51:49 -- target/dif.sh@36 -- # local sub_id=2 00:32:11.736 17:51:49 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:11.736 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.736 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.736 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.736 17:51:49 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:11.736 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.736 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.736 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.736 17:51:49 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:11.736 17:51:49 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:11.736 17:51:49 -- target/dif.sh@115 -- # numjobs=2 00:32:11.736 17:51:49 -- target/dif.sh@115 -- # iodepth=8 00:32:11.736 17:51:49 -- target/dif.sh@115 -- # runtime=5 00:32:11.736 17:51:49 -- target/dif.sh@115 -- # files=1 00:32:11.736 17:51:49 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:11.736 17:51:49 -- target/dif.sh@28 -- # local sub 00:32:11.736 17:51:49 -- target/dif.sh@30 -- # for sub in "$@" 00:32:11.736 17:51:49 -- target/dif.sh@31 -- # create_subsystem 0 00:32:11.737 17:51:49 -- target/dif.sh@18 -- # local sub_id=0 00:32:11.737 17:51:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:11.737 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.737 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.737 bdev_null0 00:32:11.737 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.737 17:51:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:11.737 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.737 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.737 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.737 17:51:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:11.737 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.737 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.737 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.737 17:51:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:11.737 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.737 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.737 [2024-11-16 17:51:49.160252] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:11.737 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.737 17:51:49 -- target/dif.sh@30 -- # for sub in "$@" 00:32:11.737 17:51:49 -- target/dif.sh@31 -- # create_subsystem 1 00:32:11.737 17:51:49 -- target/dif.sh@18 -- # local sub_id=1 00:32:11.737 17:51:49 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:11.737 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.737 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.737 bdev_null1 00:32:11.737 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.737 17:51:49 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:11.737 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.737 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.737 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.737 17:51:49 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:11.737 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.737 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.737 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.737 17:51:49 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:11.737 17:51:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.737 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:32:11.737 17:51:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.737 17:51:49 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:11.737 17:51:49 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:11.737 17:51:49 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.737 17:51:49 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:11.737 17:51:49 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.737 17:51:49 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:11.737 17:51:49 -- target/dif.sh@82 -- # gen_fio_conf 00:32:11.737 17:51:49 -- nvmf/common.sh@520 -- # config=() 00:32:11.737 17:51:49 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:11.737 17:51:49 -- nvmf/common.sh@520 -- # local subsystem config 00:32:11.737 17:51:49 -- target/dif.sh@54 -- # local file 00:32:11.737 17:51:49 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:11.737 17:51:49 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.737 17:51:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:11.737 17:51:49 -- target/dif.sh@56 -- # cat 00:32:11.737 17:51:49 -- common/autotest_common.sh@1330 -- # shift 00:32:11.737 17:51:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:11.737 { 00:32:11.737 "params": { 00:32:11.737 "name": "Nvme$subsystem", 00:32:11.737 "trtype": "$TEST_TRANSPORT", 00:32:11.737 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:11.737 "adrfam": "ipv4", 00:32:11.737 "trsvcid": "$NVMF_PORT", 00:32:11.737 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:11.737 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:11.737 "hdgst": ${hdgst:-false}, 00:32:11.737 "ddgst": ${ddgst:-false} 00:32:11.737 }, 00:32:11.737 "method": "bdev_nvme_attach_controller" 00:32:11.737 } 00:32:11.737 EOF 00:32:11.737 )") 00:32:11.737 17:51:49 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:11.737 17:51:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:11.737 17:51:49 -- nvmf/common.sh@542 -- # cat 00:32:11.737 17:51:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.737 17:51:49 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:11.737 17:51:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:11.737 17:51:49 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:11.737 17:51:49 -- target/dif.sh@72 -- # (( file <= files )) 00:32:11.737 17:51:49 -- target/dif.sh@73 -- # cat 00:32:11.737 17:51:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:11.737 17:51:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:11.737 { 00:32:11.737 "params": { 00:32:11.737 "name": "Nvme$subsystem", 00:32:11.737 "trtype": "$TEST_TRANSPORT", 00:32:11.737 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:11.737 "adrfam": "ipv4", 00:32:11.737 "trsvcid": "$NVMF_PORT", 00:32:11.737 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:11.737 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:11.737 "hdgst": ${hdgst:-false}, 00:32:11.737 "ddgst": ${ddgst:-false} 00:32:11.737 }, 00:32:11.737 "method": "bdev_nvme_attach_controller" 00:32:11.737 } 00:32:11.737 EOF 00:32:11.737 )") 00:32:11.737 17:51:49 -- target/dif.sh@72 -- # (( file++ )) 00:32:11.737 17:51:49 -- target/dif.sh@72 -- # (( file <= files )) 00:32:11.737 17:51:49 -- nvmf/common.sh@542 -- # cat 00:32:11.737 17:51:49 -- nvmf/common.sh@544 -- # jq . 00:32:11.737 17:51:49 -- nvmf/common.sh@545 -- # IFS=, 00:32:11.737 17:51:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:11.737 "params": { 00:32:11.737 "name": "Nvme0", 00:32:11.737 "trtype": "tcp", 00:32:11.737 "traddr": "10.0.0.2", 00:32:11.737 "adrfam": "ipv4", 00:32:11.737 "trsvcid": "4420", 00:32:11.737 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:11.737 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:11.737 "hdgst": false, 00:32:11.737 "ddgst": false 00:32:11.737 }, 00:32:11.737 "method": "bdev_nvme_attach_controller" 00:32:11.737 },{ 00:32:11.737 "params": { 00:32:11.737 "name": "Nvme1", 00:32:11.737 "trtype": "tcp", 00:32:11.737 "traddr": "10.0.0.2", 00:32:11.737 "adrfam": "ipv4", 00:32:11.737 "trsvcid": "4420", 00:32:11.737 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:11.737 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:11.737 "hdgst": false, 00:32:11.737 "ddgst": false 00:32:11.737 }, 00:32:11.737 "method": "bdev_nvme_attach_controller" 00:32:11.737 }' 00:32:11.737 17:51:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:11.737 17:51:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:11.737 17:51:49 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:11.737 17:51:49 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.737 17:51:49 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:11.737 17:51:49 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:11.994 17:51:49 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:11.994 17:51:49 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:11.994 17:51:49 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:11.994 17:51:49 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.994 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:11.994 ... 00:32:11.994 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:11.994 ... 00:32:11.994 fio-3.35 00:32:11.994 Starting 4 threads 00:32:11.994 EAL: No free 2048 kB hugepages reported on node 1 00:32:12.929 [2024-11-16 17:51:50.069202] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:12.929 [2024-11-16 17:51:50.069271] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:18.196 00:32:18.196 filename0: (groupid=0, jobs=1): err= 0: pid=1731243: Sat Nov 16 17:51:55 2024 00:32:18.196 read: IOPS=1774, BW=13.9MiB/s (14.5MB/s)(69.4MiB/5003msec) 00:32:18.196 slat (nsec): min=6209, max=72714, avg=22708.94, stdev=11242.19 00:32:18.196 clat (usec): min=871, max=8115, avg=4418.93, stdev=350.11 00:32:18.196 lat (usec): min=885, max=8129, avg=4441.64, stdev=350.82 00:32:18.196 clat percentiles (usec): 00:32:18.196 | 1.00th=[ 3490], 5.00th=[ 4047], 10.00th=[ 4146], 20.00th=[ 4228], 00:32:18.196 | 30.00th=[ 4293], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4490], 00:32:18.196 | 70.00th=[ 4555], 80.00th=[ 4621], 90.00th=[ 4686], 95.00th=[ 4752], 00:32:18.196 | 99.00th=[ 5211], 99.50th=[ 6063], 99.90th=[ 7308], 99.95th=[ 7439], 00:32:18.196 | 99.99th=[ 8094] 00:32:18.196 bw ( KiB/s): min=13952, max=14848, per=25.06%, avg=14194.80, stdev=321.52, samples=10 00:32:18.196 iops : min= 1744, max= 1856, avg=1774.30, stdev=40.21, samples=10 00:32:18.196 lat (usec) : 1000=0.02% 00:32:18.196 lat (msec) : 2=0.30%, 4=3.36%, 10=96.32% 00:32:18.196 cpu : usr=95.26%, sys=4.24%, ctx=7, majf=0, minf=0 00:32:18.196 IO depths : 1=1.2%, 2=21.1%, 4=53.2%, 8=24.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:18.196 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.196 complete : 0=0.0%, 4=90.4%, 8=9.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.196 issued rwts: total=8878,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:18.196 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:18.196 filename0: (groupid=0, jobs=1): err= 0: pid=1731244: Sat Nov 16 17:51:55 2024 00:32:18.196 read: IOPS=1767, BW=13.8MiB/s (14.5MB/s)(69.1MiB/5002msec) 00:32:18.196 slat (nsec): min=6262, max=77114, avg=22447.99, stdev=11126.10 00:32:18.196 clat (usec): min=972, max=8112, avg=4438.23, stdev=429.39 00:32:18.196 lat (usec): min=984, max=8121, avg=4460.68, stdev=429.85 00:32:18.197 clat percentiles (usec): 00:32:18.197 | 1.00th=[ 3621], 5.00th=[ 4080], 10.00th=[ 4146], 20.00th=[ 4228], 00:32:18.197 | 30.00th=[ 4293], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4490], 00:32:18.197 | 70.00th=[ 4555], 80.00th=[ 4621], 90.00th=[ 4686], 95.00th=[ 4817], 00:32:18.197 | 99.00th=[ 6128], 99.50th=[ 6980], 99.90th=[ 7767], 99.95th=[ 7832], 00:32:18.197 | 99.99th=[ 8094] 00:32:18.197 bw ( KiB/s): min=13776, max=14976, per=25.00%, avg=14156.44, stdev=368.50, samples=9 00:32:18.197 iops : min= 1722, max= 1872, avg=1769.56, stdev=46.06, samples=9 00:32:18.197 lat (usec) : 1000=0.03% 00:32:18.197 lat (msec) : 2=0.51%, 4=2.70%, 10=96.75% 00:32:18.197 cpu : usr=95.44%, sys=4.08%, ctx=6, majf=0, minf=0 00:32:18.197 IO depths : 1=1.0%, 2=19.7%, 4=54.0%, 8=25.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:18.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.197 complete : 0=0.0%, 4=91.1%, 8=8.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.197 issued rwts: total=8843,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:18.197 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:18.197 filename1: (groupid=0, jobs=1): err= 0: pid=1731245: Sat Nov 16 17:51:55 2024 00:32:18.197 read: IOPS=1763, BW=13.8MiB/s (14.4MB/s)(68.9MiB/5001msec) 00:32:18.197 slat (usec): min=6, max=100, avg=22.54, stdev=11.37 00:32:18.197 clat (usec): min=764, max=8343, avg=4451.14, stdev=496.04 00:32:18.197 lat (usec): min=776, max=8371, avg=4473.68, stdev=496.33 00:32:18.197 clat percentiles (usec): 00:32:18.197 | 1.00th=[ 3064], 5.00th=[ 4047], 10.00th=[ 4146], 20.00th=[ 4228], 00:32:18.197 | 30.00th=[ 4293], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4490], 00:32:18.197 | 70.00th=[ 4555], 80.00th=[ 4621], 90.00th=[ 4752], 95.00th=[ 4817], 00:32:18.197 | 99.00th=[ 6718], 99.50th=[ 7439], 99.90th=[ 7898], 99.95th=[ 8160], 00:32:18.197 | 99.99th=[ 8356] 00:32:18.197 bw ( KiB/s): min=13712, max=14976, per=24.95%, avg=14129.22, stdev=387.23, samples=9 00:32:18.197 iops : min= 1714, max= 1872, avg=1766.11, stdev=48.43, samples=9 00:32:18.197 lat (usec) : 1000=0.12% 00:32:18.197 lat (msec) : 2=0.51%, 4=2.77%, 10=96.60% 00:32:18.197 cpu : usr=94.80%, sys=4.72%, ctx=11, majf=0, minf=0 00:32:18.197 IO depths : 1=0.1%, 2=16.0%, 4=58.1%, 8=25.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:18.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.197 complete : 0=0.0%, 4=90.8%, 8=9.2%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.197 issued rwts: total=8821,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:18.197 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:18.197 filename1: (groupid=0, jobs=1): err= 0: pid=1731246: Sat Nov 16 17:51:55 2024 00:32:18.197 read: IOPS=1774, BW=13.9MiB/s (14.5MB/s)(69.3MiB/5001msec) 00:32:18.197 slat (nsec): min=6202, max=72062, avg=22155.23, stdev=8086.15 00:32:18.197 clat (usec): min=876, max=8013, avg=4426.85, stdev=364.92 00:32:18.197 lat (usec): min=885, max=8033, avg=4449.00, stdev=365.18 00:32:18.197 clat percentiles (usec): 00:32:18.197 | 1.00th=[ 3556], 5.00th=[ 4047], 10.00th=[ 4146], 20.00th=[ 4228], 00:32:18.197 | 30.00th=[ 4293], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4490], 00:32:18.197 | 70.00th=[ 4555], 80.00th=[ 4621], 90.00th=[ 4686], 95.00th=[ 4752], 00:32:18.197 | 99.00th=[ 5080], 99.50th=[ 6259], 99.90th=[ 7832], 99.95th=[ 7898], 00:32:18.197 | 99.99th=[ 8029] 00:32:18.197 bw ( KiB/s): min=13872, max=14848, per=25.12%, avg=14229.33, stdev=333.03, samples=9 00:32:18.197 iops : min= 1734, max= 1856, avg=1778.67, stdev=41.63, samples=9 00:32:18.197 lat (usec) : 1000=0.06% 00:32:18.197 lat (msec) : 2=0.24%, 4=3.71%, 10=96.00% 00:32:18.197 cpu : usr=93.42%, sys=4.88%, ctx=317, majf=0, minf=0 00:32:18.197 IO depths : 1=0.7%, 2=19.0%, 4=54.9%, 8=25.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:18.197 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.197 complete : 0=0.0%, 4=90.9%, 8=9.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:18.197 issued rwts: total=8876,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:18.197 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:18.197 00:32:18.197 Run status group 0 (all jobs): 00:32:18.197 READ: bw=55.3MiB/s (58.0MB/s), 13.8MiB/s-13.9MiB/s (14.4MB/s-14.5MB/s), io=277MiB (290MB), run=5001-5003msec 00:32:18.197 17:51:55 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:18.197 17:51:55 -- target/dif.sh@43 -- # local sub 00:32:18.197 17:51:55 -- target/dif.sh@45 -- # for sub in "$@" 00:32:18.197 17:51:55 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:18.197 17:51:55 -- target/dif.sh@36 -- # local sub_id=0 00:32:18.197 17:51:55 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:18.197 17:51:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.197 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.197 17:51:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.197 17:51:55 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:18.197 17:51:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.197 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.197 17:51:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.197 17:51:55 -- target/dif.sh@45 -- # for sub in "$@" 00:32:18.197 17:51:55 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:18.197 17:51:55 -- target/dif.sh@36 -- # local sub_id=1 00:32:18.197 17:51:55 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:18.197 17:51:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.197 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.197 17:51:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.197 17:51:55 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:18.197 17:51:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.197 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.197 17:51:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.197 00:32:18.197 real 0m24.213s 00:32:18.197 user 4m30.661s 00:32:18.197 sys 0m7.036s 00:32:18.197 17:51:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:18.197 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.197 ************************************ 00:32:18.197 END TEST fio_dif_rand_params 00:32:18.197 ************************************ 00:32:18.197 17:51:55 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:18.197 17:51:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:18.197 17:51:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:18.197 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.197 ************************************ 00:32:18.197 START TEST fio_dif_digest 00:32:18.197 ************************************ 00:32:18.197 17:51:55 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:18.197 17:51:55 -- target/dif.sh@123 -- # local NULL_DIF 00:32:18.197 17:51:55 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:18.197 17:51:55 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:18.197 17:51:55 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:18.197 17:51:55 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:18.197 17:51:55 -- target/dif.sh@127 -- # numjobs=3 00:32:18.197 17:51:55 -- target/dif.sh@127 -- # iodepth=3 00:32:18.197 17:51:55 -- target/dif.sh@127 -- # runtime=10 00:32:18.197 17:51:55 -- target/dif.sh@128 -- # hdgst=true 00:32:18.197 17:51:55 -- target/dif.sh@128 -- # ddgst=true 00:32:18.197 17:51:55 -- target/dif.sh@130 -- # create_subsystems 0 00:32:18.197 17:51:55 -- target/dif.sh@28 -- # local sub 00:32:18.197 17:51:55 -- target/dif.sh@30 -- # for sub in "$@" 00:32:18.197 17:51:55 -- target/dif.sh@31 -- # create_subsystem 0 00:32:18.197 17:51:55 -- target/dif.sh@18 -- # local sub_id=0 00:32:18.197 17:51:55 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:18.197 17:51:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.197 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.197 bdev_null0 00:32:18.197 17:51:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.197 17:51:55 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:18.197 17:51:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.197 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.197 17:51:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.197 17:51:55 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:18.198 17:51:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.198 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.198 17:51:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.198 17:51:55 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:18.198 17:51:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:18.198 17:51:55 -- common/autotest_common.sh@10 -- # set +x 00:32:18.198 [2024-11-16 17:51:55.553523] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:18.198 17:51:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:18.198 17:51:55 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:18.198 17:51:55 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:18.198 17:51:55 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:18.198 17:51:55 -- nvmf/common.sh@520 -- # config=() 00:32:18.198 17:51:55 -- nvmf/common.sh@520 -- # local subsystem config 00:32:18.198 17:51:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:18.198 17:51:55 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:18.198 17:51:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:18.198 { 00:32:18.198 "params": { 00:32:18.198 "name": "Nvme$subsystem", 00:32:18.198 "trtype": "$TEST_TRANSPORT", 00:32:18.198 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:18.198 "adrfam": "ipv4", 00:32:18.198 "trsvcid": "$NVMF_PORT", 00:32:18.198 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:18.198 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:18.198 "hdgst": ${hdgst:-false}, 00:32:18.198 "ddgst": ${ddgst:-false} 00:32:18.198 }, 00:32:18.198 "method": "bdev_nvme_attach_controller" 00:32:18.198 } 00:32:18.198 EOF 00:32:18.198 )") 00:32:18.198 17:51:55 -- target/dif.sh@82 -- # gen_fio_conf 00:32:18.198 17:51:55 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:18.198 17:51:55 -- target/dif.sh@54 -- # local file 00:32:18.198 17:51:55 -- target/dif.sh@56 -- # cat 00:32:18.198 17:51:55 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:18.198 17:51:55 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:18.198 17:51:55 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:18.198 17:51:55 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:18.198 17:51:55 -- common/autotest_common.sh@1330 -- # shift 00:32:18.198 17:51:55 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:18.198 17:51:55 -- nvmf/common.sh@542 -- # cat 00:32:18.198 17:51:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:18.198 17:51:55 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:18.198 17:51:55 -- target/dif.sh@72 -- # (( file <= files )) 00:32:18.198 17:51:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:18.198 17:51:55 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:18.198 17:51:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:18.198 17:51:55 -- nvmf/common.sh@544 -- # jq . 00:32:18.198 17:51:55 -- nvmf/common.sh@545 -- # IFS=, 00:32:18.198 17:51:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:18.198 "params": { 00:32:18.198 "name": "Nvme0", 00:32:18.198 "trtype": "tcp", 00:32:18.198 "traddr": "10.0.0.2", 00:32:18.198 "adrfam": "ipv4", 00:32:18.198 "trsvcid": "4420", 00:32:18.198 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:18.198 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:18.198 "hdgst": true, 00:32:18.198 "ddgst": true 00:32:18.198 }, 00:32:18.198 "method": "bdev_nvme_attach_controller" 00:32:18.198 }' 00:32:18.198 17:51:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:18.198 17:51:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:18.198 17:51:55 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:18.198 17:51:55 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:18.198 17:51:55 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:18.198 17:51:55 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:18.198 17:51:55 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:18.198 17:51:55 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:18.198 17:51:55 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:18.198 17:51:55 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:18.457 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:18.457 ... 00:32:18.457 fio-3.35 00:32:18.457 Starting 3 threads 00:32:18.457 EAL: No free 2048 kB hugepages reported on node 1 00:32:18.716 [2024-11-16 17:51:56.187336] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:18.716 [2024-11-16 17:51:56.187406] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:30.915 00:32:30.915 filename0: (groupid=0, jobs=1): err= 0: pid=1732014: Sat Nov 16 17:52:06 2024 00:32:30.915 read: IOPS=212, BW=26.6MiB/s (27.9MB/s)(267MiB/10045msec) 00:32:30.915 slat (nsec): min=4452, max=67687, avg=16553.73, stdev=3361.68 00:32:30.915 clat (usec): min=11298, max=51630, avg=14061.46, stdev=1447.70 00:32:30.915 lat (usec): min=11320, max=51648, avg=14078.01, stdev=1447.77 00:32:30.915 clat percentiles (usec): 00:32:30.915 | 1.00th=[11863], 5.00th=[12518], 10.00th=[12911], 20.00th=[13304], 00:32:30.915 | 30.00th=[13566], 40.00th=[13829], 50.00th=[13960], 60.00th=[14222], 00:32:30.915 | 70.00th=[14484], 80.00th=[14746], 90.00th=[15139], 95.00th=[15533], 00:32:30.915 | 99.00th=[16581], 99.50th=[16909], 99.90th=[21627], 99.95th=[47449], 00:32:30.915 | 99.99th=[51643] 00:32:30.915 bw ( KiB/s): min=26368, max=28416, per=33.75%, avg=27328.00, stdev=483.41, samples=20 00:32:30.915 iops : min= 206, max= 222, avg=213.50, stdev= 3.78, samples=20 00:32:30.915 lat (msec) : 20=99.77%, 50=0.19%, 100=0.05% 00:32:30.915 cpu : usr=95.71%, sys=3.80%, ctx=20, majf=0, minf=183 00:32:30.915 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:30.915 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.915 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.915 issued rwts: total=2137,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.915 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:30.915 filename0: (groupid=0, jobs=1): err= 0: pid=1732015: Sat Nov 16 17:52:06 2024 00:32:30.915 read: IOPS=214, BW=26.8MiB/s (28.1MB/s)(270MiB/10044msec) 00:32:30.915 slat (nsec): min=5073, max=45621, avg=17137.91, stdev=3753.59 00:32:30.915 clat (usec): min=10751, max=54224, avg=13928.74, stdev=1504.60 00:32:30.915 lat (usec): min=10769, max=54243, avg=13945.87, stdev=1504.65 00:32:30.915 clat percentiles (usec): 00:32:30.915 | 1.00th=[11731], 5.00th=[12387], 10.00th=[12780], 20.00th=[13173], 00:32:30.915 | 30.00th=[13435], 40.00th=[13698], 50.00th=[13829], 60.00th=[14091], 00:32:30.915 | 70.00th=[14222], 80.00th=[14615], 90.00th=[15008], 95.00th=[15401], 00:32:30.916 | 99.00th=[16319], 99.50th=[16909], 99.90th=[23987], 99.95th=[49546], 00:32:30.916 | 99.99th=[54264] 00:32:30.916 bw ( KiB/s): min=25651, max=28416, per=34.07%, avg=27586.55, stdev=655.84, samples=20 00:32:30.916 iops : min= 200, max= 222, avg=215.50, stdev= 5.19, samples=20 00:32:30.916 lat (msec) : 20=99.77%, 50=0.19%, 100=0.05% 00:32:30.916 cpu : usr=94.23%, sys=4.48%, ctx=129, majf=0, minf=120 00:32:30.916 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:30.916 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.916 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.916 issued rwts: total=2157,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.916 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:30.916 filename0: (groupid=0, jobs=1): err= 0: pid=1732016: Sat Nov 16 17:52:06 2024 00:32:30.916 read: IOPS=205, BW=25.6MiB/s (26.9MB/s)(258MiB/10044msec) 00:32:30.916 slat (nsec): min=4438, max=40791, avg=16942.34, stdev=3533.41 00:32:30.916 clat (usec): min=11280, max=51937, avg=14578.77, stdev=1452.64 00:32:30.916 lat (usec): min=11298, max=51953, avg=14595.71, stdev=1452.79 00:32:30.916 clat percentiles (usec): 00:32:30.916 | 1.00th=[12518], 5.00th=[13173], 10.00th=[13435], 20.00th=[13829], 00:32:30.916 | 30.00th=[14091], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:32:30.916 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15664], 95.00th=[16057], 00:32:30.916 | 99.00th=[17171], 99.50th=[17433], 99.90th=[23462], 99.95th=[47973], 00:32:30.916 | 99.99th=[52167] 00:32:30.916 bw ( KiB/s): min=25600, max=27392, per=32.55%, avg=26355.20, stdev=450.93, samples=20 00:32:30.916 iops : min= 200, max= 214, avg=205.90, stdev= 3.52, samples=20 00:32:30.916 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:32:30.916 cpu : usr=94.90%, sys=4.63%, ctx=23, majf=0, minf=144 00:32:30.916 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:30.916 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.916 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:30.916 issued rwts: total=2061,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:30.916 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:30.916 00:32:30.916 Run status group 0 (all jobs): 00:32:30.916 READ: bw=79.1MiB/s (82.9MB/s), 25.6MiB/s-26.8MiB/s (26.9MB/s-28.1MB/s), io=794MiB (833MB), run=10044-10045msec 00:32:30.916 17:52:06 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:30.916 17:52:06 -- target/dif.sh@43 -- # local sub 00:32:30.916 17:52:06 -- target/dif.sh@45 -- # for sub in "$@" 00:32:30.916 17:52:06 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:30.916 17:52:06 -- target/dif.sh@36 -- # local sub_id=0 00:32:30.916 17:52:06 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:30.916 17:52:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.916 17:52:06 -- common/autotest_common.sh@10 -- # set +x 00:32:30.916 17:52:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.916 17:52:06 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:30.916 17:52:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:30.916 17:52:06 -- common/autotest_common.sh@10 -- # set +x 00:32:30.916 17:52:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:30.916 00:32:30.916 real 0m11.062s 00:32:30.916 user 0m29.649s 00:32:30.916 sys 0m1.588s 00:32:30.916 17:52:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:30.916 17:52:06 -- common/autotest_common.sh@10 -- # set +x 00:32:30.916 ************************************ 00:32:30.916 END TEST fio_dif_digest 00:32:30.916 ************************************ 00:32:30.916 17:52:06 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:30.916 17:52:06 -- target/dif.sh@147 -- # nvmftestfini 00:32:30.916 17:52:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:30.916 17:52:06 -- nvmf/common.sh@116 -- # sync 00:32:30.916 17:52:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:30.916 17:52:06 -- nvmf/common.sh@119 -- # set +e 00:32:30.916 17:52:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:30.916 17:52:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:30.916 rmmod nvme_tcp 00:32:30.916 rmmod nvme_fabrics 00:32:30.916 rmmod nvme_keyring 00:32:30.916 17:52:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:30.916 17:52:06 -- nvmf/common.sh@123 -- # set -e 00:32:30.916 17:52:06 -- nvmf/common.sh@124 -- # return 0 00:32:30.916 17:52:06 -- nvmf/common.sh@477 -- # '[' -n 1725389 ']' 00:32:30.916 17:52:06 -- nvmf/common.sh@478 -- # killprocess 1725389 00:32:30.916 17:52:06 -- common/autotest_common.sh@936 -- # '[' -z 1725389 ']' 00:32:30.916 17:52:06 -- common/autotest_common.sh@940 -- # kill -0 1725389 00:32:30.916 17:52:06 -- common/autotest_common.sh@941 -- # uname 00:32:30.916 17:52:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:30.916 17:52:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1725389 00:32:30.916 17:52:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:30.916 17:52:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:30.916 17:52:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1725389' 00:32:30.916 killing process with pid 1725389 00:32:30.916 17:52:06 -- common/autotest_common.sh@955 -- # kill 1725389 00:32:30.916 17:52:06 -- common/autotest_common.sh@960 -- # wait 1725389 00:32:30.916 17:52:06 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:30.916 17:52:06 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:30.916 Waiting for block devices as requested 00:32:30.916 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:30.916 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:30.916 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:30.916 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:30.916 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:31.176 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:31.176 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:31.176 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:31.176 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:31.176 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:31.435 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:31.435 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:31.435 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:31.435 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:31.696 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:31.696 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:31.696 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:31.955 17:52:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:31.955 17:52:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:31.955 17:52:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:31.955 17:52:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:31.955 17:52:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:31.955 17:52:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:31.955 17:52:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:33.862 17:52:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:33.862 00:32:33.862 real 1m7.381s 00:32:33.862 user 6m28.585s 00:32:33.862 sys 0m17.934s 00:32:33.862 17:52:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:33.862 17:52:11 -- common/autotest_common.sh@10 -- # set +x 00:32:33.862 ************************************ 00:32:33.862 END TEST nvmf_dif 00:32:33.862 ************************************ 00:32:33.862 17:52:11 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:33.862 17:52:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:33.862 17:52:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:33.862 17:52:11 -- common/autotest_common.sh@10 -- # set +x 00:32:33.862 ************************************ 00:32:33.862 START TEST nvmf_abort_qd_sizes 00:32:33.862 ************************************ 00:32:33.862 17:52:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:33.862 * Looking for test storage... 00:32:33.862 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:33.862 17:52:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:33.862 17:52:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:33.862 17:52:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:34.120 17:52:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:34.120 17:52:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:34.120 17:52:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:34.120 17:52:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:34.120 17:52:11 -- scripts/common.sh@335 -- # IFS=.-: 00:32:34.120 17:52:11 -- scripts/common.sh@335 -- # read -ra ver1 00:32:34.120 17:52:11 -- scripts/common.sh@336 -- # IFS=.-: 00:32:34.120 17:52:11 -- scripts/common.sh@336 -- # read -ra ver2 00:32:34.120 17:52:11 -- scripts/common.sh@337 -- # local 'op=<' 00:32:34.120 17:52:11 -- scripts/common.sh@339 -- # ver1_l=2 00:32:34.120 17:52:11 -- scripts/common.sh@340 -- # ver2_l=1 00:32:34.120 17:52:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:34.120 17:52:11 -- scripts/common.sh@343 -- # case "$op" in 00:32:34.120 17:52:11 -- scripts/common.sh@344 -- # : 1 00:32:34.120 17:52:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:34.120 17:52:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:34.120 17:52:11 -- scripts/common.sh@364 -- # decimal 1 00:32:34.120 17:52:11 -- scripts/common.sh@352 -- # local d=1 00:32:34.120 17:52:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:34.120 17:52:11 -- scripts/common.sh@354 -- # echo 1 00:32:34.120 17:52:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:34.120 17:52:11 -- scripts/common.sh@365 -- # decimal 2 00:32:34.120 17:52:11 -- scripts/common.sh@352 -- # local d=2 00:32:34.120 17:52:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:34.120 17:52:11 -- scripts/common.sh@354 -- # echo 2 00:32:34.120 17:52:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:34.120 17:52:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:34.120 17:52:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:34.120 17:52:11 -- scripts/common.sh@367 -- # return 0 00:32:34.120 17:52:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:34.120 17:52:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:34.120 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:34.120 --rc genhtml_branch_coverage=1 00:32:34.120 --rc genhtml_function_coverage=1 00:32:34.120 --rc genhtml_legend=1 00:32:34.120 --rc geninfo_all_blocks=1 00:32:34.120 --rc geninfo_unexecuted_blocks=1 00:32:34.121 00:32:34.121 ' 00:32:34.121 17:52:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:34.121 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:34.121 --rc genhtml_branch_coverage=1 00:32:34.121 --rc genhtml_function_coverage=1 00:32:34.121 --rc genhtml_legend=1 00:32:34.121 --rc geninfo_all_blocks=1 00:32:34.121 --rc geninfo_unexecuted_blocks=1 00:32:34.121 00:32:34.121 ' 00:32:34.121 17:52:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:34.121 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:34.121 --rc genhtml_branch_coverage=1 00:32:34.121 --rc genhtml_function_coverage=1 00:32:34.121 --rc genhtml_legend=1 00:32:34.121 --rc geninfo_all_blocks=1 00:32:34.121 --rc geninfo_unexecuted_blocks=1 00:32:34.121 00:32:34.121 ' 00:32:34.121 17:52:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:34.121 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:34.121 --rc genhtml_branch_coverage=1 00:32:34.121 --rc genhtml_function_coverage=1 00:32:34.121 --rc genhtml_legend=1 00:32:34.121 --rc geninfo_all_blocks=1 00:32:34.121 --rc geninfo_unexecuted_blocks=1 00:32:34.121 00:32:34.121 ' 00:32:34.121 17:52:11 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:34.121 17:52:11 -- nvmf/common.sh@7 -- # uname -s 00:32:34.121 17:52:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:34.121 17:52:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:34.121 17:52:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:34.121 17:52:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:34.121 17:52:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:34.121 17:52:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:34.121 17:52:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:34.121 17:52:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:34.121 17:52:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:34.121 17:52:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:34.121 17:52:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:34.121 17:52:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:34.121 17:52:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:34.121 17:52:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:34.121 17:52:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:34.121 17:52:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:34.121 17:52:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:34.121 17:52:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:34.121 17:52:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:34.121 17:52:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:34.121 17:52:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:34.121 17:52:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:34.121 17:52:11 -- paths/export.sh@5 -- # export PATH 00:32:34.121 17:52:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:34.121 17:52:11 -- nvmf/common.sh@46 -- # : 0 00:32:34.121 17:52:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:34.121 17:52:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:34.121 17:52:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:34.121 17:52:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:34.121 17:52:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:34.121 17:52:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:34.121 17:52:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:34.121 17:52:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:34.121 17:52:11 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:34.121 17:52:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:34.121 17:52:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:34.121 17:52:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:34.121 17:52:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:34.121 17:52:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:34.121 17:52:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:34.121 17:52:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:34.121 17:52:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:34.121 17:52:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:34.121 17:52:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:34.121 17:52:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:34.121 17:52:11 -- common/autotest_common.sh@10 -- # set +x 00:32:36.025 17:52:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:36.025 17:52:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:36.025 17:52:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:36.025 17:52:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:36.025 17:52:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:36.025 17:52:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:36.025 17:52:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:36.025 17:52:13 -- nvmf/common.sh@294 -- # net_devs=() 00:32:36.025 17:52:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:36.025 17:52:13 -- nvmf/common.sh@295 -- # e810=() 00:32:36.025 17:52:13 -- nvmf/common.sh@295 -- # local -ga e810 00:32:36.025 17:52:13 -- nvmf/common.sh@296 -- # x722=() 00:32:36.025 17:52:13 -- nvmf/common.sh@296 -- # local -ga x722 00:32:36.025 17:52:13 -- nvmf/common.sh@297 -- # mlx=() 00:32:36.025 17:52:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:36.025 17:52:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:36.025 17:52:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:36.025 17:52:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:36.025 17:52:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:36.025 17:52:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:36.025 17:52:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:36.025 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:36.025 17:52:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:36.025 17:52:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:36.025 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:36.025 17:52:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:36.025 17:52:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:36.025 17:52:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:36.025 17:52:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:36.025 17:52:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:36.025 17:52:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:36.025 17:52:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:36.025 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:36.025 17:52:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:36.025 17:52:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:36.025 17:52:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:36.025 17:52:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:36.025 17:52:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:36.026 17:52:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:36.026 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:36.026 17:52:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:36.026 17:52:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:36.026 17:52:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:36.026 17:52:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:36.026 17:52:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:36.026 17:52:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:36.026 17:52:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:36.026 17:52:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:36.026 17:52:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:36.026 17:52:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:36.026 17:52:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:36.026 17:52:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:36.026 17:52:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:36.026 17:52:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:36.026 17:52:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:36.026 17:52:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:36.026 17:52:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:36.026 17:52:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:36.026 17:52:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:36.285 17:52:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:36.285 17:52:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:36.285 17:52:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:36.285 17:52:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:36.285 17:52:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:36.285 17:52:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:36.285 17:52:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:36.285 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:36.285 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:32:36.285 00:32:36.285 --- 10.0.0.2 ping statistics --- 00:32:36.285 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:36.285 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:32:36.285 17:52:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:36.285 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:36.285 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:32:36.285 00:32:36.285 --- 10.0.0.1 ping statistics --- 00:32:36.285 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:36.285 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:32:36.285 17:52:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:36.285 17:52:13 -- nvmf/common.sh@410 -- # return 0 00:32:36.285 17:52:13 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:36.285 17:52:13 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:37.665 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:37.665 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:37.665 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:37.665 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:37.665 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:37.665 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:37.665 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:37.665 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:37.665 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:37.665 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:37.665 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:37.665 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:37.665 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:37.665 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:37.665 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:37.665 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:38.602 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:38.602 17:52:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:38.602 17:52:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:38.602 17:52:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:38.602 17:52:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:38.602 17:52:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:38.602 17:52:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:38.602 17:52:15 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:38.602 17:52:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:38.602 17:52:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:38.602 17:52:15 -- common/autotest_common.sh@10 -- # set +x 00:32:38.602 17:52:15 -- nvmf/common.sh@469 -- # nvmfpid=1737034 00:32:38.602 17:52:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:38.602 17:52:15 -- nvmf/common.sh@470 -- # waitforlisten 1737034 00:32:38.602 17:52:15 -- common/autotest_common.sh@829 -- # '[' -z 1737034 ']' 00:32:38.602 17:52:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:38.602 17:52:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:38.602 17:52:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:38.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:38.602 17:52:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:38.602 17:52:15 -- common/autotest_common.sh@10 -- # set +x 00:32:38.602 [2024-11-16 17:52:15.964214] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:38.602 [2024-11-16 17:52:15.964304] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:38.602 EAL: No free 2048 kB hugepages reported on node 1 00:32:38.602 [2024-11-16 17:52:16.037178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:38.860 [2024-11-16 17:52:16.128074] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:38.860 [2024-11-16 17:52:16.128245] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:38.860 [2024-11-16 17:52:16.128267] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:38.860 [2024-11-16 17:52:16.128281] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:38.860 [2024-11-16 17:52:16.128366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:38.860 [2024-11-16 17:52:16.128434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:38.860 [2024-11-16 17:52:16.128525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:38.860 [2024-11-16 17:52:16.128527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:39.426 17:52:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:39.426 17:52:16 -- common/autotest_common.sh@862 -- # return 0 00:32:39.426 17:52:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:39.426 17:52:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:39.426 17:52:16 -- common/autotest_common.sh@10 -- # set +x 00:32:39.684 17:52:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:39.684 17:52:16 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:39.684 17:52:16 -- scripts/common.sh@312 -- # local nvmes 00:32:39.684 17:52:16 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:39.684 17:52:16 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:39.684 17:52:16 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:39.684 17:52:16 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:39.684 17:52:16 -- scripts/common.sh@322 -- # uname -s 00:32:39.684 17:52:16 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:39.684 17:52:16 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:39.684 17:52:16 -- scripts/common.sh@327 -- # (( 1 )) 00:32:39.684 17:52:16 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:39.684 17:52:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:39.684 17:52:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:39.684 17:52:16 -- common/autotest_common.sh@10 -- # set +x 00:32:39.684 ************************************ 00:32:39.684 START TEST spdk_target_abort 00:32:39.684 ************************************ 00:32:39.684 17:52:16 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:39.684 17:52:16 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:39.684 17:52:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:39.684 17:52:16 -- common/autotest_common.sh@10 -- # set +x 00:32:42.971 spdk_targetn1 00:32:42.971 17:52:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:42.971 17:52:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:42.971 17:52:19 -- common/autotest_common.sh@10 -- # set +x 00:32:42.971 [2024-11-16 17:52:19.787629] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:42.971 17:52:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:42.971 17:52:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:42.971 17:52:19 -- common/autotest_common.sh@10 -- # set +x 00:32:42.971 17:52:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:42.971 17:52:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:42.971 17:52:19 -- common/autotest_common.sh@10 -- # set +x 00:32:42.971 17:52:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:42.971 17:52:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:42.971 17:52:19 -- common/autotest_common.sh@10 -- # set +x 00:32:42.971 [2024-11-16 17:52:19.821155] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:42.971 17:52:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:42.971 17:52:19 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:42.971 EAL: No free 2048 kB hugepages reported on node 1 00:32:45.502 Initializing NVMe Controllers 00:32:45.502 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:45.502 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:45.502 Initialization complete. Launching workers. 00:32:45.502 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 13149, failed: 0 00:32:45.502 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1244, failed to submit 11905 00:32:45.502 success 766, unsuccess 478, failed 0 00:32:45.502 17:52:22 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:45.502 17:52:22 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:45.502 EAL: No free 2048 kB hugepages reported on node 1 00:32:48.791 [2024-11-16 17:52:26.176660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f530 is same with the state(5) to be set 00:32:48.791 [2024-11-16 17:52:26.176712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4f530 is same with the state(5) to be set 00:32:49.049 Initializing NVMe Controllers 00:32:49.049 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:49.049 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:49.049 Initialization complete. Launching workers. 00:32:49.049 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8601, failed: 0 00:32:49.049 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1187, failed to submit 7414 00:32:49.049 success 344, unsuccess 843, failed 0 00:32:49.049 17:52:26 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:49.049 17:52:26 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:49.049 EAL: No free 2048 kB hugepages reported on node 1 00:32:52.379 Initializing NVMe Controllers 00:32:52.379 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:52.379 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:52.379 Initialization complete. Launching workers. 00:32:52.379 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31758, failed: 0 00:32:52.379 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2666, failed to submit 29092 00:32:52.379 success 530, unsuccess 2136, failed 0 00:32:52.379 17:52:29 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:52.379 17:52:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:52.380 17:52:29 -- common/autotest_common.sh@10 -- # set +x 00:32:52.380 17:52:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:52.380 17:52:29 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:52.380 17:52:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:52.380 17:52:29 -- common/autotest_common.sh@10 -- # set +x 00:32:53.784 17:52:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:53.784 17:52:30 -- target/abort_qd_sizes.sh@62 -- # killprocess 1737034 00:32:53.784 17:52:30 -- common/autotest_common.sh@936 -- # '[' -z 1737034 ']' 00:32:53.784 17:52:30 -- common/autotest_common.sh@940 -- # kill -0 1737034 00:32:53.784 17:52:30 -- common/autotest_common.sh@941 -- # uname 00:32:53.784 17:52:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:53.784 17:52:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1737034 00:32:53.784 17:52:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:53.784 17:52:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:53.784 17:52:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1737034' 00:32:53.784 killing process with pid 1737034 00:32:53.784 17:52:30 -- common/autotest_common.sh@955 -- # kill 1737034 00:32:53.784 17:52:30 -- common/autotest_common.sh@960 -- # wait 1737034 00:32:53.784 00:32:53.784 real 0m14.224s 00:32:53.784 user 0m56.611s 00:32:53.784 sys 0m2.426s 00:32:53.784 17:52:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:53.784 17:52:31 -- common/autotest_common.sh@10 -- # set +x 00:32:53.784 ************************************ 00:32:53.784 END TEST spdk_target_abort 00:32:53.784 ************************************ 00:32:53.784 17:52:31 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:53.784 17:52:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:53.784 17:52:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:53.784 17:52:31 -- common/autotest_common.sh@10 -- # set +x 00:32:53.784 ************************************ 00:32:53.784 START TEST kernel_target_abort 00:32:53.784 ************************************ 00:32:53.784 17:52:31 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:53.784 17:52:31 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:53.784 17:52:31 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:53.784 17:52:31 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:53.784 17:52:31 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:53.784 17:52:31 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:53.784 17:52:31 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:53.784 17:52:31 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:53.784 17:52:31 -- nvmf/common.sh@627 -- # local block nvme 00:32:53.784 17:52:31 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:53.784 17:52:31 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:53.784 17:52:31 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:53.784 17:52:31 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:55.163 Waiting for block devices as requested 00:32:55.163 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:55.163 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:55.163 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:55.423 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:55.423 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:55.423 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:55.423 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:55.423 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:55.683 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:55.683 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:55.683 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:55.683 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:55.944 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:55.944 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:55.944 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:55.944 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:56.203 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:56.203 17:52:33 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:56.203 17:52:33 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:56.203 17:52:33 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:56.203 17:52:33 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:56.203 17:52:33 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:56.203 No valid GPT data, bailing 00:32:56.203 17:52:33 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:56.203 17:52:33 -- scripts/common.sh@393 -- # pt= 00:32:56.203 17:52:33 -- scripts/common.sh@394 -- # return 1 00:32:56.203 17:52:33 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:56.203 17:52:33 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:56.203 17:52:33 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:56.203 17:52:33 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:56.203 17:52:33 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:56.203 17:52:33 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:56.203 17:52:33 -- nvmf/common.sh@654 -- # echo 1 00:32:56.203 17:52:33 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:56.203 17:52:33 -- nvmf/common.sh@656 -- # echo 1 00:32:56.203 17:52:33 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:56.203 17:52:33 -- nvmf/common.sh@663 -- # echo tcp 00:32:56.203 17:52:33 -- nvmf/common.sh@664 -- # echo 4420 00:32:56.203 17:52:33 -- nvmf/common.sh@665 -- # echo ipv4 00:32:56.203 17:52:33 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:56.462 17:52:33 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:56.462 00:32:56.462 Discovery Log Number of Records 2, Generation counter 2 00:32:56.462 =====Discovery Log Entry 0====== 00:32:56.462 trtype: tcp 00:32:56.462 adrfam: ipv4 00:32:56.462 subtype: current discovery subsystem 00:32:56.462 treq: not specified, sq flow control disable supported 00:32:56.462 portid: 1 00:32:56.462 trsvcid: 4420 00:32:56.462 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:56.462 traddr: 10.0.0.1 00:32:56.462 eflags: none 00:32:56.462 sectype: none 00:32:56.462 =====Discovery Log Entry 1====== 00:32:56.462 trtype: tcp 00:32:56.462 adrfam: ipv4 00:32:56.462 subtype: nvme subsystem 00:32:56.462 treq: not specified, sq flow control disable supported 00:32:56.462 portid: 1 00:32:56.462 trsvcid: 4420 00:32:56.462 subnqn: kernel_target 00:32:56.462 traddr: 10.0.0.1 00:32:56.462 eflags: none 00:32:56.462 sectype: none 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:56.462 17:52:33 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:56.462 EAL: No free 2048 kB hugepages reported on node 1 00:32:59.758 Initializing NVMe Controllers 00:32:59.758 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:59.758 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:59.758 Initialization complete. Launching workers. 00:32:59.758 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 45400, failed: 0 00:32:59.758 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 45400, failed to submit 0 00:32:59.758 success 0, unsuccess 45400, failed 0 00:32:59.758 17:52:36 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:59.758 17:52:36 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:59.758 EAL: No free 2048 kB hugepages reported on node 1 00:33:03.047 Initializing NVMe Controllers 00:33:03.047 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:03.047 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:03.047 Initialization complete. Launching workers. 00:33:03.047 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 82538, failed: 0 00:33:03.047 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20790, failed to submit 61748 00:33:03.047 success 0, unsuccess 20790, failed 0 00:33:03.047 17:52:39 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:33:03.047 17:52:39 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:33:03.047 EAL: No free 2048 kB hugepages reported on node 1 00:33:06.336 Initializing NVMe Controllers 00:33:06.336 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:06.336 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:06.336 Initialization complete. Launching workers. 00:33:06.336 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79580, failed: 0 00:33:06.336 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19846, failed to submit 59734 00:33:06.336 success 0, unsuccess 19846, failed 0 00:33:06.336 17:52:43 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:06.336 17:52:43 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:06.336 17:52:43 -- nvmf/common.sh@677 -- # echo 0 00:33:06.336 17:52:43 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:06.336 17:52:43 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:06.336 17:52:43 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:06.336 17:52:43 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:06.336 17:52:43 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:06.336 17:52:43 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:06.336 00:33:06.336 real 0m11.949s 00:33:06.336 user 0m5.916s 00:33:06.336 sys 0m2.311s 00:33:06.336 17:52:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:06.336 17:52:43 -- common/autotest_common.sh@10 -- # set +x 00:33:06.336 ************************************ 00:33:06.336 END TEST kernel_target_abort 00:33:06.336 ************************************ 00:33:06.336 17:52:43 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:06.336 17:52:43 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:06.336 17:52:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:06.336 17:52:43 -- nvmf/common.sh@116 -- # sync 00:33:06.336 17:52:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:06.336 17:52:43 -- nvmf/common.sh@119 -- # set +e 00:33:06.336 17:52:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:06.336 17:52:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:06.336 rmmod nvme_tcp 00:33:06.336 rmmod nvme_fabrics 00:33:06.336 rmmod nvme_keyring 00:33:06.336 17:52:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:06.336 17:52:43 -- nvmf/common.sh@123 -- # set -e 00:33:06.336 17:52:43 -- nvmf/common.sh@124 -- # return 0 00:33:06.336 17:52:43 -- nvmf/common.sh@477 -- # '[' -n 1737034 ']' 00:33:06.336 17:52:43 -- nvmf/common.sh@478 -- # killprocess 1737034 00:33:06.336 17:52:43 -- common/autotest_common.sh@936 -- # '[' -z 1737034 ']' 00:33:06.336 17:52:43 -- common/autotest_common.sh@940 -- # kill -0 1737034 00:33:06.336 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1737034) - No such process 00:33:06.336 17:52:43 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1737034 is not found' 00:33:06.336 Process with pid 1737034 is not found 00:33:06.336 17:52:43 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:06.336 17:52:43 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:06.906 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:06.906 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:06.906 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:06.906 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:06.906 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:06.906 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:06.906 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:06.906 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:07.167 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:07.167 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:07.167 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:07.167 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:07.167 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:07.167 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:07.167 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:07.167 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:07.167 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:07.167 17:52:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:07.167 17:52:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:07.167 17:52:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:07.167 17:52:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:07.167 17:52:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:07.167 17:52:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:07.167 17:52:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:09.705 17:52:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:09.705 00:33:09.705 real 0m35.356s 00:33:09.705 user 1m4.932s 00:33:09.705 sys 0m8.131s 00:33:09.705 17:52:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:09.705 17:52:46 -- common/autotest_common.sh@10 -- # set +x 00:33:09.705 ************************************ 00:33:09.705 END TEST nvmf_abort_qd_sizes 00:33:09.705 ************************************ 00:33:09.705 17:52:46 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:09.705 17:52:46 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:09.705 17:52:46 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:09.705 17:52:46 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:09.705 17:52:46 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:09.705 17:52:46 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:09.705 17:52:46 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:09.705 17:52:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:09.705 17:52:46 -- common/autotest_common.sh@10 -- # set +x 00:33:09.705 17:52:46 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:09.705 17:52:46 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:09.705 17:52:46 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:09.705 17:52:46 -- common/autotest_common.sh@10 -- # set +x 00:33:11.082 INFO: APP EXITING 00:33:11.082 INFO: killing all VMs 00:33:11.082 INFO: killing vhost app 00:33:11.082 INFO: EXIT DONE 00:33:12.457 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:12.457 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:12.457 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:12.457 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:12.457 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:12.457 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:12.457 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:12.457 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:12.457 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:12.457 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:12.457 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:12.457 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:12.457 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:12.457 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:12.457 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:12.457 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:12.457 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:13.837 Cleaning 00:33:13.837 Removing: /var/run/dpdk/spdk0/config 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:13.837 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:13.837 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:13.837 Removing: /var/run/dpdk/spdk1/config 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:13.837 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:13.837 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:13.837 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:13.837 Removing: /var/run/dpdk/spdk2/config 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:13.837 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:13.837 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:13.837 Removing: /var/run/dpdk/spdk3/config 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:13.837 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:13.837 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:13.837 Removing: /var/run/dpdk/spdk4/config 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:13.837 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:13.837 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:13.837 Removing: /dev/shm/bdev_svc_trace.1 00:33:13.837 Removing: /dev/shm/nvmf_trace.0 00:33:13.837 Removing: /dev/shm/spdk_tgt_trace.pid1457077 00:33:13.837 Removing: /var/run/dpdk/spdk0 00:33:13.837 Removing: /var/run/dpdk/spdk1 00:33:13.837 Removing: /var/run/dpdk/spdk2 00:33:13.837 Removing: /var/run/dpdk/spdk3 00:33:13.837 Removing: /var/run/dpdk/spdk4 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1455356 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1456121 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1457077 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1457580 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1458924 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1459878 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1460068 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1460401 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1460743 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1460952 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1461111 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1461371 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1461584 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1461920 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1464468 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1464763 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1464939 00:33:13.837 Removing: /var/run/dpdk/spdk_pid1465075 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1465457 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1465528 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1465962 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1466108 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1466278 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1466422 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1466586 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1466728 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1467102 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1467264 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1467592 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1467771 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1467790 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1467972 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1468116 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1468271 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1468538 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1468699 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1468837 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1468998 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1469255 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1469425 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1469564 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1469719 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1469978 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1470145 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1470291 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1470446 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1470665 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1470868 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1471016 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1471175 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1471365 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1471587 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1471742 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1471896 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1472097 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1472427 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1472573 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1472736 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1472892 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1473309 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1473717 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1473959 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1474113 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1474381 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1474531 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1474694 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1474852 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1475122 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1475260 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1475429 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1475629 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1475849 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1475931 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1476220 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1478502 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1536028 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1538734 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1545767 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1549249 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1551630 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1552045 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1556073 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1556075 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1556751 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1557311 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1557985 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1558396 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1558406 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1558665 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1558687 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1558809 00:33:13.838 Removing: /var/run/dpdk/spdk_pid1559372 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1560040 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1560716 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1561118 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1561134 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1561277 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1562539 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1563636 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1569443 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1569727 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1572415 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1576316 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1578449 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1585203 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1590621 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1591966 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1592655 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1603913 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1606166 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1609124 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1610343 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1611712 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1611859 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1612137 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1612284 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1612881 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1614258 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1615267 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1615718 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1619341 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1622799 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1626444 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1650887 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1653720 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1657552 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1658665 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1660307 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1662979 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1665514 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1669913 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1669922 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1672862 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1673002 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1673237 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1673539 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1673546 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1674651 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1675871 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1677094 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1678308 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1679557 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1680855 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1684753 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1685167 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1686557 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1687317 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1691215 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1693891 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1697508 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1701149 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1704817 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1705237 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1705700 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1706200 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1706797 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1707345 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1707814 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1708319 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1710994 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1711159 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1715022 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1715202 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1716970 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1722138 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1722144 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1725769 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1727281 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1728722 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1729604 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1731057 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1731955 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1737475 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1737879 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1738282 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1739777 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1740187 00:33:14.097 Removing: /var/run/dpdk/spdk_pid1740601 00:33:14.097 Clean 00:33:14.097 killing process with pid 1426914 00:33:22.219 killing process with pid 1426911 00:33:22.219 killing process with pid 1426913 00:33:22.478 killing process with pid 1426912 00:33:22.478 17:52:59 -- common/autotest_common.sh@1446 -- # return 0 00:33:22.478 17:52:59 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:22.478 17:52:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:22.478 17:52:59 -- common/autotest_common.sh@10 -- # set +x 00:33:22.478 17:52:59 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:22.478 17:52:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:22.478 17:52:59 -- common/autotest_common.sh@10 -- # set +x 00:33:22.478 17:52:59 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:22.478 17:52:59 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:22.478 17:52:59 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:22.478 17:52:59 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:22.478 17:52:59 -- spdk/autotest.sh@383 -- # hostname 00:33:22.478 17:52:59 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:22.738 geninfo: WARNING: invalid characters removed from testname! 00:33:54.843 17:53:27 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:54.843 17:53:31 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:57.436 17:53:34 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:59.965 17:53:37 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:02.503 17:53:39 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:05.788 17:53:42 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:08.320 17:53:45 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:08.320 17:53:45 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:08.320 17:53:45 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:08.320 17:53:45 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:08.320 17:53:45 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:08.320 17:53:45 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:08.320 17:53:45 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:08.320 17:53:45 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:08.320 17:53:45 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:08.320 17:53:45 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:08.320 17:53:45 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:08.320 17:53:45 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:08.320 17:53:45 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:08.320 17:53:45 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:08.320 17:53:45 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:08.320 17:53:45 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:08.320 17:53:45 -- scripts/common.sh@343 -- $ case "$op" in 00:34:08.320 17:53:45 -- scripts/common.sh@344 -- $ : 1 00:34:08.320 17:53:45 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:08.320 17:53:45 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:08.320 17:53:45 -- scripts/common.sh@364 -- $ decimal 1 00:34:08.320 17:53:45 -- scripts/common.sh@352 -- $ local d=1 00:34:08.320 17:53:45 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:08.320 17:53:45 -- scripts/common.sh@354 -- $ echo 1 00:34:08.320 17:53:45 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:08.320 17:53:45 -- scripts/common.sh@365 -- $ decimal 2 00:34:08.320 17:53:45 -- scripts/common.sh@352 -- $ local d=2 00:34:08.320 17:53:45 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:08.320 17:53:45 -- scripts/common.sh@354 -- $ echo 2 00:34:08.320 17:53:45 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:08.320 17:53:45 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:08.320 17:53:45 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:08.320 17:53:45 -- scripts/common.sh@367 -- $ return 0 00:34:08.320 17:53:45 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:08.320 17:53:45 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:08.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:08.320 --rc genhtml_branch_coverage=1 00:34:08.320 --rc genhtml_function_coverage=1 00:34:08.320 --rc genhtml_legend=1 00:34:08.320 --rc geninfo_all_blocks=1 00:34:08.320 --rc geninfo_unexecuted_blocks=1 00:34:08.320 00:34:08.320 ' 00:34:08.320 17:53:45 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:08.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:08.320 --rc genhtml_branch_coverage=1 00:34:08.320 --rc genhtml_function_coverage=1 00:34:08.320 --rc genhtml_legend=1 00:34:08.320 --rc geninfo_all_blocks=1 00:34:08.320 --rc geninfo_unexecuted_blocks=1 00:34:08.320 00:34:08.320 ' 00:34:08.320 17:53:45 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:08.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:08.320 --rc genhtml_branch_coverage=1 00:34:08.320 --rc genhtml_function_coverage=1 00:34:08.320 --rc genhtml_legend=1 00:34:08.320 --rc geninfo_all_blocks=1 00:34:08.320 --rc geninfo_unexecuted_blocks=1 00:34:08.320 00:34:08.320 ' 00:34:08.320 17:53:45 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:08.320 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:08.320 --rc genhtml_branch_coverage=1 00:34:08.320 --rc genhtml_function_coverage=1 00:34:08.320 --rc genhtml_legend=1 00:34:08.320 --rc geninfo_all_blocks=1 00:34:08.320 --rc geninfo_unexecuted_blocks=1 00:34:08.320 00:34:08.320 ' 00:34:08.320 17:53:45 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:08.320 17:53:45 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:08.320 17:53:45 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:08.320 17:53:45 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:08.320 17:53:45 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:08.320 17:53:45 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:08.320 17:53:45 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:08.320 17:53:45 -- paths/export.sh@5 -- $ export PATH 00:34:08.320 17:53:45 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:08.320 17:53:45 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:08.320 17:53:45 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:08.320 17:53:45 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1731776025.XXXXXX 00:34:08.320 17:53:45 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1731776025.OXbyqb 00:34:08.320 17:53:45 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:08.320 17:53:45 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:34:08.320 17:53:45 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:08.320 17:53:45 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:08.320 17:53:45 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:08.320 17:53:45 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:08.320 17:53:45 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:08.320 17:53:45 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:08.320 17:53:45 -- common/autotest_common.sh@10 -- $ set +x 00:34:08.320 17:53:45 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:08.320 17:53:45 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:08.320 17:53:45 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:08.320 17:53:45 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:08.320 17:53:45 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:08.320 17:53:45 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:08.320 17:53:45 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:08.320 17:53:45 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:08.320 17:53:45 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:08.320 17:53:45 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:08.320 17:53:45 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:08.320 + [[ -n 1371909 ]] 00:34:08.320 + sudo kill 1371909 00:34:08.331 [Pipeline] } 00:34:08.346 [Pipeline] // stage 00:34:08.350 [Pipeline] } 00:34:08.364 [Pipeline] // timeout 00:34:08.369 [Pipeline] } 00:34:08.383 [Pipeline] // catchError 00:34:08.387 [Pipeline] } 00:34:08.402 [Pipeline] // wrap 00:34:08.408 [Pipeline] } 00:34:08.421 [Pipeline] // catchError 00:34:08.430 [Pipeline] stage 00:34:08.433 [Pipeline] { (Epilogue) 00:34:08.445 [Pipeline] catchError 00:34:08.447 [Pipeline] { 00:34:08.459 [Pipeline] echo 00:34:08.461 Cleanup processes 00:34:08.467 [Pipeline] sh 00:34:08.756 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:08.756 1752907 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:08.770 [Pipeline] sh 00:34:09.056 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:09.056 ++ grep -v 'sudo pgrep' 00:34:09.056 ++ awk '{print $1}' 00:34:09.056 + sudo kill -9 00:34:09.056 + true 00:34:09.069 [Pipeline] sh 00:34:09.354 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:19.334 [Pipeline] sh 00:34:19.623 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:19.623 Artifacts sizes are good 00:34:19.639 [Pipeline] archiveArtifacts 00:34:19.647 Archiving artifacts 00:34:19.846 [Pipeline] sh 00:34:20.157 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:20.173 [Pipeline] cleanWs 00:34:20.183 [WS-CLEANUP] Deleting project workspace... 00:34:20.183 [WS-CLEANUP] Deferred wipeout is used... 00:34:20.191 [WS-CLEANUP] done 00:34:20.193 [Pipeline] } 00:34:20.210 [Pipeline] // catchError 00:34:20.222 [Pipeline] sh 00:34:20.505 + logger -p user.info -t JENKINS-CI 00:34:20.514 [Pipeline] } 00:34:20.527 [Pipeline] // stage 00:34:20.532 [Pipeline] } 00:34:20.546 [Pipeline] // node 00:34:20.552 [Pipeline] End of Pipeline 00:34:20.588 Finished: SUCCESS